2024-09-10T23:40:57.937 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:40:57.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:40:58.065 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899807' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTSt0qdfx05jJvNf1csLmkM0boz2yVFUlKs20a065MUyLLQx176QZmPrRPCQiw/fu4z7ITocc9JBRenXodI94k= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8LkS/2dP29VBekttC18U6RbAX58A6uqMpY4Cqq/0DaP/mXLbSBIqtBEZm2D3fB958QOf0S3dMwTZOSzF6Z6JA= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWqN3tGlLF6xFZAkDa7i91vbusN02Nv2TUrd4rjYkgybF3q2xndw2XhwZoNMVYsGex3NDUh9O53W8cSRDeP0PE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:40:58.066 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:40:58.067 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:40:58.067 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:40:58.068 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:40:58.090 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:40:58.091 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:40:58.091 INFO:teuthology.packaging:ref: None 2024-09-10T23:40:58.091 INFO:teuthology.packaging:tag: None 2024-09-10T23:40:58.091 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:40:58.091 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:40:58.091 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:40:58.252 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:40:58.254 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:40:58.260 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:40:58.260 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:40:58.267 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:40:58.291 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:40:58.299 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:40:58.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:36:08.211044', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTSt0qdfx05jJvNf1csLmkM0boz2yVFUlKs20a065MUyLLQx176QZmPrRPCQiw/fu4z7ITocc9JBRenXodI94k='} 2024-09-10T23:40:58.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:36:08.212032', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8LkS/2dP29VBekttC18U6RbAX58A6uqMpY4Cqq/0DaP/mXLbSBIqtBEZm2D3fB958QOf0S3dMwTZOSzF6Z6JA='} 2024-09-10T23:40:58.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:36:08.209852', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWqN3tGlLF6xFZAkDa7i91vbusN02Nv2TUrd4rjYkgybF3q2xndw2XhwZoNMVYsGex3NDUh9O53W8cSRDeP0PE='} 2024-09-10T23:40:58.396 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:40:58.403 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T23:40:58.403 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T23:40:58.403 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T23:40:58.403 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:40:58.515 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f62d4d07be0>, signals=[15]) 2024-09-10T23:40:58.515 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:40:58.521 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:40:58.521 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T23:40:58.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:40:58.607 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T23:40:58.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:40:58.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-10T23:40:58.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:40:58.772 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:40:58.777 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-10T23:40:58.795 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-10T23:40:58.796 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-10T23:40:58.854 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-09-10T23:40:58.854 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-09-10T23:40:58.854 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:40:58.855 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:40:58.856 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-10T23:40:58.890 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-09-10T23:40:58.908 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-09-10T23:40:58.908 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:40:58.967 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-09-10T23:40:58.998 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-10T23:40:59.017 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-10T23:40:59.017 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-10T23:40:59.074 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-09-10T23:40:59.074 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-09-10T23:40:59.074 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-09-10T23:40:59.074 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:40:59.074 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:40:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:40:59.075 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-10T23:40:59.098 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:40:59.108 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:40:59.126 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:40:59.126 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:40:59.129 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:40:59.131 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:40:59.147 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:40:59.154 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:40:59.154 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:40:59.187 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:40:59.189 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:40:59.216 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:40:59.323 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:40:59.338 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:40:59.338 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T23:40:59.339 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T23:40:59.339 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:40:59.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:40:59.356 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-10T23:40:59.415 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:40:59.415 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-503.el9.x86_64 2024-09-10T23:40:59.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-09-10T23:41:01.866 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T23:41:06.367 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-10T23:41:10.926 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-10T23:41:12.393 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-10T23:41:13.281 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T23:41:18.903 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T23:41:21.027 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T23:41:21.027 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T23:41:21.106 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-10T23:41:21.122 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-10T23:41:21.122 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:41:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 79 M 2024-09-10T23:41:21.124 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 126 M 2024-09-10T23:41:21.124 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-10T23:41:21.438 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 77 kB/s | 23 kB 00:00 2024-09-10T23:41:24.188 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 10 MB/s | 29 MB 00:02 2024-09-10T23:41:24.522 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.6 MB/s | 16 MB 00:03 2024-09-10T23:41:28.405 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 4.8 MB/s | 35 MB 00:07 2024-09-10T23:41:28.405 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:41:28.405 INFO:teuthology.orchestra.run.smithi019.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-10T23:41:29.119 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-10T23:41:29.474 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-10T23:41:29.474 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-10T23:41:30.469 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-10T23:41:30.469 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-10T23:41:33.046 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-10T23:41:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:41:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:41:36.581 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:41:36.709 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:41:41.821 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:41:41.868 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:41:47.010 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:42:26.631 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:42:26.673 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:42:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:42:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:42:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:42:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:42:27.858 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:42:27.859 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-10T23:42:28.210 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:42:28.303 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:42:28.303 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:42:28.303 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T23:42:28.304 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T23:42:28.304 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T23:42:28.304 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T23:42:28.304 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T23:42:28.304 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:42:28.363 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:42:28.363 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:42:28.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-09-10T23:42:28.398 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-09-10T23:42:28.398 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 82.el9 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8274670 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:42:28.399 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:42:28.400 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:42:28.401 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:42:28.401 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-505.el9.x86_64 2024-09-10T23:42:28.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:42:29.153 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-10T23:42:30.393 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:42:30.425 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-10T23:42:30.427 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-10T23:42:30.442 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.ZknasdW3gN 2024-09-10T23:42:30.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZknasdW3gN 2024-09-10T23:42:30.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.ZknasdW3gN 2024-09-10T23:42:30.654 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.ZknasdW3gN is 6KB 2024-09-10T23:42:30.702 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.ZknasdW3gN 2024-09-10T23:42:30.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:42:30.787 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:42:30.787 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:42:30.787 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:42:30.787 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T23:42:30.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T23:42:31.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-10T23:43:01.065 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T23:43:01.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T23:43:01.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:43:19.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-09-10T23:43:28.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T23:43:28.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:44:28.625 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:44:40.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T23:44:40.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:44:41.061 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-10T23:44:41.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T23:44:41.424 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T23:44:41.424 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-10T23:44:41.442 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-505.el9.x86_64 2024-09-10T23:44:41.442 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T23:44:41.442 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:44:41.442 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:44:42.443 DEBUG:teuthology.parallel:result is None 2024-09-10T23:44:42.443 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:44:42.451 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:44:42.451 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:44:42.454 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:44:42.457 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:44:42.475 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:44:42.485 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:44:42.496 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:44:42.497 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:44:42.512 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:44:42.515 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:44:42.619 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:44:42.628 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:44:42.628 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:44:42.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:44:42.646 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:44:42.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:44:42.663 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:44:42.665 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:44:42.688 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:44:42.727 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:44:42.745 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:44:42.761 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:44:42.770 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:44:42.783 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:44:42.785 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:44:42.786 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:44:42.795 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:44:42.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:44:42.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:44:42.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:44:42.828 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:44:42.840 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:44:42.840 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:44:42.867 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:44:42.869 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:44:42.887 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:44:42.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:44:43.020 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:44:43.110 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:44:43.147 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:44:43.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:44:43.215 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:44:43.265 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:44:43.312 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:44:43.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:44:43.439 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:44:43.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:44:43.505 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:44:43.558 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:44:43.599 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:44:43.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:44:43.727 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:44:43.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:44:43.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-10T23:44:43.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-09-10T23:44:43.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-10T23:44:43.834 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:44:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:44:43.881 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:44:44.340 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:44:44.347 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:44:44.347 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:44:44.365 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:44:44.375 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T23:44:44.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-09-10T23:44:44.442 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-09-10T23:44:44.444 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-09-10T23:44:44.503 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-09-10T23:44:44.505 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-09-10T23:44:44.566 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-09-10T23:44:44.568 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:44:44.568 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-09-10T23:44:44.601 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-09-10T23:44:44.601 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-09-10T23:44:44.626 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-09-10T23:44:44.627 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-09-10T23:44:44.648 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-09-10T23:44:44.648 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:44:44.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:44:44.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:44:44.679 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:44:44.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:44:44.709 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:44:44.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:44:44.739 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:44:44.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:44:44.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:44:44.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:44:44.841 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:44:44.850 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:44:44.862 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:44:44.863 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi131.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:49:11.355 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-09-10T23:49:11.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T23:49:11.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:49:11.462 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-10T23:49:11.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T23:49:11.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T23:49:11.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:49:11.647 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-10T23:49:11.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T23:49:11.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T23:49:11.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:49:11.809 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-10T23:49:11.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T23:49:11.893 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:49:11.904 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:49:11.904 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:49:11.905 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:49:11.907 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:49:11.907 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:49:11.910 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:49:11.910 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:49:11.939 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:49:11.940 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:49:11.954 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:49:11.956 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:49:11.964 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:49:11.979 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:49:11.980 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-09-10T23:49:11.983 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-09-10T23:49:11.991 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-09-10T23:49:11.996 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-09-10T23:49:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-09-10T23:49:12.007 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:49:12.011 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:49:12.015 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-09-10T23:49:12.021 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:49:12.026 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:49:12.030 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:49:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:49:12.079 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:49:12.082 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:49:12.082 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-09-10T23:49:12.082 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.082 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.082 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.082 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.090 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:49:12.093 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:49:12.093 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-10T23:49:12.094 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.094 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.094 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.094 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.107 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:49:12.111 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:49:12.111 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-10T23:49:12.111 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.111 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.111 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.111 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:49:12.112 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:49:12.120 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:49:12.120 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:49:12.120 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:49:12.120 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:49:12.126 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:49:12.126 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T23:49:12.126 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:49:12.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:49:12.128 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:49:12.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:49:12.129 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:49:12.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:49:12.281 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:49:12.282 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:49:12.293 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:49:12.293 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:49:12.304 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:49:12.304 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:49:12.411 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:49:12.411 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:49:12.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:49:12.416 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:49:12.417 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:49:12.417 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:49:12.425 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:49:12.426 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:49:12.426 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:49:12.439 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:49:12.439 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:49:12.443 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:49:12.443 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:49:12.452 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:49:12.452 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:49:12.507 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:49:12.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:49:12.518 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:49:12.585 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:49:12.586 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:49:12.593 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:49:12.651 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-09-10T23:49:12.652 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-09-10T23:49:12.653 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-09-10T23:49:12.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-09-10T23:49:12.657 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-09-10T23:49:12.659 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-09-10T23:49:12.876 INFO:teuthology.orchestra.run.smithi131.stdout:45 files removed 2024-09-10T23:49:12.881 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-09-10T23:49:12.900 INFO:teuthology.orchestra.run.smithi019.stdout:45 files removed 2024-09-10T23:49:12.903 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:49:12.908 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:49:12.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:49:13.451 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-10T23:49:13.466 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-10T23:49:13.497 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-10T23:49:13.751 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-10T23:49:13.758 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 96 kB/s | 24 kB 00:00 2024-09-10T23:49:13.790 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-10T23:49:14.027 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T23:49:14.033 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T23:49:14.065 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T23:49:14.732 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-10T23:49:15.452 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-09-10T23:49:16.758 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-10T23:49:17.325 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-10T23:49:17.470 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-10T23:49:22.975 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-10T23:49:23.263 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-10T23:49:24.325 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 20 MB 00:06 2024-09-10T23:49:24.559 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-10T23:49:24.671 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-10T23:49:25.672 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T23:49:25.709 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-10T23:49:28.843 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-10T23:49:30.552 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-10T23:49:31.215 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T23:49:31.322 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-10T23:49:31.590 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-10T23:49:33.519 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:49:33.520 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:49:33.533 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:49:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:49:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:49:33.535 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:49:33.537 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:49:33.540 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:49:33.541 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:49:33.603 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-10T23:49:33.617 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:49:33.618 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:49:33.619 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:49:33.620 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:49:33.621 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:49:33.622 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:49:33.623 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:49:33.624 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:49:33.625 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:49:33.626 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:49:33.627 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:49:33.628 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:49:33.629 INFO:teuthology.orchestra.run.smithi131.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout:Install 149 Packages 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 8 Packages 2024-09-10T23:49:33.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:49:33.631 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 240 M 2024-09-10T23:49:33.631 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-10T23:49:33.814 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:49:33.815 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:49:33.827 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:49:33.828 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:49:33.828 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:49:33.829 INFO:teuthology.orchestra.run.smithi019.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:49:33.831 INFO:teuthology.orchestra.run.smithi019.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:49:33.833 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:49:33.834 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:49:33.904 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-10T23:49:33.918 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-09-10T23:49:33.918 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-10T23:49:33.918 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-09-10T23:49:33.918 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:49:33.919 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:49:33.920 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:49:33.921 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:49:33.922 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:49:33.923 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:49:33.924 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:49:33.925 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:49:33.926 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:49:33.927 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:49:33.928 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:49:33.929 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:49:33.930 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:49:33.931 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:49:33.931 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:49:33.931 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:49:33.931 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:49:33.931 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:49:33.931 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:49:33.932 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:49:33.933 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout:Install 149 Packages 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 8 Packages 2024-09-10T23:49:33.934 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:49:33.935 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 240 M 2024-09-10T23:49:33.935 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-10T23:49:34.375 INFO:teuthology.orchestra.run.smithi131.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi131.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-10T23:49:34.717 INFO:teuthology.orchestra.run.smithi131.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-10T23:49:34.742 INFO:teuthology.orchestra.run.smithi131.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.1 MB/s | 145 kB 00:00 2024-09-10T23:49:34.859 INFO:teuthology.orchestra.run.smithi131.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 2.4 MB 00:00 2024-09-10T23:49:34.971 INFO:teuthology.orchestra.run.smithi019.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-09-10T23:49:34.984 INFO:teuthology.orchestra.run.smithi131.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-10T23:49:35.159 INFO:teuthology.orchestra.run.smithi131.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-10T23:49:35.376 INFO:teuthology.orchestra.run.smithi131.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 19 MB/s | 22 MB 00:01 2024-09-10T23:49:35.387 INFO:teuthology.orchestra.run.smithi019.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.1 MB/s | 900 kB 00:00 2024-09-10T23:49:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 505 kB/s | 25 kB 00:00 2024-09-10T23:49:35.504 INFO:teuthology.orchestra.run.smithi019.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.2 MB/s | 145 kB 00:00 2024-09-10T23:49:35.785 INFO:teuthology.orchestra.run.smithi131.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 17 MB/s | 11 MB 00:00 2024-09-10T23:49:35.835 INFO:teuthology.orchestra.run.smithi131.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T23:49:35.894 INFO:teuthology.orchestra.run.smithi131.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 465 kB/s | 27 kB 00:00 2024-09-10T23:49:35.953 INFO:teuthology.orchestra.run.smithi131.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 543 kB/s | 32 kB 00:00 2024-09-10T23:49:36.070 INFO:teuthology.orchestra.run.smithi131.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 6.3 MB/s | 755 kB 00:00 2024-09-10T23:49:36.136 INFO:teuthology.orchestra.run.smithi131.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-10T23:49:36.203 INFO:teuthology.orchestra.run.smithi131.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T23:49:36.338 INFO:teuthology.orchestra.run.smithi131.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 3.7 MB/s | 507 kB 00:00 2024-09-10T23:49:36.505 INFO:teuthology.orchestra.run.smithi019.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 2.4 MB/s | 2.4 MB 00:00 2024-09-10T23:49:36.521 INFO:teuthology.orchestra.run.smithi131.stdout:(18/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 17 MB 00:01 2024-09-10T23:49:36.596 INFO:teuthology.orchestra.run.smithi131.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 605 kB/s | 45 kB 00:00 2024-09-10T23:49:36.672 INFO:teuthology.orchestra.run.smithi131.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.9 MB/s | 143 kB 00:00 2024-09-10T23:49:36.747 INFO:teuthology.orchestra.run.smithi131.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.1 MB/s | 161 kB 00:00 2024-09-10T23:49:36.822 INFO:teuthology.orchestra.run.smithi131.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-10T23:49:36.847 INFO:teuthology.orchestra.run.smithi131.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 3.1 MB/s | 321 kB 00:00 2024-09-10T23:49:36.890 INFO:teuthology.orchestra.run.smithi131.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-10T23:49:36.915 INFO:teuthology.orchestra.run.smithi131.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.5 MB/s | 99 kB 00:00 2024-09-10T23:49:36.957 INFO:teuthology.orchestra.run.smithi131.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-10T23:49:37.037 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-10T23:49:37.040 INFO:teuthology.orchestra.run.smithi131.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.0 MB/s | 171 kB 00:00 2024-09-10T23:49:37.088 INFO:teuthology.orchestra.run.smithi019.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.4 MB/s | 5.5 MB 00:02 2024-09-10T23:49:37.107 INFO:teuthology.orchestra.run.smithi131.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 513 kB/s | 34 kB 00:00 2024-09-10T23:49:37.191 INFO:teuthology.orchestra.run.smithi131.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.8 MB/s | 154 kB 00:00 2024-09-10T23:49:37.222 INFO:teuthology.orchestra.run.smithi019.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-09-10T23:49:37.291 INFO:teuthology.orchestra.run.smithi131.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 8.4 MB/s | 3.2 MB 00:00 2024-09-10T23:49:37.422 INFO:teuthology.orchestra.run.smithi019.stdout:(7/157): ceph-common-19.3.0-4854.g8f219c47.el9. 8.1 MB/s | 22 MB 00:02 2024-09-10T23:49:38.017 INFO:teuthology.orchestra.run.smithi131.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 19 MB/s | 50 MB 00:02 2024-09-10T23:49:38.064 INFO:teuthology.orchestra.run.smithi019.stdout:(8/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 17 MB/s | 11 MB 00:00 2024-09-10T23:49:38.067 INFO:teuthology.orchestra.run.smithi131.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 5.7 MB/s | 291 kB 00:00 2024-09-10T23:49:38.097 INFO:teuthology.orchestra.run.smithi019.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 758 kB/s | 25 kB 00:00 2024-09-10T23:49:38.200 INFO:teuthology.orchestra.run.smithi131.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 8.1 MB/s | 7.4 MB 00:00 2024-09-10T23:49:38.234 INFO:teuthology.orchestra.run.smithi131.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 296 kB/s | 49 kB 00:00 2024-09-10T23:49:38.284 INFO:teuthology.orchestra.run.smithi131.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 197 kB/s | 16 kB 00:00 2024-09-10T23:49:38.326 INFO:teuthology.orchestra.run.smithi131.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 285 kB 00:00 2024-09-10T23:49:38.468 INFO:teuthology.orchestra.run.smithi131.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 11 MB/s | 14 MB 00:01 2024-09-10T23:49:38.493 INFO:teuthology.orchestra.run.smithi131.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 109 kB/s | 18 kB 00:00 2024-09-10T23:49:38.527 INFO:teuthology.orchestra.run.smithi131.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 3.2 MB/s | 783 kB 00:00 2024-09-10T23:49:39.127 INFO:teuthology.orchestra.run.smithi131.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 121 kB/s | 80 kB 00:00 2024-09-10T23:49:39.269 INFO:teuthology.orchestra.run.smithi131.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 258 kB/s | 191 kB 00:00 2024-09-10T23:49:39.325 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:49:39.326 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:49:39.339 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:49:39.340 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:49:39.341 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:49:39.342 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:49:39.344 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:49:39.347 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:49:39.348 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:49:39.386 INFO:teuthology.orchestra.run.smithi131.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 898 kB/s | 801 kB 00:00 2024-09-10T23:49:39.389 INFO:teuthology.orchestra.run.smithi019.stdout:(10/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x8 2.1 MB/s | 4.8 MB 00:02 2024-09-10T23:49:39.411 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T23:49:39.431 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-10T23:49:39.431 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T23:49:39.431 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-10T23:49:39.431 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:49:39.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:49:39.433 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:49:39.434 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:49:39.435 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:49:39.436 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:49:39.437 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:49:39.438 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:49:39.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:49:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:49:39.441 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:49:39.442 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:49:39.443 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-10T23:49:39.444 INFO:teuthology.orchestra.run.smithi135.stdout:Install 149 Packages 2024-09-10T23:49:39.445 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 8 Packages 2024-09-10T23:49:39.445 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:49:39.445 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 240 M 2024-09-10T23:49:39.445 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T23:49:39.523 INFO:teuthology.orchestra.run.smithi019.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.7 MB/s | 225 kB 00:00 2024-09-10T23:49:39.607 INFO:teuthology.orchestra.run.smithi019.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 324 kB/s | 27 kB 00:00 2024-09-10T23:49:39.887 INFO:teuthology.orchestra.run.smithi131.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 334 kB/s | 253 kB 00:00 2024-09-10T23:49:40.045 INFO:teuthology.orchestra.run.smithi131.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-10T23:49:40.123 INFO:teuthology.orchestra.run.smithi019.stdout:(13/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 25 MB/s | 50 MB 00:02 2024-09-10T23:49:40.149 INFO:teuthology.orchestra.run.smithi019.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 59 kB/s | 32 kB 00:00 2024-09-10T23:49:40.199 INFO:teuthology.orchestra.run.smithi019.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.2 MB/s | 162 kB 00:00 2024-09-10T23:49:40.204 INFO:teuthology.orchestra.run.smithi131.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi019.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:49:40.316 INFO:teuthology.orchestra.run.smithi019.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 7.4 MB/s | 507 kB 00:00 2024-09-10T23:49:40.416 INFO:teuthology.orchestra.run.smithi019.stdout:(18/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 2.8 MB/s | 755 kB 00:00 2024-09-10T23:49:40.500 INFO:teuthology.orchestra.run.smithi019.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 542 kB/s | 45 kB 00:00 2024-09-10T23:49:40.600 INFO:teuthology.orchestra.run.smithi019.stdout:(20/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 5.5 MB 00:00 2024-09-10T23:49:40.612 INFO:teuthology.orchestra.run.smithi131.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 186 kB/s | 135 kB 00:00 2024-09-10T23:49:40.625 INFO:teuthology.orchestra.run.smithi019.stdout:(21/157): python3-ceph-common-19.3.0-4854.g8f21 1.1 MB/s | 143 kB 00:00 2024-09-10T23:49:40.651 INFO:teuthology.orchestra.run.smithi019.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 3.2 MB/s | 161 kB 00:00 2024-09-10T23:49:40.709 INFO:teuthology.orchestra.run.smithi019.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.1 MB/s | 306 kB 00:00 2024-09-10T23:49:40.760 INFO:teuthology.orchestra.run.smithi019.stdout:(24/157): python3-rados-19.3.0-4854.g8f219c47.e 2.3 MB/s | 321 kB 00:00 2024-09-10T23:49:40.771 INFO:teuthology.orchestra.run.smithi131.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 172 kB/s | 125 kB 00:00 2024-09-10T23:49:40.785 INFO:teuthology.orchestra.run.smithi019.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.3 MB/s | 99 kB 00:00 2024-09-10T23:49:40.810 INFO:teuthology.orchestra.run.smithi019.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.6 MB/s | 85 kB 00:00 2024-09-10T23:49:40.946 INFO:teuthology.orchestra.run.smithi131.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 290 kB/s | 215 kB 00:00 2024-09-10T23:49:40.952 INFO:teuthology.orchestra.run.smithi019.stdout:(27/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 19 MB/s | 3.2 MB 00:00 2024-09-10T23:49:40.977 INFO:teuthology.orchestra.run.smithi019.stdout:(28/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.0 MB/s | 171 kB 00:00 2024-09-10T23:49:41.003 INFO:teuthology.orchestra.run.smithi019.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 685 kB/s | 34 kB 00:00 2024-09-10T23:49:41.063 INFO:teuthology.orchestra.run.smithi135.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-09-10T23:49:41.078 INFO:teuthology.orchestra.run.smithi019.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.5 MB/s | 154 kB 00:00 2024-09-10T23:49:41.088 INFO:teuthology.orchestra.run.smithi131.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 1.4 MB/s | 689 kB 00:00 2024-09-10T23:49:41.172 INFO:teuthology.orchestra.run.smithi131.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-10T23:49:41.247 INFO:teuthology.orchestra.run.smithi131.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 356 kB/s | 107 kB 00:00 2024-09-10T23:49:41.272 INFO:teuthology.orchestra.run.smithi131.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-10T23:49:41.331 INFO:teuthology.orchestra.run.smithi131.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-10T23:49:41.456 INFO:teuthology.orchestra.run.smithi131.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-10T23:49:41.498 INFO:teuthology.orchestra.run.smithi131.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-10T23:49:41.582 INFO:teuthology.orchestra.run.smithi131.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.7 MB/s | 3.0 MB 00:00 2024-09-10T23:49:41.607 INFO:teuthology.orchestra.run.smithi131.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-10T23:49:41.629 INFO:teuthology.orchestra.run.smithi019.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 23 MB/s | 14 MB 00:00 2024-09-10T23:49:41.632 INFO:teuthology.orchestra.run.smithi131.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T23:49:41.658 INFO:teuthology.orchestra.run.smithi131.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-10T23:49:41.680 INFO:teuthology.orchestra.run.smithi135.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.4 MB/s | 900 kB 00:00 2024-09-10T23:49:41.691 INFO:teuthology.orchestra.run.smithi131.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-10T23:49:41.704 INFO:teuthology.orchestra.run.smithi019.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.8 MB/s | 291 kB 00:00 2024-09-10T23:49:41.733 INFO:teuthology.orchestra.run.smithi131.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-10T23:49:41.759 INFO:teuthology.orchestra.run.smithi131.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 5.6 MB/s | 581 kB 00:00 2024-09-10T23:49:41.762 INFO:teuthology.orchestra.run.smithi019.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 848 kB/s | 49 kB 00:00 2024-09-10T23:49:41.780 INFO:teuthology.orchestra.run.smithi135.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.4 MB/s | 145 kB 00:00 2024-09-10T23:49:41.792 INFO:teuthology.orchestra.run.smithi131.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-10T23:49:41.812 INFO:teuthology.orchestra.run.smithi019.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 329 kB/s | 16 kB 00:00 2024-09-10T23:49:41.817 INFO:teuthology.orchestra.run.smithi131.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T23:49:41.843 INFO:teuthology.orchestra.run.smithi131.stdout:(65/157): bison-3.7.4-5.el9.x86_64.rpm 880 kB/s | 943 kB 00:01 2024-09-10T23:49:41.868 INFO:teuthology.orchestra.run.smithi131.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-10T23:49:41.880 INFO:teuthology.orchestra.run.smithi019.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-10T23:49:41.910 INFO:teuthology.orchestra.run.smithi131.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-10T23:49:41.963 INFO:teuthology.orchestra.run.smithi019.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 9.2 MB/s | 783 kB 00:00 2024-09-10T23:49:42.030 INFO:teuthology.orchestra.run.smithi019.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 274 kB/s | 18 kB 00:00 2024-09-10T23:49:42.139 INFO:teuthology.orchestra.run.smithi019.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 738 kB/s | 80 kB 00:00 2024-09-10T23:49:42.169 INFO:teuthology.orchestra.run.smithi131.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-10T23:49:42.227 INFO:teuthology.orchestra.run.smithi131.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-10T23:49:42.239 INFO:teuthology.orchestra.run.smithi019.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 7.8 MB/s | 801 kB 00:00 2024-09-10T23:49:42.261 INFO:teuthology.orchestra.run.smithi131.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-10T23:49:42.286 INFO:teuthology.orchestra.run.smithi131.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T23:49:42.306 INFO:teuthology.orchestra.run.smithi019.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T23:49:42.361 INFO:teuthology.orchestra.run.smithi131.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 9.5 MB/s | 4.9 MB 00:00 2024-09-10T23:49:42.390 INFO:teuthology.orchestra.run.smithi019.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-10T23:49:42.412 INFO:teuthology.orchestra.run.smithi131.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-10T23:49:42.439 INFO:teuthology.orchestra.run.smithi135.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 3.6 MB/s | 2.4 MB 00:00 2024-09-10T23:49:42.490 INFO:teuthology.orchestra.run.smithi019.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-10T23:49:42.548 INFO:teuthology.orchestra.run.smithi019.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T23:49:42.595 INFO:teuthology.orchestra.run.smithi131.stdout:(74/157): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 6.0 MB 00:00 2024-09-10T23:49:42.629 INFO:teuthology.orchestra.run.smithi131.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-10T23:49:42.632 INFO:teuthology.orchestra.run.smithi019.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-10T23:49:42.654 INFO:teuthology.orchestra.run.smithi131.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T23:49:42.716 INFO:teuthology.orchestra.run.smithi019.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-10T23:49:42.738 INFO:teuthology.orchestra.run.smithi131.stdout:(77/157): postgresql-server-13.16-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-09-10T23:49:42.763 INFO:teuthology.orchestra.run.smithi131.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-10T23:49:42.788 INFO:teuthology.orchestra.run.smithi131.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-10T23:49:42.797 INFO:teuthology.orchestra.run.smithi135.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.9 MB/s | 5.5 MB 00:01 2024-09-10T23:49:42.799 INFO:teuthology.orchestra.run.smithi019.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-10T23:49:42.814 INFO:teuthology.orchestra.run.smithi131.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-10T23:49:42.830 INFO:teuthology.orchestra.run.smithi135.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-09-10T23:49:42.839 INFO:teuthology.orchestra.run.smithi131.stdout:(81/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-10T23:49:42.864 INFO:teuthology.orchestra.run.smithi131.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-10T23:49:42.889 INFO:teuthology.orchestra.run.smithi131.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-10T23:49:42.915 INFO:teuthology.orchestra.run.smithi131.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-10T23:49:42.969 INFO:teuthology.orchestra.run.smithi131.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 222 kB 00:00 2024-09-10T23:49:42.990 INFO:teuthology.orchestra.run.smithi131.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-10T23:49:43.016 INFO:teuthology.orchestra.run.smithi131.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 910 kB/s | 42 kB 00:00 2024-09-10T23:49:43.044 INFO:teuthology.orchestra.run.smithi131.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.9 MB/s | 269 kB 00:00 2024-09-10T23:49:43.070 INFO:teuthology.orchestra.run.smithi131.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.9 MB/s | 159 kB 00:00 2024-09-10T23:49:43.083 INFO:teuthology.orchestra.run.smithi019.stdout:(47/157): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-10T23:49:43.095 INFO:teuthology.orchestra.run.smithi131.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T23:49:43.120 INFO:teuthology.orchestra.run.smithi131.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T23:49:43.145 INFO:teuthology.orchestra.run.smithi131.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T23:49:43.221 INFO:teuthology.orchestra.run.smithi131.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-10T23:49:43.246 INFO:teuthology.orchestra.run.smithi131.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-10T23:49:43.280 INFO:teuthology.orchestra.run.smithi131.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-10T23:49:43.305 INFO:teuthology.orchestra.run.smithi131.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T23:49:43.308 INFO:teuthology.orchestra.run.smithi019.stdout:(48/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-10T23:49:43.339 INFO:teuthology.orchestra.run.smithi131.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-10T23:49:43.364 INFO:teuthology.orchestra.run.smithi131.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-09-10T23:49:43.389 INFO:teuthology.orchestra.run.smithi131.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T23:49:43.400 INFO:teuthology.orchestra.run.smithi019.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-10T23:49:43.415 INFO:teuthology.orchestra.run.smithi131.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T23:49:43.440 INFO:teuthology.orchestra.run.smithi131.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T23:49:43.458 INFO:teuthology.orchestra.run.smithi019.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 379 kB/s | 22 kB 00:00 2024-09-10T23:49:43.465 INFO:teuthology.orchestra.run.smithi131.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T23:49:43.490 INFO:teuthology.orchestra.run.smithi131.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-10T23:49:43.523 INFO:teuthology.orchestra.run.smithi135.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 6.6 MB/s | 4.8 MB 00:00 2024-09-10T23:49:43.624 INFO:teuthology.orchestra.run.smithi131.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 141 kB/s | 22 kB 00:00 2024-09-10T23:49:43.674 INFO:teuthology.orchestra.run.smithi131.stdout:(105/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-10T23:49:43.693 INFO:teuthology.orchestra.run.smithi019.stdout:(51/157): ceph-mgr-diskprediction-local-19.3.0- 2.8 MB/s | 7.4 MB 00:02 2024-09-10T23:49:43.716 INFO:teuthology.orchestra.run.smithi131.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-10T23:49:43.718 INFO:teuthology.orchestra.run.smithi019.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-09-10T23:49:43.741 INFO:teuthology.orchestra.run.smithi131.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 837 kB/s | 19 kB 00:00 2024-09-10T23:49:43.775 INFO:teuthology.orchestra.run.smithi131.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 3.1 MB/s | 309 kB 00:00 2024-09-10T23:49:43.800 INFO:teuthology.orchestra.run.smithi131.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T23:49:43.818 INFO:teuthology.orchestra.run.smithi019.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-10T23:49:43.826 INFO:teuthology.orchestra.run.smithi131.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T23:49:43.851 INFO:teuthology.orchestra.run.smithi131.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T23:49:43.877 INFO:teuthology.orchestra.run.smithi019.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-10T23:49:43.885 INFO:teuthology.orchestra.run.smithi131.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T23:49:43.935 INFO:teuthology.orchestra.run.smithi131.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T23:49:43.935 INFO:teuthology.orchestra.run.smithi019.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 192 kB/s | 11 kB 00:00 2024-09-10T23:49:43.985 INFO:teuthology.orchestra.run.smithi131.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T23:49:44.011 INFO:teuthology.orchestra.run.smithi131.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:49:44.036 INFO:teuthology.orchestra.run.smithi131.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T23:49:44.061 INFO:teuthology.orchestra.run.smithi019.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-10T23:49:44.061 INFO:teuthology.orchestra.run.smithi131.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-10T23:49:44.120 INFO:teuthology.orchestra.run.smithi019.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T23:49:44.120 INFO:teuthology.orchestra.run.smithi131.stdout:(118/157): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-10T23:49:44.145 INFO:teuthology.orchestra.run.smithi131.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-10T23:49:44.178 INFO:teuthology.orchestra.run.smithi019.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-09-10T23:49:44.179 INFO:teuthology.orchestra.run.smithi131.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T23:49:44.204 INFO:teuthology.orchestra.run.smithi131.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-10T23:49:44.229 INFO:teuthology.orchestra.run.smithi131.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T23:49:44.231 INFO:teuthology.orchestra.run.smithi135.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 6.5 MB/s | 22 MB 00:03 2024-09-10T23:49:44.263 INFO:teuthology.orchestra.run.smithi131.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T23:49:44.280 INFO:teuthology.orchestra.run.smithi131.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-10T23:49:44.305 INFO:teuthology.orchestra.run.smithi131.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-10T23:49:44.311 INFO:teuthology.orchestra.run.smithi019.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-09-10T23:49:44.315 INFO:teuthology.orchestra.run.smithi135.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 302 kB/s | 25 kB 00:00 2024-09-10T23:49:44.331 INFO:teuthology.orchestra.run.smithi131.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-10T23:49:44.356 INFO:teuthology.orchestra.run.smithi131.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-10T23:49:44.382 INFO:teuthology.orchestra.run.smithi131.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-10T23:49:44.387 INFO:teuthology.orchestra.run.smithi019.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-10T23:49:44.432 INFO:teuthology.orchestra.run.smithi131.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-10T23:49:44.445 INFO:teuthology.orchestra.run.smithi019.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-10T23:49:44.457 INFO:teuthology.orchestra.run.smithi131.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:49:44.482 INFO:teuthology.orchestra.run.smithi131.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:49:44.504 INFO:teuthology.orchestra.run.smithi019.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 816 kB/s | 47 kB 00:00 2024-09-10T23:49:44.507 INFO:teuthology.orchestra.run.smithi131.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T23:49:44.541 INFO:teuthology.orchestra.run.smithi131.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-10T23:49:44.563 INFO:teuthology.orchestra.run.smithi019.stdout:(63/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T23:49:44.567 INFO:teuthology.orchestra.run.smithi131.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-10T23:49:44.592 INFO:teuthology.orchestra.run.smithi131.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T23:49:44.617 INFO:teuthology.orchestra.run.smithi131.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T23:49:44.621 INFO:teuthology.orchestra.run.smithi019.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-10T23:49:44.643 INFO:teuthology.orchestra.run.smithi131.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-10T23:49:44.714 INFO:teuthology.orchestra.run.smithi019.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T23:49:44.714 INFO:teuthology.orchestra.run.smithi131.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-10T23:49:44.714 INFO:teuthology.orchestra.run.smithi131.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T23:49:44.718 INFO:teuthology.orchestra.run.smithi131.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T23:49:44.744 INFO:teuthology.orchestra.run.smithi131.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-10T23:49:44.769 INFO:teuthology.orchestra.run.smithi131.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T23:49:44.794 INFO:teuthology.orchestra.run.smithi131.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T23:49:44.819 INFO:teuthology.orchestra.run.smithi131.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T23:49:44.845 INFO:teuthology.orchestra.run.smithi131.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-10T23:49:44.865 INFO:teuthology.orchestra.run.smithi135.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 8.4 MB/s | 17 MB 00:02 2024-09-10T23:49:44.870 INFO:teuthology.orchestra.run.smithi131.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-10T23:49:44.895 INFO:teuthology.orchestra.run.smithi131.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-10T23:49:44.946 INFO:teuthology.orchestra.run.smithi131.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T23:49:44.949 INFO:teuthology.orchestra.run.smithi135.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.6 MB/s | 225 kB 00:00 2024-09-10T23:49:45.024 INFO:teuthology.orchestra.run.smithi135.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 360 kB/s | 27 kB 00:00 2024-09-10T23:49:45.096 INFO:teuthology.orchestra.run.smithi131.stdout:(149/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.2 MB/s | 16 MB 00:01 2024-09-10T23:49:45.133 INFO:teuthology.orchestra.run.smithi135.stdout:(13/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 6.8 MB/s | 11 MB 00:01 2024-09-10T23:49:45.158 INFO:teuthology.orchestra.run.smithi135.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 238 kB/s | 32 kB 00:00 2024-09-10T23:49:45.247 INFO:teuthology.orchestra.run.smithi019.stdout:(66/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 2.1 MB/s | 17 MB 00:08 2024-09-10T23:49:45.250 INFO:teuthology.orchestra.run.smithi135.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.7 MB/s | 162 kB 00:00 2024-09-10T23:49:45.275 INFO:teuthology.orchestra.run.smithi135.stdout:(16/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.2 MB/s | 755 kB 00:00 2024-09-10T23:49:45.325 INFO:teuthology.orchestra.run.smithi135.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.6 MB/s | 127 kB 00:00 2024-09-10T23:49:45.364 INFO:teuthology.orchestra.run.smithi019.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.8 MB/s | 3.0 MB 00:01 2024-09-10T23:49:45.451 INFO:teuthology.orchestra.run.smithi135.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 2.8 MB/s | 507 kB 00:00 2024-09-10T23:49:45.534 INFO:teuthology.orchestra.run.smithi135.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 541 kB/s | 45 kB 00:00 2024-09-10T23:49:45.588 INFO:teuthology.orchestra.run.smithi131.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 5.0 MB/s | 3.2 MB 00:00 2024-09-10T23:49:45.618 INFO:teuthology.orchestra.run.smithi135.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T23:49:45.647 INFO:teuthology.orchestra.run.smithi131.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 4.6 MB/s | 3.5 MB 00:00 2024-09-10T23:49:45.693 INFO:teuthology.orchestra.run.smithi135.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.1 MB/s | 161 kB 00:00 2024-09-10T23:49:45.777 INFO:teuthology.orchestra.run.smithi135.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 3.8 MB/s | 321 kB 00:00 2024-09-10T23:49:45.860 INFO:teuthology.orchestra.run.smithi135.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.6 MB/s | 306 kB 00:00 2024-09-10T23:49:45.944 INFO:teuthology.orchestra.run.smithi135.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.2 MB/s | 99 kB 00:00 2024-09-10T23:49:46.019 INFO:teuthology.orchestra.run.smithi135.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-10T23:49:46.072 INFO:teuthology.orchestra.run.smithi019.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-09-10T23:49:46.095 INFO:teuthology.orchestra.run.smithi135.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 7.2 MB/s | 5.5 MB 00:00 2024-09-10T23:49:46.181 INFO:teuthology.orchestra.run.smithi135.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.0 MB/s | 171 kB 00:00 2024-09-10T23:49:46.205 INFO:teuthology.orchestra.run.smithi131.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 73 kB/s | 41 kB 00:00 2024-09-10T23:49:46.239 INFO:teuthology.orchestra.run.smithi019.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-10T23:49:46.253 INFO:teuthology.orchestra.run.smithi135.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 456 kB/s | 34 kB 00:00 2024-09-10T23:49:46.273 INFO:teuthology.orchestra.run.smithi019.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-09-10T23:49:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T23:49:46.337 INFO:teuthology.orchestra.run.smithi135.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.8 MB/s | 154 kB 00:00 2024-09-10T23:49:46.482 INFO:teuthology.orchestra.run.smithi019.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-10T23:49:46.529 INFO:teuthology.orchestra.run.smithi135.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 6.2 MB/s | 3.2 MB 00:00 2024-09-10T23:49:46.540 INFO:teuthology.orchestra.run.smithi019.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T23:49:46.681 INFO:teuthology.orchestra.run.smithi131.stdout:(153/157): NetworkManager-1.49.90-1.el9.x86_64. 1.5 MB/s | 2.3 MB 00:01 2024-09-10T23:49:46.989 INFO:teuthology.orchestra.run.smithi131.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 318 kB/s | 249 kB 00:00 2024-09-10T23:49:47.174 INFO:teuthology.orchestra.run.smithi019.stdout:(74/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.0 MB/s | 4.9 MB 00:02 2024-09-10T23:49:47.231 INFO:teuthology.orchestra.run.smithi131.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 1.1 MB/s | 1.8 MB 00:01 2024-09-10T23:49:47.241 INFO:teuthology.orchestra.run.smithi019.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 924 kB/s | 61 kB 00:00 2024-09-10T23:49:47.399 INFO:teuthology.orchestra.run.smithi019.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-10T23:49:47.549 INFO:teuthology.orchestra.run.smithi019.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-09-10T23:49:47.625 INFO:teuthology.orchestra.run.smithi019.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 342 kB/s | 26 kB 00:00 2024-09-10T23:49:47.650 INFO:teuthology.orchestra.run.smithi019.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 991 kB/s | 248 kB 00:00 2024-09-10T23:49:47.683 INFO:teuthology.orchestra.run.smithi019.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-09-10T23:49:47.742 INFO:teuthology.orchestra.run.smithi019.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-09-10T23:49:47.793 INFO:teuthology.orchestra.run.smithi019.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-10T23:49:47.954 INFO:teuthology.orchestra.run.smithi135.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 5.2 MB/s | 7.4 MB 00:01 2024-09-10T23:49:47.968 INFO:teuthology.orchestra.run.smithi019.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-10T23:49:48.129 INFO:teuthology.orchestra.run.smithi135.stdout:(32/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 7.9 MB/s | 14 MB 00:01 2024-09-10T23:49:48.135 INFO:teuthology.orchestra.run.smithi019.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-09-10T23:49:48.154 INFO:teuthology.orchestra.run.smithi135.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 1.4 MB/s | 291 kB 00:00 2024-09-10T23:49:48.165 INFO:teuthology.orchestra.run.smithi131.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 934 kB/s | 1.4 MB 00:01 2024-09-10T23:49:48.188 INFO:teuthology.orchestra.run.smithi135.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 845 kB/s | 49 kB 00:00 2024-09-10T23:49:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 246 kB/s | 16 kB 00:00 2024-09-10T23:49:48.235 INFO:teuthology.orchestra.run.smithi019.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 773 kB/s | 77 kB 00:00 2024-09-10T23:49:48.272 INFO:teuthology.orchestra.run.smithi135.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.3 MB/s | 285 kB 00:00 2024-09-10T23:49:48.294 INFO:teuthology.orchestra.run.smithi019.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-09-10T23:49:48.348 INFO:teuthology.orchestra.run.smithi131.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 2.4 MB 00:01 2024-09-10T23:49:48.355 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:49:48.355 INFO:teuthology.orchestra.run.smithi131.stdout:Total 16 MB/s | 240 MB 00:14 2024-09-10T23:49:48.502 INFO:teuthology.orchestra.run.smithi019.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 1.3 MB/s | 269 kB 00:00 2024-09-10T23:49:48.648 INFO:teuthology.orchestra.run.smithi019.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.6 MB/s | 5.1 MB 00:00 2024-09-10T23:49:48.728 INFO:teuthology.orchestra.run.smithi019.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 705 kB/s | 159 kB 00:00 2024-09-10T23:49:48.753 INFO:teuthology.orchestra.run.smithi019.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.6 MB/s | 279 kB 00:00 2024-09-10T23:49:48.804 INFO:teuthology.orchestra.run.smithi019.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-10T23:49:48.829 INFO:teuthology.orchestra.run.smithi019.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-10T23:49:48.873 INFO:teuthology.orchestra.run.smithi135.stdout:(37/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 11 MB/s | 50 MB 00:04 2024-09-10T23:49:48.896 INFO:teuthology.orchestra.run.smithi019.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-09-10T23:49:48.898 INFO:teuthology.orchestra.run.smithi135.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 29 kB/s | 18 kB 00:00 2024-09-10T23:49:48.931 INFO:teuthology.orchestra.run.smithi135.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 1.1 MB/s | 783 kB 00:00 2024-09-10T23:49:48.971 INFO:teuthology.orchestra.run.smithi019.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 590 kB/s | 44 kB 00:00 2024-09-10T23:49:49.047 INFO:teuthology.orchestra.run.smithi019.stdout:(95/157): postgresql-server-13.16-1.el9.x86_64. 2.1 MB/s | 5.8 MB 00:02 2024-09-10T23:49:49.072 INFO:teuthology.orchestra.run.smithi019.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-09-10T23:49:49.115 INFO:teuthology.orchestra.run.smithi135.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-10T23:49:49.147 INFO:teuthology.orchestra.run.smithi019.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-09-10T23:49:49.172 INFO:teuthology.orchestra.run.smithi019.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-09-10T23:49:49.182 INFO:teuthology.orchestra.run.smithi135.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 763 kB/s | 191 kB 00:00 2024-09-10T23:49:49.247 INFO:teuthology.orchestra.run.smithi019.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 771 kB/s | 58 kB 00:00 2024-09-10T23:49:49.291 INFO:teuthology.orchestra.run.smithi135.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-10T23:49:49.315 INFO:teuthology.orchestra.run.smithi019.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-10T23:49:49.324 INFO:teuthology.orchestra.run.smithi135.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.8 MB/s | 801 kB 00:00 2024-09-10T23:49:49.349 INFO:teuthology.orchestra.run.smithi135.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T23:49:49.381 INFO:teuthology.orchestra.run.smithi019.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 960 kB/s | 64 kB 00:00 2024-09-10T23:49:49.391 INFO:teuthology.orchestra.run.smithi135.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-10T23:49:49.409 INFO:teuthology.orchestra.run.smithi135.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T23:49:49.415 INFO:teuthology.orchestra.run.smithi019.stdout:(102/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-10T23:49:49.440 INFO:teuthology.orchestra.run.smithi019.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-09-10T23:49:49.499 INFO:teuthology.orchestra.run.smithi019.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-10T23:49:49.534 INFO:teuthology.orchestra.run.smithi135.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-09-10T23:49:49.549 INFO:teuthology.orchestra.run.smithi019.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T23:49:49.559 INFO:teuthology.orchestra.run.smithi135.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-10T23:49:49.583 INFO:teuthology.orchestra.run.smithi019.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T23:49:49.608 INFO:teuthology.orchestra.run.smithi019.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-10T23:49:49.615 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-10T23:49:49.643 INFO:teuthology.orchestra.run.smithi135.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-10T23:49:49.652 INFO:teuthology.orchestra.run.smithi019.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-10T23:49:49.676 INFO:teuthology.orchestra.run.smithi135.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 656 kB/s | 22 kB 00:00 2024-09-10T23:49:49.693 INFO:teuthology.orchestra.run.smithi135.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 800 kB/s | 107 kB 00:00 2024-09-10T23:49:49.700 INFO:teuthology.orchestra.run.smithi019.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 523 kB/s | 26 kB 00:00 2024-09-10T23:49:49.725 INFO:teuthology.orchestra.run.smithi019.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T23:49:49.727 INFO:teuthology.orchestra.run.smithi135.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-10T23:49:49.743 INFO:teuthology.orchestra.run.smithi135.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-10T23:49:49.759 INFO:teuthology.orchestra.run.smithi019.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T23:49:49.768 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-10T23:49:49.768 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-10T23:49:49.777 INFO:teuthology.orchestra.run.smithi135.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-10T23:49:49.793 INFO:teuthology.orchestra.run.smithi019.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T23:49:49.794 INFO:teuthology.orchestra.run.smithi135.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T23:49:49.811 INFO:teuthology.orchestra.run.smithi135.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-10T23:49:49.836 INFO:teuthology.orchestra.run.smithi135.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-10T23:49:49.851 INFO:teuthology.orchestra.run.smithi019.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-10T23:49:49.885 INFO:teuthology.orchestra.run.smithi019.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T23:49:49.895 INFO:teuthology.orchestra.run.smithi135.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-10T23:49:49.902 INFO:teuthology.orchestra.run.smithi019.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-10T23:49:49.919 INFO:teuthology.orchestra.run.smithi019.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T23:49:49.920 INFO:teuthology.orchestra.run.smithi135.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-10T23:49:49.936 INFO:teuthology.orchestra.run.smithi019.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 847 kB/s | 14 kB 00:00 2024-09-10T23:49:49.945 INFO:teuthology.orchestra.run.smithi135.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-10T23:49:49.969 INFO:teuthology.orchestra.run.smithi019.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-10T23:49:49.979 INFO:teuthology.orchestra.run.smithi135.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-10T23:49:49.995 INFO:teuthology.orchestra.run.smithi019.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T23:49:50.004 INFO:teuthology.orchestra.run.smithi135.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-10T23:49:50.028 INFO:teuthology.orchestra.run.smithi019.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T23:49:50.038 INFO:teuthology.orchestra.run.smithi135.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-10T23:49:50.054 INFO:teuthology.orchestra.run.smithi019.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T23:49:50.063 INFO:teuthology.orchestra.run.smithi135.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-10T23:49:50.079 INFO:teuthology.orchestra.run.smithi019.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T23:49:50.088 INFO:teuthology.orchestra.run.smithi135.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T23:49:50.104 INFO:teuthology.orchestra.run.smithi019.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T23:49:50.113 INFO:teuthology.orchestra.run.smithi135.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T23:49:50.129 INFO:teuthology.orchestra.run.smithi019.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-10T23:49:50.139 INFO:teuthology.orchestra.run.smithi135.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-10T23:49:50.155 INFO:teuthology.orchestra.run.smithi019.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-10T23:49:50.180 INFO:teuthology.orchestra.run.smithi019.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-10T23:49:50.197 INFO:teuthology.orchestra.run.smithi135.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-10T23:49:50.205 INFO:teuthology.orchestra.run.smithi019.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-10T23:49:50.231 INFO:teuthology.orchestra.run.smithi019.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-10T23:49:50.281 INFO:teuthology.orchestra.run.smithi135.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-09-10T23:49:50.289 INFO:teuthology.orchestra.run.smithi019.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-10T23:49:50.314 INFO:teuthology.orchestra.run.smithi019.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:49:50.315 INFO:teuthology.orchestra.run.smithi135.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-10T23:49:50.340 INFO:teuthology.orchestra.run.smithi019.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:49:50.340 INFO:teuthology.orchestra.run.smithi135.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T23:49:50.373 INFO:teuthology.orchestra.run.smithi019.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T23:49:50.407 INFO:teuthology.orchestra.run.smithi019.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-10T23:49:50.432 INFO:teuthology.orchestra.run.smithi019.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-10T23:49:50.449 INFO:teuthology.orchestra.run.smithi135.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-10T23:49:50.458 INFO:teuthology.orchestra.run.smithi019.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T23:49:50.483 INFO:teuthology.orchestra.run.smithi019.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T23:49:50.490 INFO:teuthology.orchestra.run.smithi135.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-10T23:49:50.508 INFO:teuthology.orchestra.run.smithi019.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-10T23:49:50.516 INFO:teuthology.orchestra.run.smithi135.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T23:49:50.533 INFO:teuthology.orchestra.run.smithi019.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-10T23:49:50.559 INFO:teuthology.orchestra.run.smithi019.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T23:49:50.584 INFO:teuthology.orchestra.run.smithi019.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T23:49:50.609 INFO:teuthology.orchestra.run.smithi019.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T23:49:50.616 INFO:teuthology.orchestra.run.smithi135.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-10T23:49:50.634 INFO:teuthology.orchestra.run.smithi019.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T23:49:50.641 INFO:teuthology.orchestra.run.smithi135.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 489 kB/s | 61 kB 00:00 2024-09-10T23:49:50.660 INFO:teuthology.orchestra.run.smithi019.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-10T23:49:50.667 INFO:teuthology.orchestra.run.smithi135.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-10T23:49:50.685 INFO:teuthology.orchestra.run.smithi019.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:49:50.692 INFO:teuthology.orchestra.run.smithi135.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-10T23:49:50.710 INFO:teuthology.orchestra.run.smithi019.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2024-09-10T23:49:50.717 INFO:teuthology.orchestra.run.smithi135.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-10T23:49:50.743 INFO:teuthology.orchestra.run.smithi135.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-10T23:49:50.752 INFO:teuthology.orchestra.run.smithi019.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2024-09-10T23:49:50.768 INFO:teuthology.orchestra.run.smithi135.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-10T23:49:50.778 INFO:teuthology.orchestra.run.smithi019.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T23:49:50.793 INFO:teuthology.orchestra.run.smithi135.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-10T23:49:50.828 INFO:teuthology.orchestra.run.smithi019.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T23:49:50.893 INFO:teuthology.orchestra.run.smithi135.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-10T23:49:50.919 INFO:teuthology.orchestra.run.smithi135.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-10T23:49:50.944 INFO:teuthology.orchestra.run.smithi135.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T23:49:50.961 INFO:teuthology.orchestra.run.smithi135.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-10T23:49:50.986 INFO:teuthology.orchestra.run.smithi135.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T23:49:51.021 INFO:teuthology.orchestra.run.smithi135.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.4 MB/s | 269 kB 00:00 2024-09-10T23:49:51.046 INFO:teuthology.orchestra.run.smithi135.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-10T23:49:51.071 INFO:teuthology.orchestra.run.smithi135.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T23:49:51.096 INFO:teuthology.orchestra.run.smithi135.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T23:49:51.121 INFO:teuthology.orchestra.run.smithi135.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T23:49:51.205 INFO:teuthology.orchestra.run.smithi135.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-10T23:49:51.230 INFO:teuthology.orchestra.run.smithi135.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-10T23:49:51.255 INFO:teuthology.orchestra.run.smithi135.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-09-10T23:49:51.281 INFO:teuthology.orchestra.run.smithi135.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T23:49:51.306 INFO:teuthology.orchestra.run.smithi135.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-10T23:49:51.320 INFO:teuthology.orchestra.run.smithi019.stdout:(149/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.6 MB/s | 3.2 MB 00:00 2024-09-10T23:49:51.331 INFO:teuthology.orchestra.run.smithi135.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-10T23:49:51.356 INFO:teuthology.orchestra.run.smithi135.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T23:49:51.382 INFO:teuthology.orchestra.run.smithi135.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T23:49:51.407 INFO:teuthology.orchestra.run.smithi135.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T23:49:51.432 INFO:teuthology.orchestra.run.smithi135.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T23:49:51.458 INFO:teuthology.orchestra.run.smithi135.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-10T23:49:51.462 INFO:teuthology.orchestra.run.smithi019.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-09-10T23:49:51.537 INFO:teuthology.orchestra.run.smithi019.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 4.6 MB/s | 3.5 MB 00:00 2024-09-10T23:49:51.587 INFO:teuthology.orchestra.run.smithi019.stdout:(152/157): NetworkManager-libnm-1.49.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-09-10T23:49:51.679 INFO:teuthology.orchestra.run.smithi019.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 2.7 MB/s | 249 kB 00:00 2024-09-10T23:49:51.700 INFO:teuthology.orchestra.run.smithi135.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-10T23:49:51.704 INFO:teuthology.orchestra.run.smithi019.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 244 kB/s | 41 kB 00:00 2024-09-10T23:49:51.710 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-10T23:49:51.712 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-10T23:49:51.725 INFO:teuthology.orchestra.run.smithi135.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-10T23:49:51.780 INFO:teuthology.orchestra.run.smithi019.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-10T23:49:51.783 INFO:teuthology.orchestra.run.smithi135.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-10T23:49:51.809 INFO:teuthology.orchestra.run.smithi135.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-10T23:49:51.851 INFO:teuthology.orchestra.run.smithi135.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-09-10T23:49:51.884 INFO:teuthology.orchestra.run.smithi135.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-10T23:49:51.910 INFO:teuthology.orchestra.run.smithi135.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 442 kB/s | 26 kB 00:00 2024-09-10T23:49:51.943 INFO:teuthology.orchestra.run.smithi135.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T23:49:51.963 INFO:teuthology.orchestra.run.smithi019.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-09-10T23:49:51.977 INFO:teuthology.orchestra.run.smithi135.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 527 kB/s | 49 kB 00:00 2024-09-10T23:49:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-10T23:49:52.052 INFO:teuthology.orchestra.run.smithi135.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T23:49:52.077 INFO:teuthology.orchestra.run.smithi135.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:49:52.106 INFO:teuthology.orchestra.run.smithi135.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T23:49:52.136 INFO:teuthology.orchestra.run.smithi135.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-10T23:49:52.162 INFO:teuthology.orchestra.run.smithi135.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-10T23:49:52.187 INFO:teuthology.orchestra.run.smithi135.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-10T23:49:52.254 INFO:teuthology.orchestra.run.smithi135.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2024-09-10T23:49:52.279 INFO:teuthology.orchestra.run.smithi135.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-10T23:49:52.304 INFO:teuthology.orchestra.run.smithi135.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-10T23:49:52.330 INFO:teuthology.orchestra.run.smithi135.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-10T23:49:52.355 INFO:teuthology.orchestra.run.smithi135.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T23:49:52.380 INFO:teuthology.orchestra.run.smithi135.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-10T23:49:52.405 INFO:teuthology.orchestra.run.smithi135.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-10T23:49:52.431 INFO:teuthology.orchestra.run.smithi135.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-10T23:49:52.456 INFO:teuthology.orchestra.run.smithi135.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-10T23:49:52.481 INFO:teuthology.orchestra.run.smithi135.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T23:49:52.507 INFO:teuthology.orchestra.run.smithi135.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:49:52.532 INFO:teuthology.orchestra.run.smithi135.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:49:52.557 INFO:teuthology.orchestra.run.smithi135.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T23:49:52.591 INFO:teuthology.orchestra.run.smithi135.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-10T23:49:52.616 INFO:teuthology.orchestra.run.smithi135.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-10T23:49:52.642 INFO:teuthology.orchestra.run.smithi135.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T23:49:52.667 INFO:teuthology.orchestra.run.smithi135.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T23:49:52.720 INFO:teuthology.orchestra.run.smithi135.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-09-10T23:49:52.743 INFO:teuthology.orchestra.run.smithi135.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-10T23:49:52.785 INFO:teuthology.orchestra.run.smithi135.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-10T23:49:52.810 INFO:teuthology.orchestra.run.smithi135.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-09-10T23:49:52.835 INFO:teuthology.orchestra.run.smithi135.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-10T23:49:52.860 INFO:teuthology.orchestra.run.smithi135.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-10T23:49:52.877 INFO:teuthology.orchestra.run.smithi135.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-10T23:49:52.902 INFO:teuthology.orchestra.run.smithi135.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-10T23:49:52.928 INFO:teuthology.orchestra.run.smithi135.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-10T23:49:52.953 INFO:teuthology.orchestra.run.smithi135.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T23:49:52.978 INFO:teuthology.orchestra.run.smithi135.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:49:53.004 INFO:teuthology.orchestra.run.smithi135.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T23:49:53.062 INFO:teuthology.orchestra.run.smithi135.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T23:49:53.296 INFO:teuthology.orchestra.run.smithi135.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 11 MB/s | 3.5 MB 00:00 2024-09-10T23:49:53.504 INFO:teuthology.orchestra.run.smithi135.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.5 MB/s | 3.2 MB 00:00 2024-09-10T23:49:53.646 INFO:teuthology.orchestra.run.smithi135.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 4.0 MB/s | 2.3 MB 00:00 2024-09-10T23:49:53.680 INFO:teuthology.orchestra.run.smithi135.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 233 kB/s | 41 kB 00:00 2024-09-10T23:49:53.730 INFO:teuthology.orchestra.run.smithi135.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 4.2 MB/s | 1.8 MB 00:00 2024-09-10T23:49:53.847 INFO:teuthology.orchestra.run.smithi135.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 1.2 MB/s | 249 kB 00:00 2024-09-10T23:49:54.114 INFO:teuthology.orchestra.run.smithi135.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 2.4 MB 00:00 2024-09-10T23:49:54.147 INFO:teuthology.orchestra.run.smithi135.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 1.4 MB 00:00 2024-09-10T23:49:54.152 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:49:54.153 INFO:teuthology.orchestra.run.smithi135.stdout:Total 16 MB/s | 240 MB 00:14 2024-09-10T23:49:55.330 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T23:49:55.483 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T23:49:55.483 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T23:49:57.388 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T23:49:57.388 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T23:49:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-10T23:49:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:49:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:49:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:49:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:49:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:49:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:49:58.755 INFO:teuthology.orchestra.run.smithi019.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.6 MB/s | 16 MB 00:09 2024-09-10T23:49:58.760 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:49:58.760 INFO:teuthology.orchestra.run.smithi019.stdout:Total 9.7 MB/s | 240 MB 00:24 2024-09-10T23:49:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:49:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:49:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:49:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:49:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:49:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:49:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:49:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:49:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:49:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:49:59.598 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:49:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:49:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:49:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:49:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:49:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:50:00.047 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-10T23:50:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:50:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:50:00.220 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-10T23:50:00.220 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-10T23:50:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:50:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:50:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:50:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:50:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:50:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:50:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:50:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:50:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:50:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:50:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:50:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:50:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:50:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:50:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:50:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:50:01.444 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:50:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:50:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:50:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:50:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:50:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:50:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:50:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:50:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:50:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:50:02.570 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:50:02.611 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:50:02.669 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-10T23:50:02.669 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-10T23:50:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:50:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:50:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:50:03.030 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:50:03.102 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:50:03.134 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:50:03.169 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:50:03.217 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:50:03.252 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:50:03.295 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:50:03.337 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:50:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:50:03.665 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:50:03.706 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:50:03.810 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:50:03.848 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:50:03.888 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:50:03.914 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:50:03.946 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:50:04.020 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:50:04.023 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T23:50:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:50:04.162 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:50:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:50:04.201 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:50:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:50:04.229 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:50:04.263 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:50:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:50:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:50:04.302 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:50:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:50:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:50:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:50:04.399 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:50:04.432 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:50:04.473 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:50:04.508 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:50:04.595 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:50:04.638 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:50:04.670 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:50:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:50:04.773 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:50:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:50:04.820 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:50:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:50:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:50:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:50:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:50:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:50:05.256 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:50:05.306 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:50:05.334 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:50:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:50:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:50:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:50:05.542 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:50:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:50:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:50:05.602 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:50:05.635 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:50:05.721 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:50:05.734 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:50:05.790 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:50:05.835 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:50:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:50:05.925 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:50:05.954 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:50:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:50:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:06.130 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:50:06.152 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:50:06.153 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:06.229 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:50:06.382 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:50:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:50:06.557 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:50:06.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:50:06.675 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:50:06.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:50:06.751 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:50:06.784 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:50:06.812 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:50:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:50:06.879 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:50:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:50:06.964 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:50:06.991 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:50:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:50:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:50:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:50:07.146 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:50:07.174 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:50:07.242 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:50:07.289 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:50:07.363 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:50:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:50:07.749 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:50:08.212 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:50:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:50:08.299 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:50:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:50:08.360 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:50:08.373 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:50:08.407 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:50:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:50:08.491 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:50:08.533 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:50:08.682 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:50:08.689 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:50:08.731 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:50:08.736 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:50:08.815 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:50:08.826 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:50:08.844 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:50:08.880 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:50:08.891 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:50:08.963 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:50:08.996 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:50:09.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:50:09.078 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:50:09.115 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:50:09.158 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:50:09.200 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:50:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:50:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:50:09.382 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:50:09.409 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:50:09.480 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:50:09.511 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:50:09.627 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:50:09.682 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-10T23:50:09.801 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:50:09.828 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:50:09.846 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:50:09.861 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:50:09.901 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:50:09.910 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:50:09.926 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:50:09.951 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:50:09.951 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:50:09.977 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:50:10.026 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:50:10.031 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:50:10.154 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:50:10.192 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:50:10.220 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:50:10.254 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:50:10.293 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:50:10.325 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:50:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:50:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:50:10.389 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:50:10.414 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:50:10.456 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:50:10.490 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:50:10.511 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:50:10.576 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:50:10.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:50:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:50:10.652 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:50:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:50:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:50:10.786 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:50:10.799 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:50:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:50:10.845 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:50:11.040 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:50:11.090 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:50:11.117 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:50:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:50:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:50:11.315 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:50:11.346 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:50:11.371 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:50:11.537 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:50:11.564 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:50:11.583 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:50:11.617 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:50:11.715 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:50:11.727 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:50:11.771 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:50:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:50:11.854 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:50:11.866 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:50:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:50:11.966 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:12.036 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:12.074 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:12.112 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:50:12.142 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:50:12.220 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:50:12.258 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:50:12.370 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:50:12.408 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:50:12.442 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:50:12.526 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:50:12.578 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:50:12.617 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:50:12.626 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:12.661 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:50:12.664 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:50:12.702 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:50:12.729 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:50:12.762 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:50:12.762 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:50:12.763 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:50:12.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:12.796 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:50:12.801 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:50:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:50:12.878 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:50:12.907 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:50:12.951 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:50:12.966 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:50:13.039 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:50:13.078 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:50:13.121 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:50:13.150 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:50:13.224 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:50:13.282 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:50:13.360 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:50:13.504 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:50:13.560 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:50:14.117 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:50:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:50:14.216 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:50:14.250 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:50:14.264 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:50:14.292 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:50:14.293 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:50:14.325 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:50:14.331 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:50:14.376 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:50:14.551 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:50:14.626 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:50:14.649 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:50:14.697 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:50:14.729 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:50:14.771 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:50:14.792 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:50:14.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:50:14.837 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:50:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:50:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:50:14.939 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:50:14.987 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:50:15.030 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:50:15.074 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:50:15.115 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:50:15.259 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:50:15.301 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:50:15.342 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:50:15.349 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:50:15.374 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:50:15.445 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:50:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:50:15.467 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:50:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:50:15.541 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:50:15.574 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:50:15.598 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:50:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:50:15.831 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:50:15.864 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:50:15.895 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:50:15.938 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:50:15.975 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:50:16.023 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:50:16.061 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:50:16.095 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:50:16.128 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:50:16.171 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:50:16.205 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:50:16.352 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:50:16.391 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:50:16.507 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:50:16.569 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:50:17.331 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:50:17.376 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:50:17.409 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:50:17.512 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:50:17.566 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:50:17.619 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:50:17.709 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:50:17.745 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:50:17.792 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:17.822 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:17.937 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:50:17.976 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:50:18.056 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:50:18.373 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:18.409 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:50:18.485 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:50:18.485 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:50:18.485 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:50:18.485 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:18.518 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:50:18.753 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:50:18.870 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:50:20.197 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:50:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:50:20.302 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:50:23.992 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:24.023 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:24.534 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-09-10T23:50:24.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:24.609 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:50:24.652 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:50:24.708 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:50:24.724 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:50:24.724 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:24.724 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:50:24.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:24.745 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:50:24.745 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:50:24.745 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:50:24.745 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:24.778 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:50:26.237 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:50:26.264 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:50:26.264 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:26.264 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:50:26.264 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:50:26.264 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:50:26.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:26.488 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:50:26.512 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:50:26.512 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:26.512 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:50:26.512 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:50:26.512 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:50:26.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:26.964 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:50:26.987 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:50:26.987 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:26.987 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:50:26.987 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:50:26.987 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:50:26.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:27.102 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:50:27.159 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:50:27.215 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:50:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:50:27.465 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:50:27.542 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:50:27.631 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:50:27.778 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:50:27.823 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:50:27.855 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:50:27.883 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:50:28.288 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:50:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:50:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:50:28.413 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:50:28.438 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:50:30.552 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:50:30.552 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-09-10T23:50:30.552 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-09-10T23:50:30.553 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-09-10T23:50:30.553 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-09-10T23:50:30.553 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-09-10T23:50:30.553 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-09-10T23:50:30.553 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-09-10T23:50:30.553 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:50:30.758 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:50:30.758 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:30.758 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:50:30.758 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:31.633 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:50:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:50:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:50:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:50:32.300 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:32.301 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:50:32.301 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:50:32.301 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:50:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:32.533 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:50:32.556 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:50:32.557 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:32.557 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:50:32.557 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:50:32.557 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:50:32.557 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:50:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:50:32.802 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:50:32.965 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:50:32.997 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:50:33.009 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:50:33.021 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:50:33.021 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:33.021 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:50:33.021 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:50:33.021 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:50:33.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:33.032 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:50:33.032 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:33.033 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:50:33.033 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:50:33.033 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:50:33.033 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:33.073 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:50:33.085 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:50:33.183 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:50:33.196 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:50:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:50:33.251 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:50:33.437 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:50:33.485 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:50:33.553 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:50:33.641 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:50:33.783 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:50:33.818 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:50:33.850 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:50:33.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:50:34.205 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:50:34.234 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:50:34.258 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:50:34.258 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:34.258 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:50:34.258 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:50:34.258 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:50:34.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:34.282 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:50:34.301 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:50:34.309 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:50:34.325 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:50:34.325 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:34.325 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:50:34.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:34.342 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:50:34.377 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:50:34.401 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:50:34.401 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:34.401 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:50:34.401 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:50:34.401 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:50:34.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:34.406 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:50:34.433 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:50:34.719 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:50:34.743 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:50:34.743 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:34.743 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:50:34.743 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:50:34.744 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:50:34.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:50:37.482 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-09-10T23:50:37.482 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-09-10T23:50:37.482 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-09-10T23:50:37.483 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-09-10T23:50:37.483 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-09-10T23:50:37.483 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-09-10T23:50:37.483 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-09-10T23:50:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:37.583 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:50:37.648 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:50:37.664 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:50:37.682 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:50:37.682 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:37.682 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:50:37.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:38.607 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:50:38.631 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:50:38.745 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:50:38.909 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:50:38.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:50:38.966 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:50:38.966 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:38.966 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:50:38.966 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:50:38.966 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:50:38.966 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:50:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:50:39.126 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:50:39.173 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:50:39.259 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:50:39.288 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:50:39.288 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:39.288 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:50:39.288 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:50:39.288 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:50:39.288 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:50:39.464 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:50:39.506 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:50:39.526 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:50:39.538 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:50:39.551 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:50:39.552 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:39.552 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:50:39.552 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:50:39.552 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:50:39.552 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:39.565 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:50:39.744 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:50:39.787 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:50:39.817 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:50:39.847 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:50:39.885 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:50:40.027 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:50:40.052 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:50:40.053 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:40.053 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:50:40.053 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:50:40.053 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:50:40.053 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:40.123 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:50:40.153 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:50:40.166 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:50:40.176 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:50:40.176 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:40.176 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:50:40.176 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:50:40.177 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:50:40.177 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:40.220 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:50:40.232 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:50:40.242 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:50:40.242 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:40.242 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:50:40.242 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:50:40.305 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:50:40.310 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:50:40.311 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:40.311 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:50:40.311 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:50:40.311 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:50:40.311 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:40.499 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:50:40.544 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:40.545 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:50:40.592 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:40.612 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:40.627 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:50:40.646 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:50:40.670 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:50:40.670 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:40.670 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:50:40.670 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:50:40.670 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:50:40.670 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:40.724 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:50:40.885 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:50:40.941 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:50:40.977 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:50:41.004 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:50:41.412 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:50:41.435 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:50:41.454 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:50:41.495 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:50:41.522 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:50:41.563 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:50:41.564 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:50:41.593 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:50:41.645 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:50:41.675 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:50:41.701 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:50:41.735 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:50:41.735 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:50:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:50:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:50:41.912 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:50:41.936 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:50:41.942 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:41.942 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:42.122 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:42.122 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:50:42.214 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:50:42.278 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:50:44.954 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:50:45.016 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:50:45.375 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:50:45.416 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:50:45.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:50:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:50:45.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:50:45.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:50:45.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:50:45.777 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:50:45.806 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:50:45.852 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:50:46.033 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:50:46.058 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:50:46.177 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:50:46.353 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:50:46.385 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:50:46.411 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:50:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:50:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:50:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:50:46.411 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:46.433 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:46.461 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:50:46.467 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:46.473 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:50:46.487 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:46.574 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:50:46.632 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:50:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:50:47.424 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:50:47.462 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:50:47.551 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:50:47.583 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:50:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:50:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:50:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:50:47.644 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:50:47.680 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:50:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:50:47.705 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:47.705 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:50:47.705 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:50:47.705 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:50:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:50:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:50:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:50:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:50:47.780 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:47.780 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:50:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:50:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:50:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:47.839 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:50:47.865 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:50:47.865 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:47.865 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:50:47.865 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:50:47.865 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:50:47.865 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:48.004 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:48.005 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:50:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:50:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:50:48.198 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:50:48.223 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:50:48.223 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:50:48.224 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:50:48.224 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:50:48.224 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:50:48.224 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:50:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:50:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:50:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:50:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:50:49.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:50:49.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:50:49.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:50:49.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:50:49.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:50:49.255 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:50:49.256 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:50:49.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:50:49.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:50:49.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:50:51.844 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:50:51.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:51.844 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-09-10T23:50:51.844 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:51.844 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.845 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.847 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:50:51.848 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:50:51.849 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:50:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:50:51.851 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:50:51.852 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:50:51.853 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:50:51.854 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:50:51.855 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.856 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:50:51.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:50:51.858 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-10T23:50:52.245 DEBUG:teuthology.parallel:result is None 2024-09-10T23:50:53.203 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:50:53.244 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:50:53.285 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:50:53.317 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:50:53.344 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:50:53.550 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:50:53.616 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:50:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:50:53.675 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:50:53.721 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:50:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:50:54.535 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:50:54.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:50:54.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:50:54.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:50:54.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:50:54.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:50:54.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:50:54.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:50:54.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:50:54.538 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:50:54.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:50:54.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:50:54.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:50:54.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:50:54.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:50:54.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:50:54.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:50:54.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:50:54.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:50:54.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:50:54.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:50:54.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:50:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:50:54.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:50:54.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:50:54.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:50:54.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:50:54.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:50:54.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:50:54.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:50:54.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:50:54.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:50:54.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:50:54.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:50:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:50:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:50:55.427 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:50:55.518 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:50:55.552 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:50:55.577 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:50:55.611 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:50:55.612 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:50:55.712 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:50:55.712 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:50:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:50:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:50:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:50:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:50:56.099 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:50:56.167 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:50:57.331 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:50:57.331 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:57.331 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-09-10T23:50:57.331 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:50:57.332 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:50:57.334 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:50:57.335 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:50:57.336 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:50:57.337 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:50:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:50:57.339 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:50:57.340 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:50:57.341 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:50:57.342 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:50:57.343 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:50:57.344 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T23:50:57.788 DEBUG:teuthology.parallel:result is None 2024-09-10T23:51:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:51:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:51:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:51:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:51:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:51:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:51:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:51:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:51:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:51:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:51:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:51:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:51:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:51:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:51:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:51:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:51:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:51:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:51:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:51:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:51:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:51:04.749 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:51:04.752 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:51:04.753 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:51:04.754 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:51:04.755 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:51:04.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:51:04.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:51:04.758 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:51:04.759 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:51:04.760 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:51:04.761 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:51:04.762 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:51:04.762 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:51:04.762 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-10T23:51:05.245 DEBUG:teuthology.parallel:result is None 2024-09-10T23:51:05.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:51:05.396 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:51:05.420 INFO:teuthology.orchestra.run.smithi019.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:51:05.421 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:51:05.421 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:51:05.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:51:05.570 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:51:05.597 INFO:teuthology.orchestra.run.smithi131.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:51:05.598 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:51:05.598 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:51:05.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:51:05.744 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:51:05.769 INFO:teuthology.orchestra.run.smithi135.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:51:05.769 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:51:05.769 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:51:05.771 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:51:05.771 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:51:05.771 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:51:05.801 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:51:05.802 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:51:05.834 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:51:05.834 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:51:05.864 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:51:05.864 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:51:05.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:51:05.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:51:05.957 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:51:05.958 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:51:05.987 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:51:06.054 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:51:06.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:51:06.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:51:06.153 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:51:06.153 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:51:06.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:51:06.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:51:06.246 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:51:06.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:51:06.275 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:51:06.341 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:51:06.341 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:51:06.366 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:51:06.431 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:51:06.431 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:51:06.431 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:51:06.457 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:51:06.524 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:51:06.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:51:06.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:51:06.613 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:51:06.614 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:51:06.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:51:06.704 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T23:51:06.796 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T23:51:06.796 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:51:06.797 INFO:tasks.cephadm:Cluster fsid is 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:51:06.797 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T23:51:06.797 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.19', 'mon.b': '172.21.15.131', 'mon.c': '172.21.15.135'} 2024-09-10T23:51:06.797 INFO:tasks.cephadm:First mon is mon.a on smithi019 2024-09-10T23:51:06.798 INFO:tasks.cephadm:First mgr is x 2024-09-10T23:51:06.798 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T23:51:06.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname $(hostname -s) 2024-09-10T23:51:06.824 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname $(hostname -s) 2024-09-10T23:51:06.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-09-10T23:51:06.875 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T23:51:06.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:51:07.025 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T23:51:07.179 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:51:07.181 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:51:07.181 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:51:07.181 DEBUG:teuthology.orchestra.run.smithi019:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:07.558 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:51 /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:07.558 DEBUG:teuthology.orchestra.run.smithi131:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:07.938 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:51 /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:07.938 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:51 /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:08.321 DEBUG:teuthology.orchestra.run.smithi019:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:08.338 DEBUG:teuthology.orchestra.run.smithi131:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:08.355 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:51:08.388 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T23:51:08.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:51:08.394 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:51:08.397 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:51:10.013 INFO:teuthology.orchestra.run.smithi131.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:51:10.027 INFO:teuthology.orchestra.run.smithi019.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:51:10.145 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:51:38.767 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-10T23:51:38.768 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:51:38.768 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:51:38.768 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-09-10T23:51:38.768 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:51:38.768 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-10T23:51:38.769 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-10T23:51:41.522 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-10T23:51:41.522 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:51:41.522 INFO:teuthology.orchestra.run.smithi131.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:51:41.522 INFO:teuthology.orchestra.run.smithi131.stdout: "repo_digests": [ 2024-09-10T23:51:41.523 INFO:teuthology.orchestra.run.smithi131.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:51:41.523 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-09-10T23:51:41.523 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-10T23:51:42.734 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T23:51:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:51:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:51:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "repo_digests": [ 2024-09-10T23:51:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:51:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T23:51:42.735 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T23:51:42.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph 2024-09-10T23:51:42.806 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph 2024-09-10T23:51:42.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-09-10T23:51:42.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /etc/ceph 2024-09-10T23:51:42.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /etc/ceph 2024-09-10T23:51:42.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-09-10T23:51:42.956 INFO:tasks.cephadm:Writing seed config... 2024-09-10T23:51:42.957 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T23:51:42.957 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-10T23:51:42.957 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T23:51:42.957 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T23:51:42.957 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T23:51:42.957 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T23:51:42.957 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T23:51:42.958 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:51:42.959 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T23:51:42.959 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T23:51:42.959 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T23:51:42.959 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T23:51:42.959 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T23:51:42.959 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T23:51:42.960 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:51:42.960 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T23:51:42.977 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8be8ba00-6fcf-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-09-10T23:51:42.977 DEBUG:teuthology.orchestra.run.smithi019:mon.a> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T23:51:43.019 DEBUG:teuthology.orchestra.run.smithi019:mgr.x> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T23:51:43.063 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T23:51:43.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.19 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:51:43.275 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:51:43.275 INFO:teuthology.orchestra.run.smithi019.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.19', '--skip-admin-label'] 2024-09-10T23:51:43.275 INFO:teuthology.orchestra.run.smithi019.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T23:51:43.276 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying podman|docker is present... 2024-09-10T23:51:43.299 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:51:43.299 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying lvm2 is present... 2024-09-10T23:51:43.299 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying time synchronization is in place... 2024-09-10T23:51:43.307 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:51:43.308 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:51:43.314 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:51:43.314 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T23:51:43.321 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-09-10T23:51:43.327 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-09-10T23:51:43.328 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:51:43.328 INFO:teuthology.orchestra.run.smithi019.stdout:Repeating the final host check... 2024-09-10T23:51:43.350 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:51:43.350 INFO:teuthology.orchestra.run.smithi019.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T23:51:43.350 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl is present 2024-09-10T23:51:43.350 INFO:teuthology.orchestra.run.smithi019.stdout:lvcreate is present 2024-09-10T23:51:43.357 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:51:43.357 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:51:43.363 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:51:43.363 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T23:51:43.370 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-09-10T23:51:43.377 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-09-10T23:51:43.377 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:51:43.377 INFO:teuthology.orchestra.run.smithi019.stdout:Host looks OK 2024-09-10T23:51:43.377 INFO:teuthology.orchestra.run.smithi019.stdout:Cluster fsid: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:51:43.377 INFO:teuthology.orchestra.run.smithi019.stdout:Acquiring lock 140384735429488 on /run/cephadm/8be8ba00-6fcf-11ef-bcea-c7b262605968.lock 2024-09-10T23:51:43.377 INFO:teuthology.orchestra.run.smithi019.stdout:Lock 140384735429488 acquired on /run/cephadm/8be8ba00-6fcf-11ef-bcea-c7b262605968.lock 2024-09-10T23:51:43.378 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 3300 ... 2024-09-10T23:51:43.378 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 6789 ... 2024-09-10T23:51:43.378 INFO:teuthology.orchestra.run.smithi019.stdout:Base mon IP(s) is [172.21.15.19:3300, 172.21.15.19:6789], mon addrv is [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-10T23:51:43.381 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.19 metric 100 2024-09-10T23:51:43.381 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.19 metric 100 2024-09-10T23:51:43.384 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T23:51:43.384 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T23:51:43.384 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1755sec hoplimit 64 pref medium 2024-09-10T23:51:43.386 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T23:51:43.386 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T23:51:43.386 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:51:43.386 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T23:51:43.387 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-10T23:51:43.387 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:51:43.387 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-09-10T23:51:43.387 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-09-10T23:51:43.387 INFO:teuthology.orchestra.run.smithi019.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T23:51:43.388 INFO:teuthology.orchestra.run.smithi019.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T23:51:43.389 INFO:teuthology.orchestra.run.smithi019.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:51:43.904 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:51:43.904 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:51:43.904 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T23:51:43.904 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T23:51:43.905 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T23:51:43.905 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:51:43.905 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T23:51:44.834 INFO:teuthology.orchestra.run.smithi019.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:51:44.835 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:51:44.835 INFO:teuthology.orchestra.run.smithi019.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T23:51:45.733 INFO:teuthology.orchestra.run.smithi019.stdout:stat: stdout 167 167 2024-09-10T23:51:45.733 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial keys... 2024-09-10T23:51:46.706 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQCS2+BmCCL/AxAA8RJOygJ7G5Jyh0TFmU5Tqw== 2024-09-10T23:51:47.687 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQCT2+BmCwRnAxAApY/NjfjQCLNn4Knm0DYSNA== 2024-09-10T23:51:48.491 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQCT2+Bmh6jHORAA537gSBY8L5yL8gMvbHxwSw== 2024-09-10T23:51:48.492 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial monmap... 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool for a [v2:172.21.15.19:3300,v1:172.21.15.19:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: set fsid to 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:51:49.365 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:51:49.366 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mon... 2024-09-10T23:51:50.313 INFO:teuthology.orchestra.run.smithi019.stdout:create mon.a on 2024-09-10T23:51:50.526 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T23:51:50.694 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T23:51:50.885 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968.target. 2024-09-10T23:51:50.885 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968.target. 2024-09-10T23:51:51.158 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:51:51.160 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T23:51:51.346 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968.target.wants/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@.service. 2024-09-10T23:51:51.395 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 systemd[1]: Starting Ceph mon.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:51:51.714 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 podman[30476]: 2024-09-10 23:51:51.587170579 +0000 UTC m=+0.109651744 container create 143e9b4904fd689efddf80cb22f2f06d145bbadfb11a02694e2f35349ba8fcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:51:51.715 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 podman[30476]: 2024-09-10 23:51:51.495160605 +0000 UTC m=+0.017641782 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:51:51.880 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:51:51.880 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T23:51:51.888 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:51:51.888 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T23:51:51.889 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T23:51:51.889 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:51:51.889 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon to start... 2024-09-10T23:51:51.889 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon... 2024-09-10T23:51:52.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 podman[30476]: 2024-09-10 23:51:51.806122338 +0000 UTC m=+0.328603503 container init 143e9b4904fd689efddf80cb22f2f06d145bbadfb11a02694e2f35349ba8fcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T23:51:52.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 podman[30476]: 2024-09-10 23:51:51.80961862 +0000 UTC m=+0.332099787 container start 143e9b4904fd689efddf80cb22f2f06d145bbadfb11a02694e2f35349ba8fcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:52.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 ceph-mon[30496]: mkfs 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:51:52.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 ceph-mon[30496]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:51:52.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 bash[30476]: 143e9b4904fd689efddf80cb22f2f06d145bbadfb11a02694e2f35349ba8fcc5 2024-09-10T23:51:52.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:51 smithi019 systemd[1]: Started Ceph mon.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:51:53.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:51:53.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: monmap epoch 1 2024-09-10T23:51:53.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:51:53.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: last_changed 2024-09-10T23:51:48.824335+0000 2024-09-10T23:51:53.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: created 2024-09-10T23:51:48.824335+0000 2024-09-10T23:51:53.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: min_mon_release 19 (squid) 2024-09-10T23:51:53.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: election_strategy: 1 2024-09-10T23:51:53.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T23:51:53.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: fsmap 2024-09-10T23:51:53.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:51:53.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:52 smithi019 ceph-mon[30496]: mgrmap e1: no daemons active 2024-09-10T23:51:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:51:54 smithi019 ceph-mon[30496]: from='client.? 172.21.15.19:0/4137168172' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T23:52:00.928 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout id: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout services: 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 2s) 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout data: 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T23:52:00.929 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T23:52:00.930 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:00.930 INFO:teuthology.orchestra.run.smithi019.stdout:mon is available 2024-09-10T23:52:00.930 INFO:teuthology.orchestra.run.smithi019.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T23:52:04.045 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:04 smithi019 ceph-mon[30496]: from='client.? 172.21.15.19:0/824467557' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:52:04.045 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:04 smithi019 ceph-mon[30496]: from='client.? 172.21.15.19:0/824467557' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T23:52:05.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:05.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:52:05.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:52:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:52:05.826 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:52:05.826 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:52:05.826 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:52:05.826 INFO:teuthology.orchestra.run.smithi019.stdout:Generating new minimal ceph.conf... 2024-09-10T23:52:06.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:06 smithi019 ceph-mon[30496]: from='client.? 172.21.15.19:0/3150348574' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:06.903 INFO:teuthology.orchestra.run.smithi019.stdout:Restarting the monitor... 2024-09-10T23:52:07.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:06 smithi019 systemd[1]: Stopping Ceph mon.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:52:07.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a[30492]: 2024-09-10T23:52:07.169+0000 7fdf2e821640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:07.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a[30492]: 2024-09-10T23:52:07.169+0000 7fdf2e821640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T23:52:07.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:07 smithi019 podman[30738]: 2024-09-10 23:52:07.343836801 +0000 UTC m=+0.275148602 container died 143e9b4904fd689efddf80cb22f2f06d145bbadfb11a02694e2f35349ba8fcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:52:07.928 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:07 smithi019 podman[30738]: 2024-09-10 23:52:07.702274492 +0000 UTC m=+0.633586283 container cleanup 143e9b4904fd689efddf80cb22f2f06d145bbadfb11a02694e2f35349ba8fcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:52:07.929 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:07 smithi019 bash[30738]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:52:08.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:07 smithi019 podman[30751]: 2024-09-10 23:52:07.928240621 +0000 UTC m=+0.584514627 container remove 143e9b4904fd689efddf80cb22f2f06d145bbadfb11a02694e2f35349ba8fcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T23:52:08.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 systemd[1]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T23:52:08.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 systemd[1]: Stopped Ceph mon.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:52:08.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 systemd[1]: Starting Ceph mon.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 podman[30840]: 2024-09-10 23:52:08.270935268 +0000 UTC m=+0.101906326 container create 1f3c3449861044c84a0861a7af18fcfcad64fdc7cd9be44fc09b3f2df7864f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 podman[30840]: 2024-09-10 23:52:08.184991366 +0000 UTC m=+0.015962367 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 podman[30840]: 2024-09-10 23:52:08.481481766 +0000 UTC m=+0.312452755 container init 1f3c3449861044c84a0861a7af18fcfcad64fdc7cd9be44fc09b3f2df7864f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 podman[30840]: 2024-09-10 23:52:08.484660617 +0000 UTC m=+0.315631607 container start 1f3c3449861044c84a0861a7af18fcfcad64fdc7cd9be44fc09b3f2df7864f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: pidfile_write: ignore empty --pid-file 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: load: jerasure load: lrc 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:52:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Git sha 0 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: DB SUMMARY 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: DB Session ID: QNCEHOE2LMSQM2VZOW31 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96561 ; 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:52:08.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.env: 0x55da699d2180 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.info_log: 0x55da6bdeb700 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.statistics: (nil) 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.use_fsync: 0 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:52:08.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.db_log_dir: 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.wal_dir: 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.write_buffer_manager: 0x55da6bdefb80 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:52:08.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:52:08.528 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:52:08.528 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:52:08.528 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.unordered_write: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.row_cache: None 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.wal_filter: None 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.wal_compression: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:52:08.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:52:08.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_open_files: -1 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:52:08.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Compression algorithms supported: 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kZSTD supported: 0 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T23:52:08.532 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.merge_operator: 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_filter: None 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55da6bdeb320) 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_type: 0 2024-09-10T23:52:08.533 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_index_type: 0 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_shortening: 1 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: checksum: 4 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: no_block_cache: 0 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache: 0x55da6bddf610 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_options: 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: capacity : 536870912 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_shard_bits : 4 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: strict_capacity_limit : 0 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_compressed: (nil) 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: persistent_cache: (nil) 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size: 4096 2024-09-10T23:52:08.534 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size_deviation: 10 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_restart_interval: 16 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_block_restart_interval: 1 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: metadata_block_size: 4096 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: partition_filters: 0 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: use_delta_encoding: 1 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: filter_policy: bloomfilter 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: whole_key_filtering: 1 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: verify_compression: 0 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: format_version: 5 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_index_compression: 1 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_align: 0 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: max_auto_readahead_size: 262144 2024-09-10T23:52:08.535 INFO:journalctl@ceph.mon.a.smithi019.stdout: prepopulate_block_cache: 0 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression: NoCompression 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.num_levels: 7 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:52:08.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:52:08.537 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:52:08.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:52:08.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:52:08.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.ttl: 2592000 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:52:08.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b9d0d1c5-5841-46ee-b71b-ab7c0dc18ba4 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012328511633, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012328512573, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92465, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 295, "table_properties": {"data_size": 90512, "index_size": 273, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11990, "raw_average_key_size": 47, "raw_value_size": 83754, "raw_average_value_size": 335, "num_data_blocks": 12, "num_entries": 250, "num_filter_entries": 250, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726012328, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b9d0d1c5-5841-46ee-b71b-ab7c0dc18ba4", "db_session_id": "QNCEHOE2LMSQM2VZOW31", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012328512676, "job": 1, "event": "recovery_finished"} 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:52:08.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55da6be0ee00 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: DB pointer 0x55da6bf10000 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** DB Stats ** 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-09-10T23:52:08.543 INFO:journalctl@ceph.mon.a.smithi019.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: L0 2/0 92.16 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: Sum 2/0 92.16 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 154.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:52:08.544 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative compaction: 0.00 GB write, 27.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval compaction: 0.00 GB write, 27.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache BinnedLRUCache@0x55da6bddf610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:52:08.545 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: starting mon.a rank 0 at public addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] at bind addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???) e1 preinit fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???).mds e1 new map 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???).mds e1 print_map 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout: e1 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout: btime 2024-09-10T23:51:51:848411+0000 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout: legacy client fscid: -1 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout: No filesystems configured 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:52:08.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:52:08.547 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T23:52:08.574 INFO:teuthology.orchestra.run.smithi019.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T23:52:08.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 bash[30840]: 1f3c3449861044c84a0861a7af18fcfcad64fdc7cd9be44fc09b3f2df7864f45 2024-09-10T23:52:08.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:52:08.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: monmap epoch 1 2024-09-10T23:52:08.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:08.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: last_changed 2024-09-10T23:51:48.824335+0000 2024-09-10T23:52:08.885 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: created 2024-09-10T23:51:48.824335+0000 2024-09-10T23:52:08.886 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: min_mon_release 19 (squid) 2024-09-10T23:52:08.886 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: election_strategy: 1 2024-09-10T23:52:08.886 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T23:52:08.886 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: fsmap 2024-09-10T23:52:08.886 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:52:08.886 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 ceph-mon[30859]: mgrmap e1: no daemons active 2024-09-10T23:52:08.886 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:08 smithi019 systemd[1]: Started Ceph mon.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:52:09.550 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T23:52:09.571 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:52:09.571 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mgr... 2024-09-10T23:52:09.572 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T23:52:09.572 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T23:52:09.831 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:52:09.831 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T23:52:09.989 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968.target.wants/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@.service. 2024-09-10T23:52:10.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:10 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2367353318' entity='client.admin' 2024-09-10T23:52:11.022 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:10 smithi019 podman[31069]: 2024-09-10 23:52:10.763874548 +0000 UTC m=+0.647159410 container start 06c2442c6e82f13966ce3e955c16c45c5c0a8be223ca5b15b85d3ad292f5a3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T23:52:11.707 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:52:11.708 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T23:52:11.715 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:52:11.715 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T23:52:11.715 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T23:52:11.715 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:52:11.724 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:52:11.725 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T23:52:11.733 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:52:11.733 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T23:52:11.733 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T23:52:11.733 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T23:52:11.733 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr to start... 2024-09-10T23:52:11.733 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr... 2024-09-10T23:52:12.022 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:11 smithi019 bash[31069]: 06c2442c6e82f13966ce3e955c16c45c5c0a8be223ca5b15b85d3ad292f5a3ec 2024-09-10T23:52:12.022 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:11 smithi019 systemd[1]: Started Ceph mgr.x for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:52:13.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:12 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/132571286' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:52:13.273 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:13.273 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:52:13.273 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-09-10T23:52:13.274 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:13.275 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:51:51:848411+0000", 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:52:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:51:51.849111+0000", 2024-09-10T23:52:13.277 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:52:13.278 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:13.278 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:52:13.278 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:52:13.278 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (1/15)... 2024-09-10T23:52:16.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:15 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2796445877' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:52:16.368 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:52:16.369 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:52:16.370 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:52:16.374 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:16.374 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:52:16.374 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:51:51:848411+0000", 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:52:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:51:51.849111+0000", 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (2/15)... 2024-09-10T23:52:17.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: Activating manager daemon x 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: mgrmap e2: x(active, starting, since 0.00309043s) 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: Manager daemon x is now available 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' 2024-09-10T23:52:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:16 smithi019 ceph-mon[30859]: from='mgr.14100 172.21.15.19:0/1007382454' entity='mgr.x' 2024-09-10T23:52:18.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:18 smithi019 ceph-mon[30859]: mgrmap e3: x(active, since 1.0074s) 2024-09-10T23:52:19.509 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:19 smithi019 ceph-mon[30859]: mgrmap e4: x(active, since 2s) 2024-09-10T23:52:19.641 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:19.641 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:52:19.641 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-10T23:52:19.641 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:52:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:19.643 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:52:19.643 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:52:19.643 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:19.643 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:52:19.643 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:19.643 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:52:19.643 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:52:19.647 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:51:51:848411+0000", 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:52:19.648 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:51:51.849111+0000", 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:52:19.649 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:52:19.650 INFO:teuthology.orchestra.run.smithi019.stdout:mgr is available 2024-09-10T23:52:20.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:20 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/443746402' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:52:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:52:20.748 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling cephadm module... 2024-09-10T23:52:21.174 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:21 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3405074934' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:52:22.382 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:22 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4013700740' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T23:52:22.383 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:22 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ignoring --setuser ceph since I am not root 2024-09-10T23:52:22.383 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:22 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ignoring --setgroup ceph since I am not root 2024-09-10T23:52:23.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:23 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4013700740' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T23:52:23.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:23 smithi019 ceph-mon[30859]: mgrmap e5: x(active, since 6s) 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-09-10T23:52:23.911 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 5... 2024-09-10T23:52:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:24 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2740981818' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:52:27.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: Active manager daemon x restarted 2024-09-10T23:52:27.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: Activating manager daemon x 2024-09-10T23:52:27.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T23:52:27.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: mgrmap e6: x(active, starting, since 0.00313222s) 2024-09-10T23:52:27.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:52:27.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:52:27.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:52:27.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:52:27.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:52:27.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:27 smithi019 ceph-mon[30859]: Manager daemon x is now available 2024-09-10T23:52:28.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:52:28.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T23:52:28.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:52:28.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:52:28.891 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 5 is available 2024-09-10T23:52:28.891 INFO:teuthology.orchestra.run.smithi019.stdout:Setting orchestrator backend to cephadm... 2024-09-10T23:52:29.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: Found migration_current of "None". Setting to last migration. 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: mgrmap e7: x(active, since 1.00579s) 2024-09-10T23:52:29.276 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:29 smithi019 ceph-mon[30859]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T23:52:30.717 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-mon[30859]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:30.717 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:30.717 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:30.717 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-mon[30859]: mgrmap e8: x(active, since 2s) 2024-09-10T23:52:30.717 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-10T23:52:30.336+0000 7f6cbb2b9640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:52:30] ENGINE Error in HTTPServer.serve 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: Traceback (most recent call last): 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._connections.run(self.expiration_interval) 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._run(expiration_interval) 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:52:30.718 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: s = self.context.wrap_socket( 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: return self.sslsocket_class._create( 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self.do_handshake() 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._sslobj.do_handshake() 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:52:30.719 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-10T23:52:31.286 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T23:52:31.286 INFO:teuthology.orchestra.run.smithi019.stdout:Generating ssh key... 2024-09-10T23:52:31.660 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:31 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:30] ENGINE Bus STARTING 2024-09-10T23:52:31.660 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:31 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:30] ENGINE Serving on https://172.21.15.19:7150 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:31 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:30] ENGINE Error in HTTPServer.serve 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: Traceback (most recent call last): 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._run(expiration_interval) 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:52:31.661 INFO:journalctl@ceph.mon.a.smithi019.stdout: s = self.context.wrap_socket( 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout: return self.sslsocket_class._create( 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout: self.do_handshake() 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._sslobj.do_handshake() 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:31 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:30] ENGINE Serving on http://172.21.15.19:8765 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:31 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:30] ENGINE Bus STARTED 2024-09-10T23:52:31.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:31 smithi019 ceph-mon[30859]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: Generating public/private rsa key pair. 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: Your identification has been saved in /tmp/tmp0ald8nv6/key 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: Your public key has been saved in /tmp/tmp0ald8nv6/key.pub 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: The key fingerprint is: 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: SHA256:uEI/HndipcbFXEO6K0DYxI8LuIYwihUi0oEhft6ySzA ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: The key's randomart image is: 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: +---[RSA 3072]----+ 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: |o+.. .. . | 2024-09-10T23:52:32.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: |B o +. o | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: |oo +. oo . o | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: |o = o....o o . | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: |+E +.oo.S * | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: |+ =.o..+ + . | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: | . o. = O o | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: | . .o * + | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: | . . | 2024-09-10T23:52:32.450 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: +----[SHA256]-----+ 2024-09-10T23:52:32.723 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-mon[30859]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:32.723 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-mon[30859]: Generating ssh key... 2024-09-10T23:52:32.723 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:32.723 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:32 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:33.908 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiear4NJ1cCox/z0bdTAiBpNtdk6czJ1+9NP8v1dL+ZPGAQzAm25AxZLe8H+RbjUIeVXLkhNgwE99e15BqQRLOhTr0ZxGlt4zC1hDYJKASkPdTXaopER+ZPVAvK7MhXSDB22MWo0tp7UgSHo8VUNxjSDOYsiVD13sszKsIN5uMHIf05qrkOsPUACIoduEcZkOJzacTozk9QzPZ74aq1waij+EpjInwV6xtqfWcBdlhTa9h23BK9LJ48Goapn7eDxgbvbd+JuyFhkbHHn4k1toGWnm38LqWbOmQKhrExIAYBXkt7+Ld+EDA31iAJnH78B7bVuUI9Po40k0T84eI8DMay82ns9UwWy+T7PsXvUsEwxZzuvPpzARF1K7etaDUWarhEc2w2lADawjabIQ6jT6F2ydHXAE9dzB0QE8UVsdA3gzRrjemmVR1LltAeUhrg+oGy2EwD1CnSbtojAhZXktAxHhj5bOXrA53SySTMF2RaJMKHPTyUmOorOdddvpYW0E= ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:52:33.908 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:52:33.908 INFO:teuthology.orchestra.run.smithi019.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T23:52:33.913 INFO:teuthology.orchestra.run.smithi019.stdout:Adding host smithi019... 2024-09-10T23:52:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:34 smithi019 ceph-mon[30859]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:35.257 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:35 smithi019 ceph-mon[30859]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi019", "addr": "172.21.15.19", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:36.489 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:36 smithi019 ceph-mon[30859]: Deploying cephadm binary to smithi019 2024-09-10T23:52:39.114 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Added host 'smithi019' with addr '172.21.15.19' 2024-09-10T23:52:39.114 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mon service... 2024-09-10T23:52:39.732 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:39 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:39.732 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:39 smithi019 ceph-mon[30859]: Added host smithi019 2024-09-10T23:52:39.732 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:39 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:40.389 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T23:52:40.390 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mgr service... 2024-09-10T23:52:41.010 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:40 smithi019 ceph-mon[30859]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:41.010 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:40 smithi019 ceph-mon[30859]: Saving service mon spec with placement count:5 2024-09-10T23:52:41.010 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:40 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:42 smithi019 ceph-mon[30859]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:42 smithi019 ceph-mon[30859]: Saving service mgr spec with placement count:2 2024-09-10T23:52:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:42 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:42 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:42.384 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T23:52:43.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:43 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:43.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:43 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3245468471' entity='client.admin' 2024-09-10T23:52:45.506 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:45 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:45.507 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:45 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/311503770' entity='client.admin' 2024-09-10T23:52:45.507 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:45 smithi019 ceph-mon[30859]: from='mgr.14118 172.21.15.19:0/1875149432' entity='mgr.x' 2024-09-10T23:52:45.509 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling the dashboard module... 2024-09-10T23:52:46.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:46 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/184567734' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T23:52:46.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ignoring --setuser ceph since I am not root 2024-09-10T23:52:46.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ignoring --setgroup ceph since I am not root 2024-09-10T23:52:47.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:47 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/184567734' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T23:52:47.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:47 smithi019 ceph-mon[30859]: mgrmap e9: x(active, since 18s) 2024-09-10T23:52:48.666 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:48 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1913105640' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-09-10T23:52:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 9... 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: Active manager daemon x restarted 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: Activating manager daemon x 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: mgrmap e10: x(active, starting, since 0.00363324s) 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:52:52.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:51 smithi019 ceph-mon[30859]: Manager daemon x is now available 2024-09-10T23:52:52.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:52 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:52 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:52:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:52 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:52:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:52 smithi019 ceph-mon[30859]: mgrmap e11: x(active, since 1.00626s) 2024-09-10T23:52:53.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:52:53.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T23:52:53.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:52:53.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:52:53.109 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 9 is available 2024-09-10T23:52:53.109 INFO:teuthology.orchestra.run.smithi019.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T23:52:53.860 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-mon[30859]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T23:52:53.860 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-mon[30859]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T23:52:53.860 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-10T23:52:53.727+0000 7fbfbbc00640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:52:53] ENGINE Error in HTTPServer.serve 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: Traceback (most recent call last): 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._connections.run(self.expiration_interval) 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._run(expiration_interval) 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: s = self.context.wrap_socket( 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:52:53.861 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: return self.sslsocket_class._create( 2024-09-10T23:52:53.862 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:52:53.862 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self.do_handshake() 2024-09-10T23:52:53.862 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:52:53.862 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._sslobj.do_handshake() 2024-09-10T23:52:53.862 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:52:53.862 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:52:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: mgrmap e12: x(active, since 2s) 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:53] ENGINE Bus STARTING 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:53] ENGINE Serving on https://172.21.15.19:7150 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:53] ENGINE Error in HTTPServer.serve 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout: Traceback (most recent call last): 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._run(expiration_interval) 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:52:54.859 INFO:journalctl@ceph.mon.a.smithi019.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: s = self.context.wrap_socket( 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: return self.sslsocket_class._create( 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: self.do_handshake() 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._sslobj.do_handshake() 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:52:54.860 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:52:54.861 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:53] ENGINE Serving on http://172.21.15.19:8765 2024-09-10T23:52:54.861 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: [10/Sep/2024:23:52:53] ENGINE Bus STARTED 2024-09-10T23:52:54.861 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:54 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:52:55.825 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:55 smithi019 ceph-mon[30859]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:56.383 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUVpsou7w+7dHjv57UXKL/rMlMDdswDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIzNTI1NVoXDTM0\nMDkxMTIzNTI1NVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjE5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAvm77fVtGOE02TX3ywKDHfRnMmH4YcLFor3Rg\nCd462Pb9PnId1gXyNQqkvhxJs8BedhEoCNNqyN4CdYHkS/fIZYwxajxQpSKMPskW\n4AGrzTLK3L46m8OsjrSVaN6/FpFAuSZVxjMVbJWe/O1oNHIpurKVyqYYNmTbvtlm\ndjpoiYaQMIunLiJGSM/9/Fvym9G8P/TAdycaSkDfsRA4WNWYff7nwURNxZSPMaf3\nvhYiZtuC7+wxsUZzERYSfIyvioSnehK3PYWf3jF2el62yDY/0gbqGZVVchn//RMz\nXSaAy2FY/y1XcNXPUik4XhAw0GH3D10mNhdjIenFQdBdXUWmSxAf2csDR0VyjbVt\naxlE7xTNZrEPONdG3a5IYTPLCVoebXDv8Kzr9PH6z3YOT/dwdeBerZRoR0wVoinC\naxZrU4g+K46r+UQ5qLH0bDa3sUBaTmOvP0RJ1V45Ue7Ulkv5j5tK2z5p5+jcl995\nKBFRhaA7Rvk1FUhf+BLqCNFRi49G4sl1Sc98F/puIUKuTyABiePBG6L4qEMima21\neel+D66F/gqg8HttTKdXZLEklUsCz/w0xR3Jsv7P1tsVkdD8TsJV1L1/2aOcnVgs\np7yB47BlrS/oQSuRG/f4Vs1d1nlzlBg29qXCNwpoMJxeKMblELcnuUxgnBkDlaXE\nA1xqkckCAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDE5LmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPEzAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQBItIjdnEEyZtfQWTNtPGtR0h5b/eLZbnfpPpmM\nTMje9vIotaCJljWCQ7U74DpPCHjzV5ZG54FoSYD/02QoGdWOFREol1nDymteSIsP\nL91eoDz7zj9eiS/lNZtFK12lGNHjNDKpnArJP2FvJTUxsqMrRRttzpDw3KfKpoER\nBMP+8VFaB5hfRvu0Bup0qnBOLjUmyj0xVVuUcW+94Gw+5fWJhxnVI8VLMP6pZNx7\nmqs7gy5DSKld5e9XHp9x9J9QNqXEDOTX7rFSPRG5mjI1DWPoFHfr5roKxsWm8YEx\n0vWnHSEYCs9LiYLVDZWY00A+MuUYyHm1ZfiuY3R2pbVaJp7GBq13Crpz8G1K/dTV\njV0ZE+Vs5acS0N5+B2CdkM3pDDBPuyvH27PVIOYQsvH0LIJQ3brZMTSLu9y+OeoX\nzqeIy69ScjkgZ+CdM+FRPEB+mGtjqeJzkQvvxJyB1O1DbLHuO2xGdc+psyej5Hvb\naFPMaiGbrdEkjNz46q5TSjTnGzyALpGezMPK6rGMgG60hn2yLqC+n1pWfMD7jTk3\npTXH0iq/sPTXREKGDXMiyQaDseXRxMNKAGUhVVNrQ8eiZLBBzg4nkFEWddNLMXjy\nsPc3lZVbASrgFIia2Z3iVPgPlUCWlroz4ZeP7Lt99I6ocrjD9insTcPLmkuNYa7j\nBR+z7g==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKgIBAAKCAgEAvm77fVtGOE02TX3ywKDHfRnMmH4YcLFor3RgCd462Pb9PnId\n1gXyNQqkvhxJs8BedhEoCNNqyN4CdYHkS/fIZYwxajxQpSKMPskW4AGrzTLK3L46\nm8OsjrSVaN6/FpFAuSZVxjMVbJWe/O1oNHIpurKVyqYYNmTbvtlmdjpoiYaQMIun\nLiJGSM/9/Fvym9G8P/TAdycaSkDfsRA4WNWYff7nwURNxZSPMaf3vhYiZtuC7+wx\nsUZzERYSfIyvioSnehK3PYWf3jF2el62yDY/0gbqGZVVchn//RMzXSaAy2FY/y1X\ncNXPUik4XhAw0GH3D10mNhdjIenFQdBdXUWmSxAf2csDR0VyjbVtaxlE7xTNZrEP\nONdG3a5IYTPLCVoebXDv8Kzr9PH6z3YOT/dwdeBerZRoR0wVoinCaxZrU4g+K46r\n+UQ5qLH0bDa3sUBaTmOvP0RJ1V45Ue7Ulkv5j5tK2z5p5+jcl995KBFRhaA7Rvk1\nFUhf+BLqCNFRi49G4sl1Sc98F/puIUKuTyABiePBG6L4qEMima21eel+D66F/gqg\n8HttTKdXZLEklUsCz/w0xR3Jsv7P1tsVkdD8TsJV1L1/2aOcnVgsp7yB47BlrS/o\nQSuRG/f4Vs1d1nlzlBg29qXCNwpoMJxeKMblELcnuUxgnBkDlaXEA1xqkckCAwEA\nAQKCAgADrIx5kxGijT4A9lWBCRkQMGrVsYkZk391JlLVneeXJZy/k0Z0Fjh7QX6D\nYUEiw94oSC7av+/aR3Fws7xxCSstzZI4F69oOc4CE0seFnb3Rh8xbXiGZmeld5Wl\njxz/4g/uAolUTspl0xuQJNxsnQJx5N2/w4vJpBFOEbYVjdog3R6NcTeDS/H8yzzk\naezr7xRcsriL4MGnF31S8ADGTGJDlaMCNyXw+LhfUuHhIitjvjrWeiezR3kTP7b3\nl2QQauLFF8G+4OpNFSAEcfnAy+fxtP4LPentTtPoUNiEcY7s9y6j+n7ELiI9b/Va\nCzuF3ORkjX2EcAsSxznUPTrjGjCAT1EEitxIpJDhhU6rFsb2+0Z9v4xL+LBlTHDs\ndthEhjRX6YximDf81VEZrDISM7KXlBkVQLiozNQ8W75ElaHi6ehJfyD4/+GB8Isr\njFL0De4Wt0gJTkZ23+NzfK5ZDUABmCe0fGTX2wkFz4qJNb7wOf+i2gjmBtT5p7qC\nrvVZWciBMoJbhzAbVDdycsdhSqFxHJ6DrEnyAzVl9+68oZxNzbxNlEB2n09k/W9B\ncbAO/diDbFtzWqwRmglQYCAn8tkk6QLeeOXHklke1Yko/xieiPFI2ZxMsTNU2GcX\nUYU42dSPrUkZ1rKDIEsWM4hB6squb+9uwaHAO2IqQ4SFq14KIQKCAQEA4xSn+UV8\nTZBrh2e+5qRrXt67/x+0yy6K738G6SYZJuhxuTkBCeOCK8Snp4UGaHVOWZBJUhnC\nnwP3RgNAI+dGKSaMCQE9RQCFCzj36jI8M1BO78ZIWyDP4Vpklxsy7LrkUatz0nky\nC6H0xz1LtNn7+SttDa1FY7JI3R6syl+7VmzZ25e63BfJobeQx1qEnh7L8IlqdDU7\nSSBuPiydGFmeQsOKDkMIKFShJHjOKZhUeQo1UGaA0C+v/tzZ5r0WDrqQlpOdwwhC\n9T0aISHmclolIBjsyaE4F1ngst+B8MkqTFxjfdKW31aNDstkSKafR8knDglywChs\nrBe//T2/mroZ1QKCAQEA1q+LvVPM5uQ4vK7a9WPStJTOkHqWO1EtugtV9xRXmxqB\nSYMTT5RXyNELmpgwf9ZzrTjb6p2T190HTNJ1EhYfjecSEzfeZ9Y1nruZAelmS169\n0Z8lvTsXefhnChdOZZctzlcdYSSSlBT4BFJilKRUQSCGPv9q4EOnnej/kQVZgkFW\neK+2Uk0zeW/PHrZ//0RiLe2HorurwDjXLsOgP9MB+YvYN2XUSSGuBBM2sVtciYHI\nQKUaU7Yjxzwd8tx6Lb+QizTBBwzVa5SkxdLEJz8ksjBd+yRPzQX7bMsj8XJrvYdL\ncNmon46GL3tpjzsCcNCrf+wV5uc5zhsz1FdgNJZ+JQKCAQEAocRSUTqV7a+HWqOm\nlCnnL2Ne68VLhz71zN1iL+9rFZObiEa6na/MSJ/Ei4sxYHLIyPcHtIwTYDJ0EhU4\nuRsFmUUTl0qhuik/nhoMSnNU/X0lbpyDaR+7158Mb7T5lzkgc6m/Td32r+DFPrZE\n22Y6oWu1OXwJJZeZXqR+lYCTNWM/47Z4cFgl1KWvZsTuGrJ3uDg8dOKDBHos7u/b\nTcByBL/F9pj8E7cOQKwquekBrGSATHFpLGX8a4QrWruzHfT8EbjBN3IIOSo5FgdP\nYoEjV3VKIe1OxxvI/cRJjh3Qmytp2PWPczT2Mebk3viMGZiL0O0cKRXjLMmShLZb\na79NrQKCAQEAjRkpLZDjLak3hQMjE369IERhEuIO1QOAmzMSF+b9wQoFiQwl5/qm\nS2zhRITb81k+A85H84YHgitZvergWLfDm18QKSNiADrwWNgRMwl0Wvr0pM4FXr50\nqoxRJHe25dwble75dzwzPjId47FF602ptngq40K5upWcl5NoTKcIciyBKabKnILy\n3tBWf2gQ7fPC106zA4h21EpHWwvlyazkMl/wBlDd2gbRuQnru1tBkXqD48Dfcb9W\n+n4PbOvtPR4XYPaWGw0bQ66ZMQ9aLjU46AgT7Jir/iL9YT6N7AV4vEMsmQnk4qEo\nnhJtiV6ONxlebh/7MRwtiMGmKdwXddinJQKCAQEAkdkP9B4IqtXgIkGaLGF41UAZ\nG24wUADMcYH04DbN8dan0VNaxtPsiiSsEtfxScZaMzZAWX09aWEjuZaMV+jnCCGb\nf7GfxkRFE4I57g9WarESj77xuvtanTWeGZpRNZGolGG4pVP6+hkoqWBTGG1Kypz/\naDsBXxn/quriH7j71bb4PSuKWaxFc5zx9Ls3dINCidpY20tVgaoHKsyOXKRnpPsm\nrsADB4L8rSWSPyZqa7Hjhpzlmv7CY1eSQDDsW4T/k6pO1113VnBjx9aY4Z11UQLH\nhJovn3tF1eQjW3vdOx49Io3cWrcLljY9zv8nWxmN/Vu27w5oegkyOxNJbddlIA==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T23:52:57.614 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T23:52:58.257 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:58 smithi019 ceph-mon[30859]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:58.258 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:58 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:52:58.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T23:52:58.937 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial admin user... 2024-09-10T23:52:59.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:59 smithi019 ceph-mon[30859]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:59.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:52:59 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:00.360 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$eAkdIUi18etbNf.T3/sX0OyEeidYko9SC07MBJDz529ONQ/.ArJ7i", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726012379, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T23:53:00.360 INFO:teuthology.orchestra.run.smithi019.stdout:Fetching dashboard port number... 2024-09-10T23:53:00.939 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:00 smithi019 ceph-mon[30859]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:00.939 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:00 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:01.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T23:53:01.466 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:53:01.466 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T23:53:01.474 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:53:01.474 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T23:53:01.474 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T23:53:01.474 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T23:53:01.475 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph Dashboard is now available at: 2024-09-10T23:53:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: URL: https://smithi019.front.sepia.ceph.com:8443/ 2024-09-10T23:53:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: User: admin 2024-09-10T23:53:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: Password: 3bv5ix94nt 2024-09-10T23:53:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:01.476 INFO:teuthology.orchestra.run.smithi019.stdout:Saving cluster configuration to /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config directory 2024-09-10T23:53:01.898 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:01 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/629443093' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.797 INFO:teuthology.orchestra.run.smithi019.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout: ceph telemetry on 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout:For more information see: 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:02.798 INFO:teuthology.orchestra.run.smithi019.stdout:Bootstrap complete. 2024-09-10T23:53:02.835 INFO:tasks.cephadm:Fetching config... 2024-09-10T23:53:02.835 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:53:02.835 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T23:53:02.851 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T23:53:02.852 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:53:02.852 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T23:53:02.909 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T23:53:02.909 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:53:02.909 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T23:53:02.974 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T23:53:02.975 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:53:02.975 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T23:53:03.032 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T23:53:03.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiear4NJ1cCox/z0bdTAiBpNtdk6czJ1+9NP8v1dL+ZPGAQzAm25AxZLe8H+RbjUIeVXLkhNgwE99e15BqQRLOhTr0ZxGlt4zC1hDYJKASkPdTXaopER+ZPVAvK7MhXSDB22MWo0tp7UgSHo8VUNxjSDOYsiVD13sszKsIN5uMHIf05qrkOsPUACIoduEcZkOJzacTozk9QzPZ74aq1waij+EpjInwV6xtqfWcBdlhTa9h23BK9LJ48Goapn7eDxgbvbd+JuyFhkbHHn4k1toGWnm38LqWbOmQKhrExIAYBXkt7+Ld+EDA31iAJnH78B7bVuUI9Po40k0T84eI8DMay82ns9UwWy+T7PsXvUsEwxZzuvPpzARF1K7etaDUWarhEc2w2lADawjabIQ6jT6F2ydHXAE9dzB0QE8UVsdA3gzRrjemmVR1LltAeUhrg+oGy2EwD1CnSbtojAhZXktAxHhj5bOXrA53SySTMF2RaJMKHPTyUmOorOdddvpYW0E= ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:53:03.107 INFO:teuthology.orchestra.run.smithi019.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiear4NJ1cCox/z0bdTAiBpNtdk6czJ1+9NP8v1dL+ZPGAQzAm25AxZLe8H+RbjUIeVXLkhNgwE99e15BqQRLOhTr0ZxGlt4zC1hDYJKASkPdTXaopER+ZPVAvK7MhXSDB22MWo0tp7UgSHo8VUNxjSDOYsiVD13sszKsIN5uMHIf05qrkOsPUACIoduEcZkOJzacTozk9QzPZ74aq1waij+EpjInwV6xtqfWcBdlhTa9h23BK9LJ48Goapn7eDxgbvbd+JuyFhkbHHn4k1toGWnm38LqWbOmQKhrExIAYBXkt7+Ld+EDA31iAJnH78B7bVuUI9Po40k0T84eI8DMay82ns9UwWy+T7PsXvUsEwxZzuvPpzARF1K7etaDUWarhEc2w2lADawjabIQ6jT6F2ydHXAE9dzB0QE8UVsdA3gzRrjemmVR1LltAeUhrg+oGy2EwD1CnSbtojAhZXktAxHhj5bOXrA53SySTMF2RaJMKHPTyUmOorOdddvpYW0E= ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:03.119 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiear4NJ1cCox/z0bdTAiBpNtdk6czJ1+9NP8v1dL+ZPGAQzAm25AxZLe8H+RbjUIeVXLkhNgwE99e15BqQRLOhTr0ZxGlt4zC1hDYJKASkPdTXaopER+ZPVAvK7MhXSDB22MWo0tp7UgSHo8VUNxjSDOYsiVD13sszKsIN5uMHIf05qrkOsPUACIoduEcZkOJzacTozk9QzPZ74aq1waij+EpjInwV6xtqfWcBdlhTa9h23BK9LJ48Goapn7eDxgbvbd+JuyFhkbHHn4k1toGWnm38LqWbOmQKhrExIAYBXkt7+Ld+EDA31iAJnH78B7bVuUI9Po40k0T84eI8DMay82ns9UwWy+T7PsXvUsEwxZzuvPpzARF1K7etaDUWarhEc2w2lADawjabIQ6jT6F2ydHXAE9dzB0QE8UVsdA3gzRrjemmVR1LltAeUhrg+oGy2EwD1CnSbtojAhZXktAxHhj5bOXrA53SySTMF2RaJMKHPTyUmOorOdddvpYW0E= ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:53:03.161 INFO:teuthology.orchestra.run.smithi131.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiear4NJ1cCox/z0bdTAiBpNtdk6czJ1+9NP8v1dL+ZPGAQzAm25AxZLe8H+RbjUIeVXLkhNgwE99e15BqQRLOhTr0ZxGlt4zC1hDYJKASkPdTXaopER+ZPVAvK7MhXSDB22MWo0tp7UgSHo8VUNxjSDOYsiVD13sszKsIN5uMHIf05qrkOsPUACIoduEcZkOJzacTozk9QzPZ74aq1waij+EpjInwV6xtqfWcBdlhTa9h23BK9LJ48Goapn7eDxgbvbd+JuyFhkbHHn4k1toGWnm38LqWbOmQKhrExIAYBXkt7+Ld+EDA31iAJnH78B7bVuUI9Po40k0T84eI8DMay82ns9UwWy+T7PsXvUsEwxZzuvPpzARF1K7etaDUWarhEc2w2lADawjabIQ6jT6F2ydHXAE9dzB0QE8UVsdA3gzRrjemmVR1LltAeUhrg+oGy2EwD1CnSbtojAhZXktAxHhj5bOXrA53SySTMF2RaJMKHPTyUmOorOdddvpYW0E= ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:03.174 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiear4NJ1cCox/z0bdTAiBpNtdk6czJ1+9NP8v1dL+ZPGAQzAm25AxZLe8H+RbjUIeVXLkhNgwE99e15BqQRLOhTr0ZxGlt4zC1hDYJKASkPdTXaopER+ZPVAvK7MhXSDB22MWo0tp7UgSHo8VUNxjSDOYsiVD13sszKsIN5uMHIf05qrkOsPUACIoduEcZkOJzacTozk9QzPZ74aq1waij+EpjInwV6xtqfWcBdlhTa9h23BK9LJ48Goapn7eDxgbvbd+JuyFhkbHHn4k1toGWnm38LqWbOmQKhrExIAYBXkt7+Ld+EDA31iAJnH78B7bVuUI9Po40k0T84eI8DMay82ns9UwWy+T7PsXvUsEwxZzuvPpzARF1K7etaDUWarhEc2w2lADawjabIQ6jT6F2ydHXAE9dzB0QE8UVsdA3gzRrjemmVR1LltAeUhrg+oGy2EwD1CnSbtojAhZXktAxHhj5bOXrA53SySTMF2RaJMKHPTyUmOorOdddvpYW0E= ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:53:03.215 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiear4NJ1cCox/z0bdTAiBpNtdk6czJ1+9NP8v1dL+ZPGAQzAm25AxZLe8H+RbjUIeVXLkhNgwE99e15BqQRLOhTr0ZxGlt4zC1hDYJKASkPdTXaopER+ZPVAvK7MhXSDB22MWo0tp7UgSHo8VUNxjSDOYsiVD13sszKsIN5uMHIf05qrkOsPUACIoduEcZkOJzacTozk9QzPZ74aq1waij+EpjInwV6xtqfWcBdlhTa9h23BK9LJ48Goapn7eDxgbvbd+JuyFhkbHHn4k1toGWnm38LqWbOmQKhrExIAYBXkt7+Ld+EDA31iAJnH78B7bVuUI9Po40k0T84eI8DMay82ns9UwWy+T7PsXvUsEwxZzuvPpzARF1K7etaDUWarhEc2w2lADawjabIQ6jT6F2ydHXAE9dzB0QE8UVsdA3gzRrjemmVR1LltAeUhrg+oGy2EwD1CnSbtojAhZXktAxHhj5bOXrA53SySTMF2RaJMKHPTyUmOorOdddvpYW0E= ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:03.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T23:53:03.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:03 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2293005185' entity='client.admin' 2024-09-10T23:53:03.485 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:04.735 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T23:53:04.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T23:53:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:05.455 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:05 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1837979842' entity='client.admin' 2024-09-10T23:53:05.455 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:05 smithi019 ceph-mon[30859]: mgrmap e13: x(active, since 12s) 2024-09-10T23:53:05.455 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:05 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:06 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:06 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi019", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:06 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:06 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:06 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:07.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:07.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:07.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:07.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:07.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:07.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T23:53:07.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:07.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:07.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:07 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:07.602 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi131 2024-09-10T23:53:07.602 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:53:07.603 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:53:07.623 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:53:07.623 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:07.681 INFO:tasks.cephadm:Adding host smithi131 to orchestrator... 2024-09-10T23:53:07.681 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch host add smithi131 2024-09-10T23:53:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:08.302 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:08 smithi019 ceph-mon[30859]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:08.302 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:08 smithi019 ceph-mon[30859]: Updating smithi019:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:08.303 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:08 smithi019 ceph-mon[30859]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:09.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:09 smithi019 ceph-mon[30859]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:10.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:10 smithi019 ceph-mon[30859]: Deploying cephadm binary to smithi131 2024-09-10T23:53:12.428 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi131' with addr '172.21.15.131' 2024-09-10T23:53:12.705 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:12 smithi019 ceph-mon[30859]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:12.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:12 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:12.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:12 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:12.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:53:13.241 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:13.909 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:13.909 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}] 2024-09-10T23:53:13.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:13 smithi019 ceph-mon[30859]: Added host smithi131 2024-09-10T23:53:13.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:13 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:13.909 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:13 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:14.500 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2024-09-10T23:53:14.500 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:53:14.500 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:53:14.520 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:53:14.520 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:14.578 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2024-09-10T23:53:14.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch host add smithi135 2024-09-10T23:53:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:15.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:14 smithi019 ceph-mon[30859]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:15.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:14 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:15.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:14 smithi019 ceph-mon[30859]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:53:17.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:17.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:17.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:16 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:18.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:18.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:18.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: Deploying cephadm binary to smithi135 2024-09-10T23:53:18.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:18.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:18.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:18.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:18.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:18 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:19.551 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi135' with addr '172.21.15.135' 2024-09-10T23:53:19.563 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:19 smithi019 ceph-mon[30859]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:20.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:53:20.393 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:20.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:20 smithi019 ceph-mon[30859]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:20.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:20 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:20.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:20 smithi019 ceph-mon[30859]: Added host smithi135 2024-09-10T23:53:20.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:20 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:20.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:20 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:20.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:20 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:21.053 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:53:21.053 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2024-09-10T23:53:21.689 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T23:53:21.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T23:53:21.942 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:22.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:21 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:22.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:21 smithi019 ceph-mon[30859]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:53:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-10T23:53:23.205 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:22 smithi019 ceph-mon[30859]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:23.206 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:22 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1660186575' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:53:23.523 INFO:tasks.cephadm:Adding mon.a on smithi019 2024-09-10T23:53:23.523 INFO:tasks.cephadm:Adding mon.b on smithi131 2024-09-10T23:53:23.524 INFO:tasks.cephadm:Adding mon.c on smithi135 2024-09-10T23:53:23.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi019:172.21.15.19=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c' 2024-09-10T23:53:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:53:23.844 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:53:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1660186575' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:53:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:53:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:23 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:24.559 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mon update... 2024-09-10T23:53:25.095 DEBUG:teuthology.orchestra.run.smithi131:mon.b> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T23:53:25.097 DEBUG:teuthology.orchestra.run.smithi135:mon.c> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T23:53:25.100 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:53:25.100 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:53:25.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:25.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:25.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:25.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:24 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:26.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:25 smithi019 ceph-mon[30859]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:26.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:25 smithi019 ceph-mon[30859]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c;count:3 2024-09-10T23:53:26.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:25 smithi019 ceph-mon[30859]: Deploying daemon mon.c on smithi135 2024-09-10T23:53:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:53:27.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:26 smithi019 ceph-mon[30859]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:27.858 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:53:27.859 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","modified":"2024-09-10T23:51:48.824335Z","created":"2024-09-10T23:51:48.824335Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:53:27.859 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T23:53:28.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:27 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/9934430' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:53:28.859 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T23:53:28.859 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T23:53:28.859 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T23:53:28.859 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Added host smithi131 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Deploying cephadm binary to smithi135 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:28.861 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:28.862 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.862 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:28.862 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Added host smithi135 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1660186575' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1660186575' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:29.178 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c;count:3 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: Deploying daemon mon.c on smithi135 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/9934430' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 ceph-mon[35432]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 bash[35407]: bf91465b581a555f36167546a779637a688eeb5bd1a1637f46ec7cfb8f9b05b4 2024-09-10T23:53:29.179 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:28 smithi135 systemd[1]: Started Ceph mon.c for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:53:29.454 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:53:29.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:53:29.707 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:53:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: mon.a calling monitor election 2024-09-10T23:53:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: mon.c calling monitor election 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: monmap epoch 2 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: last_changed 2024-09-10T23:53:28.863158+0000 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: created 2024-09-10T23:51:48.824335+0000 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: min_mon_release 19 (squid) 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: election_strategy: 1 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-09-10T23:53:34.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: fsmap 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: mgrmap e13: x(active, since 42s) 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: overall HEALTH_OK 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:33 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: mon.a calling monitor election 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.280 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: mon.c calling monitor election 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: monmap epoch 2 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: last_changed 2024-09-10T23:53:28.863158+0000 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: created 2024-09-10T23:51:48.824335+0000 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: min_mon_release 19 (squid) 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: election_strategy: 1 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: fsmap 2024-09-10T23:53:34.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:53:34.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: mgrmap e13: x(active, since 42s) 2024-09-10T23:53:34.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: overall HEALTH_OK 2024-09-10T23:53:34.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:34.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:34.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:34.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:34.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:33 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:53:34.804 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","modified":"2024-09-10T23:53:28.863158Z","created":"2024-09-10T23:51:48.824335Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:53:34.804 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-09-10T23:53:35.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:34 smithi135 ceph-mon[35432]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:35.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:34 smithi135 ceph-mon[35432]: Deploying daemon mon.b on smithi131 2024-09-10T23:53:35.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:34 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/542504590' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:53:35.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:34 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:35.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:34 smithi019 ceph-mon[30859]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:35.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:34 smithi019 ceph-mon[30859]: Deploying daemon mon.b on smithi131 2024-09-10T23:53:35.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:34 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/542504590' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:53:35.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:34 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:36.421 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:53:36.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:53:36.668 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:53:37.040 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:36 smithi135 ceph-mon[35432]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:37.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:36 smithi019 ceph-mon[30859]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:37.305 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:53:37.305 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","modified":"2024-09-10T23:53:28.863158Z","created":"2024-09-10T23:51:48.824335Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:53:37.305 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-09-10T23:53:37.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:37 smithi131 systemd[1]: Started Ceph mon.b for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:53:38.897 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:53:38.897 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:53:39.151 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:53:42.894 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:53:42.894 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","modified":"2024-09-10T23:53:37.533358Z","created":"2024-09-10T23:51:48.824335Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T23:53:42.895 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 3 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: mon.a calling monitor election 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: mon.c calling monitor election 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.895 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: mon.b calling monitor election 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: monmap epoch 3 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: last_changed 2024-09-10T23:53:37.533358+0000 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: created 2024-09-10T23:51:48.824335+0000 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: min_mon_release 19 (squid) 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: election_strategy: 1 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-09-10T23:53:42.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: fsmap 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: mgrmap e13: x(active, since 51s) 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: overall HEALTH_OK 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:42.897 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:42 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: mon.a calling monitor election 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: mon.c calling monitor election 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:42.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: mon.b calling monitor election 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: monmap epoch 3 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: last_changed 2024-09-10T23:53:37.533358+0000 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: created 2024-09-10T23:51:48.824335+0000 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: min_mon_release 19 (squid) 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: election_strategy: 1 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T23:53:42.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: fsmap 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: mgrmap e13: x(active, since 51s) 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: overall HEALTH_OK 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:42.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:42 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:43.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:43.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:43.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: mon.a calling monitor election 2024-09-10T23:53:43.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: mon.c calling monitor election 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: mon.b calling monitor election 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: monmap epoch 3 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:43.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: last_changed 2024-09-10T23:53:37.533358+0000 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: created 2024-09-10T23:51:48.824335+0000 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: min_mon_release 19 (squid) 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: election_strategy: 1 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: fsmap 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: mgrmap e13: x(active, since 51s) 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: overall HEALTH_OK 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:43.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:42 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:43.470 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T23:53:43.470 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T23:53:43.726 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:43.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:43 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:43.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:43 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/716992896' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:53:43.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:43 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:43 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:43.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:43 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:43.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:43 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/716992896' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:53:43.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:43 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:43.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:43 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:43 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:43 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/716992896' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:53:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:43 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:43 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.369 INFO:teuthology.orchestra.run.smithi019.stdout:# minimal ceph.conf for 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:44.369 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-10T23:53:44.369 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-10T23:53:44.369 INFO:teuthology.orchestra.run.smithi019.stdout: mon_host = [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-10T23:53:44.875 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:44.876 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:44 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3065735072' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:44.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:44.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:44.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:44.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:44.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T23:53:44.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:44.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:44.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:44 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3065735072' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:45.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:45.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:45.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:45.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:45.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T23:53:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:44 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3065735072' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:45.217 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T23:53:45.218 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:53:45.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:53:45.249 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:53:45.249 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:45.315 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:53:45.316 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:53:45.345 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:53:45.345 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:45.411 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:53:45.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:53:45.439 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:53:45.439 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:45.506 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-10T23:53:45.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-10T23:53:46.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:53:46.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:46.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:53:46.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:46.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:45 smithi019 ceph-mon[30859]: Reconfiguring daemon mon.a on smithi019 2024-09-10T23:53:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:53:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:46.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:53:46.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:46.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:45 smithi131 ceph-mon[35491]: Reconfiguring daemon mon.a on smithi019 2024-09-10T23:53:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:46.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:53:46.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:46.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:53:46.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:46.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:45 smithi135 ceph-mon[35432]: Reconfiguring daemon mon.a on smithi019 2024-09-10T23:53:46.192 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: Reconfiguring daemon mon.b on smithi131 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3473015544' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:53:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:47 smithi135 ceph-mon[35432]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.469 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ignoring --setuser ceph since I am not root 2024-09-10T23:53:47.469 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ignoring --setgroup ceph since I am not root 2024-09-10T23:53:47.469 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:47.469 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.469 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:53:47.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:47.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:53:47.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:47.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: Reconfiguring daemon mon.b on smithi131 2024-09-10T23:53:47.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3473015544' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:53:47.470 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:47 smithi019 ceph-mon[30859]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.544 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:53:47.544 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.544 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.544 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:53:47.544 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:53:47.544 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:53:47.545 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:47.545 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: Reconfiguring daemon mon.b on smithi131 2024-09-10T23:53:47.545 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3473015544' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:53:47.545 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:47 smithi131 ceph-mon[35491]: from='mgr.14150 172.21.15.19:0/3602108181' entity='mgr.x' 2024-09-10T23:53:47.792 INFO:tasks.cephadm:Adding mgr.x on smithi019 2024-09-10T23:53:47.792 INFO:tasks.cephadm:Adding mgr.y on smithi131 2024-09-10T23:53:47.792 INFO:tasks.cephadm:Adding mgr.z on smithi135 2024-09-10T23:53:47.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi019=x;smithi131=y;smithi135=z' 2024-09-10T23:53:48.032 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:53:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:48 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3473015544' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:53:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:48 smithi135 ceph-mon[35432]: mgrmap e14: x(active, since 55s) 2024-09-10T23:53:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:48 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3473015544' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:53:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:48 smithi019 ceph-mon[30859]: mgrmap e14: x(active, since 55s) 2024-09-10T23:53:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:48 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3473015544' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:53:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:48 smithi131 ceph-mon[35491]: mgrmap e14: x(active, since 55s) 2024-09-10T23:53:52.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: Active manager daemon x restarted 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: Activating manager daemon x 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: mgrmap e15: x(active, starting, since 0.00684303s) 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:53:52.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:52 smithi019 ceph-mon[30859]: Manager daemon x is now available 2024-09-10T23:53:52.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: Active manager daemon x restarted 2024-09-10T23:53:52.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: Activating manager daemon x 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: mgrmap e15: x(active, starting, since 0.00684303s) 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:53:52.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:52 smithi131 ceph-mon[35491]: Manager daemon x is now available 2024-09-10T23:53:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: Active manager daemon x restarted 2024-09-10T23:53:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: Activating manager daemon x 2024-09-10T23:53:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: mgrmap e15: x(active, starting, since 0.00684303s) 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:53:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:52 smithi135 ceph-mon[35432]: Manager daemon x is now available 2024-09-10T23:53:53.452 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mgr update... 2024-09-10T23:53:53.700 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:53.700 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:53:53.700 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:53:53.700 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:53 smithi131 ceph-mon[35491]: mgrmap e16: x(active, since 1.00913s) 2024-09-10T23:53:53.700 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:53.749 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:53.749 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:53:53.749 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:53:53.750 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:53 smithi135 ceph-mon[35432]: mgrmap e16: x(active, since 1.00913s) 2024-09-10T23:53:53.750 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:53:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:53:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:53 smithi019 ceph-mon[30859]: mgrmap e16: x(active, since 1.00913s) 2024-09-10T23:53:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:54.061 DEBUG:teuthology.orchestra.run.smithi131:mgr.y> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T23:53:54.064 DEBUG:teuthology.orchestra.run.smithi135:mgr.z> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T23:53:54.066 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T23:53:54.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T23:53:54.069 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T23:53:54.069 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T23:53:54.112 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T23:53:54.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T23:53:54.155 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:53:54.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T23:53:54.198 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:53:54.198 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T23:53:54.241 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T23:53:54.241 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T23:53:54.284 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:53:54.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T23:53:54.330 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T23:53:54.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T23:53:54.373 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T23:53:54.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-10T23:53:54.116+0000 7f13986fe640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:53:54] ENGINE Error in HTTPServer.serve 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: Traceback (most recent call last): 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._connections.run(self.expiration_interval) 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._run(expiration_interval) 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:53:54.375 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: s = self.context.wrap_socket( 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: return self.sslsocket_class._create( 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self.do_handshake() 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: self._sslobj.do_handshake() 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:53:54.376 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 23:53:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-10T23:53:54.412 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:54.414 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T23:53:54.414 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T23:53:54.459 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T23:53:54.459 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T23:53:54.469 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:54.471 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T23:53:54.471 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T23:53:54.516 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T23:53:54.516 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T23:53:54.560 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:53:54.560 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T23:53:54.603 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:53:54.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T23:53:54.647 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T23:53:54.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T23:53:54.701 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:53:54.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T23:53:54.770 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:53:54.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:53:54.833 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:53:54.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:53:54.887 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-10T23:53:54.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-09-10T23:53:54.946 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-10T23:53:54.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-10T23:53:55.007 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-10T23:53:55.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-10T23:53:55.055 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-10T23:53:55.055 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-10T23:53:55.098 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:53:55.099 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T23:53:55.154 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:53:55.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:53:55.209 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:53:55.209 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T23:53:55.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: Saving service mgr spec with placement smithi019=x;smithi131=y;smithi135=z;count:3 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: [10/Sep/2024:23:53:53] ENGINE Bus STARTING 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: [10/Sep/2024:23:53:54] ENGINE Serving on https://172.21.15.19:7150 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: [10/Sep/2024:23:53:54] ENGINE Error in HTTPServer.serve 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: Traceback (most recent call last): 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._run(expiration_interval) 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:53:55.228 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: s = self.context.wrap_socket( 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: return self.sslsocket_class._create( 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: self.do_handshake() 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._sslobj.do_handshake() 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:53:55.229 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:55.245 DEBUG:tasks.cephadm:set 26 configs 2024-09-10T23:53:55.245 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi019') 2024-09-10T23:53:55.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: Saving service mgr spec with placement smithi019=x;smithi131=y;smithi135=z;count:3 2024-09-10T23:53:55.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: [10/Sep/2024:23:53:53] ENGINE Bus STARTING 2024-09-10T23:53:55.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: [10/Sep/2024:23:53:54] ENGINE Serving on https://172.21.15.19:7150 2024-09-10T23:53:55.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: [10/Sep/2024:23:53:54] ENGINE Error in HTTPServer.serve 2024-09-10T23:53:55.426 INFO:journalctl@ceph.mon.c.smithi135.stdout: Traceback (most recent call last): 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: self._run(expiration_interval) 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: s = self.context.wrap_socket( 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: return self.sslsocket_class._create( 2024-09-10T23:53:55.427 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout: self.do_handshake() 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout: self._sslobj.do_handshake() 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:55.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: Saving service mgr spec with placement smithi019=x;smithi131=y;smithi135=z;count:3 2024-09-10T23:53:55.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: [10/Sep/2024:23:53:53] ENGINE Bus STARTING 2024-09-10T23:53:55.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: [10/Sep/2024:23:53:54] ENGINE Serving on https://172.21.15.19:7150 2024-09-10T23:53:55.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: [10/Sep/2024:23:53:54] ENGINE Error in HTTPServer.serve 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: Traceback (most recent call last): 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: self._run(expiration_interval) 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: s = self.context.wrap_socket( 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi131.stdout: return self.sslsocket_class._create( 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout: self.do_handshake() 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout: self._sslobj.do_handshake() 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:55.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: [10/Sep/2024:23:53:54] ENGINE Serving on http://172.21.15.19:8765 2024-09-10T23:53:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: [10/Sep/2024:23:53:54] ENGINE Bus STARTED 2024-09-10T23:53:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: mgrmap e17: x(active, since 2s) 2024-09-10T23:53:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2990563301' entity='client.admin' 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3108134634' entity='client.admin' 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi019", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:56.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: [10/Sep/2024:23:53:54] ENGINE Serving on http://172.21.15.19:8765 2024-09-10T23:53:56.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: [10/Sep/2024:23:53:54] ENGINE Bus STARTED 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: mgrmap e17: x(active, since 2s) 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2990563301' entity='client.admin' 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3108134634' entity='client.admin' 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi019", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:56.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: [10/Sep/2024:23:53:54] ENGINE Serving on http://172.21.15.19:8765 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: [10/Sep/2024:23:53:54] ENGINE Bus STARTED 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: mgrmap e17: x(active, since 2s) 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2990563301' entity='client.admin' 2024-09-10T23:53:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3108134634' entity='client.admin' 2024-09-10T23:53:56.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:56.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi019", "name": "osd_memory_target"} : dispatch 2024-09-10T23:53:56.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:56.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:57.403 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T23:53:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:53:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:53:57.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:53:57.442 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:57.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi019') 2024-09-10T23:53:57.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi019') 2024-09-10T23:53:57.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T23:53:57.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:53:57.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi019:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: Deploying daemon mgr.z on smithi135 2024-09-10T23:53:58.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:53:58 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2116732707' entity='client.admin' 2024-09-10T23:53:58.480 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi019:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: Deploying daemon mgr.z on smithi135 2024-09-10T23:53:58.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:53:58 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2116732707' entity='client.admin' 2024-09-10T23:53:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:53:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi019:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:58.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Updating smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:53:58.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: Deploying daemon mgr.z on smithi135 2024-09-10T23:53:58.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:53:58 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2116732707' entity='client.admin' 2024-09-10T23:53:58.830 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:58 smithi135 systemd[1]: Starting Ceph mgr.z for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:53:59.175 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:59 smithi135 podman[38059]: 2024-09-10 23:53:58.94374235 +0000 UTC m=+0.015718721 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:53:59.175 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:59 smithi135 podman[38059]: 2024-09-10 23:53:59.070401558 +0000 UTC m=+0.142377959 container create 391ca49c29deb8931f0a590327fc26d5e69fd2efff485b94fa92769f9a47dee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-z, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:53:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 -- 172.21.15.19:0/2860841300 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab0003f560 msgr2=0x7fab00041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 --2- 172.21.15.19:0/2860841300 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab0003f560 0x7fab00041a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fab14107510 tx=0x7fab04005d30 comp rx=0 tx=0).stop 2024-09-10T23:53:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 -- 172.21.15.19:0/2860841300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab14102dc0 msgr2=0x7fab14199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 --2- 172.21.15.19:0/2860841300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab14102dc0 0x7fab14199020 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab1000eab0 tx=0x7fab1000ef70 comp rx=0 tx=0).stop 2024-09-10T23:53:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 -- 172.21.15.19:0/2860841300 shutdown_connections 2024-09-10T23:53:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 --2- 172.21.15.19:0/2860841300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab14109150 0x7fab1419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 --2- 172.21.15.19:0/2860841300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab141087d0 0x7fab14199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 --2- 172.21.15.19:0/2860841300 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab0003f560 0x7fab00041a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 --2- 172.21.15.19:0/2860841300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab14102dc0 0x7fab14199020 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 -- 172.21.15.19:0/2860841300 >> 172.21.15.19:0/2860841300 conn(0x7fab140fe830 msgr2=0x7fab14100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 -- 172.21.15.19:0/2860841300 shutdown_connections 2024-09-10T23:53:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:53:59.279+0000 7fab1ba06640 1 -- 172.21.15.19:0/2860841300 wait complete. 2024-09-10T23:53:59.675 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:59 smithi135 podman[38059]: 2024-09-10 23:53:59.297809578 +0000 UTC m=+0.369785936 container init 391ca49c29deb8931f0a590327fc26d5e69fd2efff485b94fa92769f9a47dee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:53:59.675 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:59 smithi135 podman[38059]: 2024-09-10 23:53:59.300662881 +0000 UTC m=+0.372639240 container start 391ca49c29deb8931f0a590327fc26d5e69fd2efff485b94fa92769f9a47dee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T23:53:59.675 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:59 smithi135 ceph-mgr[38078]: -- 172.21.15.135:0/668433569 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5582dcf910e0 con 0x5582dcf6f000 2024-09-10T23:53:59.675 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:59 smithi135 bash[38059]: 391ca49c29deb8931f0a590327fc26d5e69fd2efff485b94fa92769f9a47dee7 2024-09-10T23:53:59.676 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 10 23:53:59 smithi135 systemd[1]: Started Ceph mgr.z for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:54:00.057 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.057 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.065 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.065 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.065 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.068 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.072 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.092 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.092 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.097 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T23:54:00.105 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.105 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.114 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.116 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:00.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2860841300' entity='client.admin' 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:00 smithi019 ceph-mon[30859]: Deploying daemon mgr.y on smithi131 2024-09-10T23:54:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2860841300' entity='client.admin' 2024-09-10T23:54:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:00 smithi131 ceph-mon[35491]: Deploying daemon mgr.y on smithi131 2024-09-10T23:54:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2860841300' entity='client.admin' 2024-09-10T23:54:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:00.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:54:00.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:54:00.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:54:00.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:00.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:00 smithi135 ceph-mon[35432]: Deploying daemon mgr.y on smithi131 2024-09-10T23:54:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.047+0000 7f4f390e5640 1 -- 172.21.15.19:0/3180796435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f341045c0 msgr2=0x7f4f3410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.047+0000 7f4f390e5640 1 --2- 172.21.15.19:0/3180796435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f341045c0 0x7f4f3410cab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009900 tx=0x7f4f1c02a410 comp rx=0 tx=0).stop 2024-09-10T23:54:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 -- 172.21.15.19:0/3180796435 shutdown_connections 2024-09-10T23:54:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 --2- 172.21.15.19:0/3180796435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f3410d100 0x7f4f3410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 --2- 172.21.15.19:0/3180796435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f341045c0 0x7f4f3410cab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 --2- 172.21.15.19:0/3180796435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f34103ca0 0x7f4f34104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 -- 172.21.15.19:0/3180796435 >> 172.21.15.19:0/3180796435 conn(0x7f4f340fd700 msgr2=0x7f4f340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 -- 172.21.15.19:0/3180796435 shutdown_connections 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 -- 172.21.15.19:0/3180796435 wait complete. 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.048+0000 7f4f390e5640 1 Processor -- start 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f390e5640 1 -- start start 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f390e5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f34103ca0 0x7f4f34101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f390e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f341045c0 0x7f4f34101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f390e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f3410d100 0x7f4f341023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f390e5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34112b80 con 0x7f4f3410d100 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f390e5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34112a00 con 0x7f4f34103ca0 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f390e5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34112d00 con 0x7f4f341045c0 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f3410d100 0x7f4f341023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f3410d100 0x7f4f341023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52148/0 (socket says 172.21.15.19:52148) 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f341045c0 0x7f4f34101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 -- 172.21.15.19:0/2228495755 learned_addr learned my addr 172.21.15.19:0/2228495755 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f32d9d640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f34103ca0 0x7f4f34101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 -- 172.21.15.19:0/2228495755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f341045c0 msgr2=0x7f4f34101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f341045c0 0x7f4f34101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 -- 172.21.15.19:0/2228495755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f34103ca0 msgr2=0x7f4f34101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f34103ca0 0x7f4f34101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 -- 172.21.15.19:0/2228495755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f341a7530 con 0x7f4f3410d100 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f32d9d640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f34103ca0 0x7f4f34101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.049+0000 7f4f3359e640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f3410d100 0x7f4f341023d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00eb10 tx=0x7f4f2c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.050+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c004b20 con 0x7f4f3410d100 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.050+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f341a7820 con 0x7f4f3410d100 2024-09-10T23:54:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.050+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f4f2c004cc0 con 0x7f4f3410d100 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.050+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c010690 con 0x7f4f3410d100 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.050+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f341a7d30 con 0x7f4f3410d100 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.051+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f4f2c010830 con 0x7f4f3410d100 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.051+0000 7f4f2bfff640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4f2003f560 0x7f4f20041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.051+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4f2c0543c0 con 0x7f4f3410d100 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.051+0000 7f4f32d9d640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4f2003f560 0x7f4f20041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.051+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f3406b1b0 con 0x7f4f3410d100 2024-09-10T23:54:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.051+0000 7f4f32d9d640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4f2003f560 0x7f4f20041a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f24005d00 tx=0x7f4f24005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.056+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4f2c0059f0 con 0x7f4f3410d100 2024-09-10T23:54:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 -- 172.21.15.19:0/2745484981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff16410d140 msgr2=0x7ff16410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/2745484981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff16410d140 0x7ff16410f5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009ca0 tx=0x7ff15c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 -- 172.21.15.19:0/2745484981 shutdown_connections 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/2745484981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff16410d140 0x7ff16410f5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/2745484981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff164104600 0x7ff16410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/2745484981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff164103ce0 0x7ff1641040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 -- 172.21.15.19:0/2745484981 >> 172.21.15.19:0/2745484981 conn(0x7ff1640fd700 msgr2=0x7ff1640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 -- 172.21.15.19:0/2745484981 shutdown_connections 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.962+0000 7ff16b5c0640 1 -- 172.21.15.19:0/2745484981 wait complete. 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.963+0000 7ff16b5c0640 1 Processor -- start 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.963+0000 7ff16b5c0640 1 -- start start 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff16b5c0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff164103ce0 0x7ff164101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff16b5c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff164104600 0x7ff164101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff16b5c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff16410d140 0x7ff164102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff16b5c0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff164112b20 con 0x7ff164104600 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff16b5c0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff1641129a0 con 0x7ff164103ce0 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff16b5c0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff164112ca0 con 0x7ff16410d140 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff164104600 0x7ff164101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff164104600 0x7ff164101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52136/0 (socket says 172.21.15.19:52136) 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 -- 172.21.15.19:0/775010587 learned_addr learned my addr 172.21.15.19:0/775010587 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff16935c640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff164103ce0 0x7ff164101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff169b5d640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff16410d140 0x7ff164102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 -- 172.21.15.19:0/775010587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff16410d140 msgr2=0x7ff164102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff16410d140 0x7ff164102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 -- 172.21.15.19:0/775010587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff164103ce0 msgr2=0x7ff164101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff164103ce0 0x7ff164101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 -- 172.21.15.19:0/775010587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1641a74b0 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.964+0000 7ff168b5b640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff164104600 0x7ff164101ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c970 tx=0x7ff15800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.965+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff158007bb0 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.965+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7ff158007d50 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.965+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1641a77a0 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.965+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15800f6b0 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.965+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1641a7d30 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.966+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7ff15800f850 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.966+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1641040c0 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.966+0000 7ff1627fc640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff14c03f560 0x7ff14c041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.966+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff1580540c0 con 0x7ff164104600 2024-09-10T23:54:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.966+0000 7ff16935c640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff14c03f560 0x7ff14c041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.967+0000 7ff16935c640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff14c03f560 0x7ff14c041a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff154005d00 tx=0x7ff15400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:00.971+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff15800fb70 con 0x7ff164104600 2024-09-10T23:54:01.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.159+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7ff164108120 con 0x7ff164104600 2024-09-10T23:54:01.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.163+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7ff15800de00 con 0x7ff164104600 2024-09-10T23:54:01.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.163+0000 7ff1627fc640 1 -- 172.21.15.19:0/775010587 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff15800fda0 con 0x7ff164104600 2024-09-10T23:54:01.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.164+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4f2c01f6e0 con 0x7f4f3410d100 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff14c03f560 msgr2=0x7ff14c041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff14c03f560 0x7ff14c041a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff154005d00 tx=0x7ff15400b410 comp rx=0 tx=0).stop 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff164104600 msgr2=0x7ff164101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff164104600 0x7ff164101ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c970 tx=0x7ff15800ce30 comp rx=0 tx=0).stop 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 shutdown_connections 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff16410d140 0x7ff164102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff14c03f560 0x7ff14c041a20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff164104600 0x7ff164101ed0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 --2- 172.21.15.19:0/775010587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff164103ce0 0x7ff164101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 >> 172.21.15.19:0/775010587 conn(0x7ff1640fd700 msgr2=0x7ff1640fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 shutdown_connections 2024-09-10T23:54:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.165+0000 7ff16b5c0640 1 -- 172.21.15.19:0/775010587 wait complete. 2024-09-10T23:54:01.252 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 systemd[1]: Starting Ceph mgr.y for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:54:01.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.253+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f4f34108140 con 0x7f4f3410d100 2024-09-10T23:54:01.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.258+0000 7f4f2bfff640 1 -- 172.21.15.19:0/2228495755 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v15)=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f4f2c019d50 con 0x7f4f3410d100 2024-09-10T23:54:01.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4f2003f560 msgr2=0x7f4f20041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4f2003f560 0x7f4f20041a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f24005d00 tx=0x7f4f24005c70 comp rx=0 tx=0).stop 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f3410d100 msgr2=0x7f4f341023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f3410d100 0x7f4f341023d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00eb10 tx=0x7f4f2c00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 shutdown_connections 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4f2003f560 0x7f4f20041a20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f3410d100 0x7f4f341023d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f341045c0 0x7f4f34101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 --2- 172.21.15.19:0/2228495755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f34103ca0 0x7f4f34101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 >> 172.21.15.19:0/2228495755 conn(0x7f4f340fd700 msgr2=0x7f4f340fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 shutdown_connections 2024-09-10T23:54:01.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.260+0000 7f4f390e5640 1 -- 172.21.15.19:0/2228495755 wait complete. 2024-09-10T23:54:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 -- 172.21.15.19:0/4293111252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa990102dc0 msgr2=0x7fa9901031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 --2- 172.21.15.19:0/4293111252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa990102dc0 0x7fa9901031a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa980009900 tx=0x7fa98002a410 comp rx=0 tx=0).stop 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 -- 172.21.15.19:0/4293111252 shutdown_connections 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 --2- 172.21.15.19:0/4293111252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990109150 0x7fa99010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 --2- 172.21.15.19:0/4293111252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9901087d0 0x7fa990108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 --2- 172.21.15.19:0/4293111252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa990102dc0 0x7fa9901031a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 -- 172.21.15.19:0/4293111252 >> 172.21.15.19:0/4293111252 conn(0x7fa9900fe830 msgr2=0x7fa990100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 -- 172.21.15.19:0/4293111252 shutdown_connections 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 -- 172.21.15.19:0/4293111252 wait complete. 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 Processor -- start 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.334+0000 7fa996573640 1 -- start start 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa996573640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990102dc0 0x7fa9901991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa996573640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9901087d0 0x7fa990199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa996573640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa990109150 0x7fa99019eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa996573640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa990112d00 con 0x7fa9901087d0 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa996573640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa990112b80 con 0x7fa990109150 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa996573640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa990112e80 con 0x7fa990102dc0 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9901087d0 0x7fa990199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9901087d0 0x7fa990199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52158/0 (socket says 172.21.15.19:52158) 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 -- 172.21.15.19:0/3215524411 learned_addr learned my addr 172.21.15.19:0/3215524411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa98ffff640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990102dc0 0x7fa9901991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa994b10640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa990109150 0x7fa99019eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 -- 172.21.15.19:0/3215524411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990102dc0 msgr2=0x7fa9901991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990102dc0 0x7fa9901991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 -- 172.21.15.19:0/3215524411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa990109150 msgr2=0x7fa99019eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa990109150 0x7fa99019eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 -- 172.21.15.19:0/3215524411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99019f280 con 0x7fa9901087d0 2024-09-10T23:54:01.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa994b10640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa990109150 0x7fa99019eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa987fff640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9901087d0 0x7fa990199710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa97800d950 tx=0x7fa97800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978017030 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa978004020 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99019f570 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.335+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9780055e0 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.336+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9901a5c30 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.336+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7fa978009a30 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.336+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9901031a0 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.337+0000 7fa98dffb640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa97c03f560 0x7fa97c041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.337+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa978053830 con 0x7fa9901087d0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.337+0000 7fa98ffff640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa97c03f560 0x7fa97c041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.337+0000 7fa98ffff640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa97c03f560 0x7fa97c041a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa980000c00 tx=0x7fa980005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.341+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa9780041d0 con 0x7fa9901087d0 2024-09-10T23:54:01.527 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 podman[37795]: 2024-09-10 23:54:01.152485856 +0000 UTC m=+0.015540935 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:54:01.528 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 podman[37795]: 2024-09-10 23:54:01.266405414 +0000 UTC m=+0.129460487 container create 1bac838ac984d0b1c7e424f177d88eedf1366fc4895bd89c6928e8737ffc1226 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T23:54:01.528 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 podman[37795]: 2024-09-10 23:54:01.451974402 +0000 UTC m=+0.315029476 container init 1bac838ac984d0b1c7e424f177d88eedf1366fc4895bd89c6928e8737ffc1226 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T23:54:01.528 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 podman[37795]: 2024-09-10 23:54:01.454712426 +0000 UTC m=+0.317767499 container start 1bac838ac984d0b1c7e424f177d88eedf1366fc4895bd89c6928e8737ffc1226 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T23:54:01.528 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 ceph-mgr[37814]: -- 172.21.15.131:0/2768667007 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55556236b0e0 con 0x555562349400 2024-09-10T23:54:01.528 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 bash[37795]: 1bac838ac984d0b1c7e424f177d88eedf1366fc4895bd89c6928e8737ffc1226 2024-09-10T23:54:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.531+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa99002e5c0 con 0x7fa9901087d0 2024-09-10T23:54:01.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.536+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7fa97801bcc0 con 0x7fa9901087d0 2024-09-10T23:54:01.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.537+0000 7fa98dffb640 1 -- 172.21.15.19:0/3215524411 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa97801ab00 con 0x7fa9901087d0 2024-09-10T23:54:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.538+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa97c03f560 msgr2=0x7fa97c041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.538+0000 7fa996573640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa97c03f560 0x7fa97c041a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa980000c00 tx=0x7fa980005e80 comp rx=0 tx=0).stop 2024-09-10T23:54:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.538+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9901087d0 msgr2=0x7fa990199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.538+0000 7fa996573640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9901087d0 0x7fa990199710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa97800d950 tx=0x7fa97800de10 comp rx=0 tx=0).stop 2024-09-10T23:54:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 shutdown_connections 2024-09-10T23:54:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa990109150 0x7fa99019eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa97c03f560 0x7fa97c041a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9901087d0 0x7fa990199710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 --2- 172.21.15.19:0/3215524411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990102dc0 0x7fa9901991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 >> 172.21.15.19:0/3215524411 conn(0x7fa9900fe830 msgr2=0x7fa990100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:01.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 shutdown_connections 2024-09-10T23:54:01.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:01.539+0000 7fa996573640 1 -- 172.21.15.19:0/3215524411 wait complete. 2024-09-10T23:54:01.800 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 10 23:54:01 smithi131 systemd[1]: Started Ceph mgr.y for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:54:02.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/775010587' entity='client.admin' 2024-09-10T23:54:02.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2228495755' entity='client.admin' 2024-09-10T23:54:02.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3215524411' entity='client.admin' 2024-09-10T23:54:02.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:02.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/775010587' entity='client.admin' 2024-09-10T23:54:02.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2228495755' entity='client.admin' 2024-09-10T23:54:02.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3215524411' entity='client.admin' 2024-09-10T23:54:02.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.430 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/775010587' entity='client.admin' 2024-09-10T23:54:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2228495755' entity='client.admin' 2024-09-10T23:54:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3215524411' entity='client.admin' 2024-09-10T23:54:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:03.894 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:03.895 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: Reconfiguring daemon mgr.x on smithi019 2024-09-10T23:54:03.896 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:03 smithi019 ceph-mon[30859]: from='client.? ' entity='client.admin' 2024-09-10T23:54:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: Reconfiguring daemon mgr.x on smithi019 2024-09-10T23:54:03.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:03 smithi135 ceph-mon[35432]: from='client.? ' entity='client.admin' 2024-09-10T23:54:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: Reconfiguring daemon mgr.x on smithi019 2024-09-10T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:03 smithi131 ceph-mon[35491]: from='client.? ' entity='client.admin' 2024-09-10T23:54:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:04 smithi019 ceph-mon[30859]: Standby manager daemon z started 2024-09-10T23:54:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:04 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:54:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:04 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:54:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:04 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:54:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:04 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:54:04.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:04 smithi135 ceph-mon[35432]: Standby manager daemon z started 2024-09-10T23:54:04.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:04 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:54:04.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:04 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:54:04.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:04 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:54:04.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:04 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:54:05.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:04 smithi131 ceph-mon[35491]: Standby manager daemon z started 2024-09-10T23:54:05.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:04 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:54:05.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:04 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:54:05.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:04 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:54:05.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:04 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.135:0/3777445933' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.147+0000 7fd5bb190640 1 -- 172.21.15.19:0/2495756171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4109130 msgr2=0x7fd5b410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.147+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2495756171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4109130 0x7fd5b410f930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009ca0 tx=0x7fd5ac02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.147+0000 7fd5bb190640 1 -- 172.21.15.19:0/2495756171 shutdown_connections 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.147+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2495756171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4109130 0x7fd5b410f930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.147+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2495756171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b41087b0 0x7fd5b4108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.147+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2495756171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b4102da0 0x7fd5b4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.148+0000 7fd5bb190640 1 -- 172.21.15.19:0/2495756171 >> 172.21.15.19:0/2495756171 conn(0x7fd5b40fe810 msgr2=0x7fd5b4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.148+0000 7fd5bb190640 1 -- 172.21.15.19:0/2495756171 shutdown_connections 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.148+0000 7fd5bb190640 1 -- 172.21.15.19:0/2495756171 wait complete. 2024-09-10T23:54:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.148+0000 7fd5bb190640 1 Processor -- start 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.148+0000 7fd5bb190640 1 -- start start 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5bb190640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b4102da0 0x7fd5b40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5bb190640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b41087b0 0x7fd5b40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5bb190640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b4109130 0x7fd5b4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5bb190640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4112df0 con 0x7fd5b41087b0 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5bb190640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4112c70 con 0x7fd5b4109130 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5bb190640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4112f70 con 0x7fd5b4102da0 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b41087b0 0x7fd5b40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b41087b0 0x7fd5b40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40286/0 (socket says 172.21.15.19:40286) 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 -- 172.21.15.19:0/2523433976 learned_addr learned my addr 172.21.15.19:0/2523433976 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b8f2c640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b4102da0 0x7fd5b40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b972d640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b4109130 0x7fd5b4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 -- 172.21.15.19:0/2523433976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b4102da0 msgr2=0x7fd5b40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b4102da0 0x7fd5b40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 -- 172.21.15.19:0/2523433976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b4109130 msgr2=0x7fd5b4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b4109130 0x7fd5b4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 -- 172.21.15.19:0/2523433976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b41a7640 con 0x7fd5b41087b0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.149+0000 7fd5b3fff640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b41087b0 0x7fd5b40759e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800d950 tx=0x7fd5a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.150+0000 7fd5b1ffb640 1 -- 172.21.15.19:0/2523433976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8017030 con 0x7fd5b41087b0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.150+0000 7fd5b1ffb640 1 -- 172.21.15.19:0/2523433976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5a8004020 con 0x7fd5b41087b0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.150+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b41a7930 con 0x7fd5b41087b0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.150+0000 7fd5b1ffb640 1 -- 172.21.15.19:0/2523433976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8003c50 con 0x7fd5b41087b0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.150+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b41a7ec0 con 0x7fd5b41087b0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.151+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b4103180 con 0x7fd5b41087b0 2024-09-10T23:54:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.152+0000 7fd5b1ffb640 1 -- 172.21.15.19:0/2523433976 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7fd5a8024060 con 0x7fd5b41087b0 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.152+0000 7fd5b1ffb640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd59c07a400 0x7fd59c07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.152+0000 7fd5b1ffb640 1 -- 172.21.15.19:0/2523433976 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd5a809b990 con 0x7fd5b41087b0 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.152+0000 7fd5b8f2c640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd59c07a400 0x7fd59c07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.153+0000 7fd5b8f2c640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd59c07a400 0x7fd59c07c8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009bd0 tx=0x7fd5a4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.157+0000 7fd5b1ffb640 1 -- 172.21.15.19:0/2523433976 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd5a80645f0 con 0x7fd5b41087b0 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.346+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd5b402e5c0 con 0x7fd5b41087b0 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.351+0000 7fd5b1ffb640 1 -- 172.21.15.19:0/2523433976 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fd5a8063ef0 con 0x7fd5b41087b0 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd59c07a400 msgr2=0x7fd59c07c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd59c07a400 0x7fd59c07c8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009bd0 tx=0x7fd5a4005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b41087b0 msgr2=0x7fd5b40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b41087b0 0x7fd5b40759e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800d950 tx=0x7fd5a800de10 comp rx=0 tx=0).stop 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 shutdown_connections 2024-09-10T23:54:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b4109130 0x7fd5b4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd59c07a400 0x7fd59c07c8c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b41087b0 0x7fd5b40759e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 --2- 172.21.15.19:0/2523433976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b4102da0 0x7fd5b40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 >> 172.21.15.19:0/2523433976 conn(0x7fd5b40fe810 msgr2=0x7fd5b4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 shutdown_connections 2024-09-10T23:54:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.353+0000 7fd5bb190640 1 -- 172.21.15.19:0/2523433976 wait complete. 2024-09-10T23:54:05.752 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:05 smithi019 ceph-mon[30859]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-10T23:54:05.752 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:54:05.752 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:05 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2523433976' entity='client.admin' 2024-09-10T23:54:05.752 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:05 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2620189514' entity='client.admin' 2024-09-10T23:54:05.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/3098269934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 msgr2=0x7fb3e810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/3098269934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e810f5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009ca0 tx=0x7fb3e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/3098269934 shutdown_connections 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/3098269934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e810f5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/3098269934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3e8104600 0x7fb3e810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/3098269934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e8103ce0 0x7fb3e81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/3098269934 >> 172.21.15.19:0/3098269934 conn(0x7fb3e80fd700 msgr2=0x7fb3e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/3098269934 shutdown_connections 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.835+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/3098269934 wait complete. 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 Processor -- start 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 -- start start 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3e8103ce0 0x7fb3e8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e8104600 0x7fb3e8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8112e00 con 0x7fb3e810d140 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8112c80 con 0x7fb3e8103ce0 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3ed3b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8112f80 con 0x7fb3e8104600 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3e6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3e8103ce0 0x7fb3e8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e819eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40312/0 (socket says 172.21.15.19:40312) 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3e77fe640 1 -- 172.21.15.19:0/639435684 learned_addr learned my addr 172.21.15.19:0/639435684 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3e67fc640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e8104600 0x7fb3e8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.836+0000 7fb3e77fe640 1 -- 172.21.15.19:0/639435684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e8104600 msgr2=0x7fb3e8199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e8104600 0x7fb3e8199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3e77fe640 1 -- 172.21.15.19:0/639435684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3e8103ce0 msgr2=0x7fb3e8199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3e8103ce0 0x7fb3e8199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3e77fe640 1 -- 172.21.15.19:0/639435684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e819f300 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3e8103ce0 0x7fb3e8199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3e77fe640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e819eb30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009430 tx=0x7fb3e00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3cffff640 1 -- 172.21.15.19:0/639435684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0003c30 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e819f590 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3cffff640 1 -- 172.21.15.19:0/639435684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e0003dd0 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3cffff640 1 -- 172.21.15.19:0/639435684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e002faa0 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.837+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e81a5cb0 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.838+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e81040c0 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.839+0000 7fb3cffff640 1 -- 172.21.15.19:0/639435684 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7fb3e002fc40 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.839+0000 7fb3cffff640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3d007a400 0x7fb3d007c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.839+0000 7fb3cffff640 1 -- 172.21.15.19:0/639435684 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb3e00bd1b0 con 0x7fb3e810d140 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.839+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3d007a400 0x7fb3d007c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.840+0000 7fb3e6ffd640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3d007a400 0x7fb3d007c8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bfd0 tx=0x7fb3d800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:05.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.844+0000 7fb3cffff640 1 -- 172.21.15.19:0/639435684 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3e0085850 con 0x7fb3e810d140 2024-09-10T23:54:05.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:05 smithi135 ceph-mon[35432]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-10T23:54:05.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:54:05.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:05 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2523433976' entity='client.admin' 2024-09-10T23:54:05.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:05 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2620189514' entity='client.admin' 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3478185537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca01076a0 msgr2=0x7f1ca0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3478185537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca01076a0 0x7f1ca0107ae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009900 tx=0x7f1c8802a410 comp rx=0 tx=0).stop 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3478185537 shutdown_connections 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3478185537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca0108020 0x7f1ca010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3478185537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca01076a0 0x7f1ca0107ae0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3478185537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ca0101c90 0x7f1ca0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3478185537 >> 172.21.15.19:0/3478185537 conn(0x7f1ca00fd700 msgr2=0x7f1ca00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:06.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3478185537 shutdown_connections 2024-09-10T23:54:06.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.028+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3478185537 wait complete. 2024-09-10T23:54:06.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.029+0000 7f1ca49ba640 1 Processor -- start 2024-09-10T23:54:06.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.029+0000 7f1ca49ba640 1 -- start start 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1ca49ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0101c90 0x7f1ca01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1ca49ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca01076a0 0x7f1ca0199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1ca49ba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ca0108020 0x7f1ca019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1ca49ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0111cc0 con 0x7f1ca0101c90 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1ca49ba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0111b40 con 0x7f1ca0108020 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1ca49ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0111e40 con 0x7f1ca01076a0 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0101c90 0x7f1ca01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0101c90 0x7f1ca01992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40326/0 (socket says 172.21.15.19:40326) 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 -- 172.21.15.19:0/3876976208 learned_addr learned my addr 172.21.15.19:0/3876976208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c97fff640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca01076a0 0x7f1ca0199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9ed9d640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ca0108020 0x7f1ca019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:06.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 -- 172.21.15.19:0/3876976208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca01076a0 msgr2=0x7f1ca0199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca01076a0 0x7f1ca0199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 -- 172.21.15.19:0/3876976208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ca0108020 msgr2=0x7f1ca019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ca0108020 0x7f1ca019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 -- 172.21.15.19:0/3876976208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca019f370 con 0x7f1ca0101c90 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9ed9d640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ca0108020 0x7f1ca019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.030+0000 7f1c9e59c640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0101c90 0x7f1ca01992c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000e9f0 tx=0x7f1c9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.031+0000 7f1c977fe640 1 -- 172.21.15.19:0/3876976208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000cd80 con 0x7f1ca0101c90 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.031+0000 7f1c977fe640 1 -- 172.21.15.19:0/3876976208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c900108e0 con 0x7f1ca0101c90 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.031+0000 7f1c977fe640 1 -- 172.21.15.19:0/3876976208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90018980 con 0x7f1ca0101c90 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.031+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca019f660 con 0x7f1ca0101c90 2024-09-10T23:54:06.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.031+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca00fdae0 con 0x7f1ca0101c90 2024-09-10T23:54:06.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.032+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca0102070 con 0x7f1ca0101c90 2024-09-10T23:54:06.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.033+0000 7f1c977fe640 1 -- 172.21.15.19:0/3876976208 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f1c90010430 con 0x7f1ca0101c90 2024-09-10T23:54:06.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.033+0000 7f1c977fe640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1c8c07a400 0x7f1c8c07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:06.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.033+0000 7f1c977fe640 1 -- 172.21.15.19:0/3876976208 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1c9009c1c0 con 0x7f1ca0101c90 2024-09-10T23:54:06.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.033+0000 7f1c97fff640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1c8c07a400 0x7f1c8c07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:06.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.034+0000 7f1c97fff640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1c8c07a400 0x7f1c8c07c8c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005ab0 tx=0x7f1c88005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:06.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.036+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fb3e81a5fa0 con 0x7fb3e810d140 2024-09-10T23:54:06.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.038+0000 7f1c977fe640 1 -- 172.21.15.19:0/3876976208 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1c90064890 con 0x7f1ca0101c90 2024-09-10T23:54:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.042+0000 7fb3cffff640 1 -- 172.21.15.19:0/639435684 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7fb3e008a280 con 0x7fb3e810d140 2024-09-10T23:54:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3d007a400 msgr2=0x7fb3d007c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3d007a400 0x7fb3d007c8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bfd0 tx=0x7fb3d800b390 comp rx=0 tx=0).stop 2024-09-10T23:54:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 msgr2=0x7fb3e819eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e819eb30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009430 tx=0x7fb3e00319f0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 shutdown_connections 2024-09-10T23:54:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3d007a400 0x7fb3d007c8c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3e810d140 0x7fb3e819eb30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e8104600 0x7fb3e8199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 --2- 172.21.15.19:0/639435684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3e8103ce0 0x7fb3e8199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 >> 172.21.15.19:0/639435684 conn(0x7fb3e80fd700 msgr2=0x7fb3e810f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 shutdown_connections 2024-09-10T23:54:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.044+0000 7fb3ed3b7640 1 -- 172.21.15.19:0/639435684 wait complete. 2024-09-10T23:54:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:05 smithi131 ceph-mon[35491]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-10T23:54:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:54:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:05 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2523433976' entity='client.admin' 2024-09-10T23:54:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:05 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2620189514' entity='client.admin' 2024-09-10T23:54:06.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.252+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f1ca00fdda0 con 0x7f1ca0101c90 2024-09-10T23:54:06.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.255+0000 7f1c977fe640 1 -- 172.21.15.19:0/3876976208 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v21)=0 v21) ==== 138+0+0 (secure 0 0 0) 0x7f1c900692c0 con 0x7f1ca0101c90 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.257+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1c8c07a400 msgr2=0x7f1c8c07c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.257+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1c8c07a400 0x7f1c8c07c8c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005ab0 tx=0x7f1c88005a20 comp rx=0 tx=0).stop 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.257+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0101c90 msgr2=0x7f1ca01992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.257+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0101c90 0x7f1ca01992c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000e9f0 tx=0x7f1c9000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 shutdown_connections 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ca0108020 0x7f1ca019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca01076a0 0x7f1ca0199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1c8c07a400 0x7f1c8c07c8c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 --2- 172.21.15.19:0/3876976208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0101c90 0x7f1ca01992c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:06.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 >> 172.21.15.19:0/3876976208 conn(0x7f1ca00fd700 msgr2=0x7f1ca0104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:06.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 shutdown_connections 2024-09-10T23:54:06.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.258+0000 7f1ca49ba640 1 -- 172.21.15.19:0/3876976208 wait complete. 2024-09-10T23:54:07.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 -- 172.21.15.19:0/3180169190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 msgr2=0x7f6b90107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 --2- 172.21.15.19:0/3180169190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 0x7f6b90107b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009900 tx=0x7f6b8402a410 comp rx=0 tx=0).stop 2024-09-10T23:54:07.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 -- 172.21.15.19:0/3180169190 shutdown_connections 2024-09-10T23:54:07.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 --2- 172.21.15.19:0/3180169190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b90108060 0x7f6b9010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 --2- 172.21.15.19:0/3180169190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 0x7f6b90107b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 --2- 172.21.15.19:0/3180169190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 0x7f6b901020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 -- 172.21.15.19:0/3180169190 >> 172.21.15.19:0/3180169190 conn(0x7f6b900fd720 msgr2=0x7f6b900ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:07.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 -- 172.21.15.19:0/3180169190 shutdown_connections 2024-09-10T23:54:07.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.060+0000 7f6b9597e640 1 -- 172.21.15.19:0/3180169190 wait complete. 2024-09-10T23:54:07.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 Processor -- start 2024-09-10T23:54:07.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 -- start start 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 0x7f6b901101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 0x7f6b90110720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b90108060 0x7f6b90110c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90112e20 con 0x7f6b901076e0 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90112ca0 con 0x7f6b90101cd0 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b9597e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90112fa0 con 0x7f6b90108060 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.061+0000 7f6b8e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 0x7f6b90110720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 0x7f6b901101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 0x7f6b901101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:35160/0 (socket says 172.21.15.19:35160) 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 -- 172.21.15.19:0/2957952512 learned_addr learned my addr 172.21.15.19:0/2957952512 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8f7fe640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b90108060 0x7f6b90110c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 -- 172.21.15.19:0/2957952512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b90108060 msgr2=0x7f6b90110c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b90108060 0x7f6b90110c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 -- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 msgr2=0x7f6b90110720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 0x7f6b90110720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 -- 172.21.15.19:0/2957952512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b901a7660 con 0x7f6b90101cd0 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b8effd640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 0x7f6b901101e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000eab0 tx=0x7f6b8000ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8000ce40 con 0x7f6b90101cd0 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b80011920 con 0x7f6b90101cd0 2024-09-10T23:54:07.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b901a7950 con 0x7f6b90101cd0 2024-09-10T23:54:07.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80010a30 con 0x7f6b90101cd0 2024-09-10T23:54:07.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.062+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b901a7e60 con 0x7f6b90101cd0 2024-09-10T23:54:07.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.064+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b901020b0 con 0x7f6b90101cd0 2024-09-10T23:54:07.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.064+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f6b8000f040 con 0x7f6b90101cd0 2024-09-10T23:54:07.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.065+0000 7f6b9497c640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b7807a400 0x7f6b7807c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.065+0000 7f6b8e7fc640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b7807a400 0x7f6b7807c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.065+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6b8009c1c0 con 0x7f6b90101cd0 2024-09-10T23:54:07.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.065+0000 7f6b8e7fc640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b7807a400 0x7f6b7807c8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b84031440 tx=0x7f6b84005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:07.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.069+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6b80016030 con 0x7f6b90101cd0 2024-09-10T23:54:07.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.253+0000 7fcec3824640 1 -- 172.21.15.19:0/874775117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc108020 msgr2=0x7fcebc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.253+0000 7fcec3824640 1 --2- 172.21.15.19:0/874775117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc108020 0x7fcebc10e820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009ca0 tx=0x7fceb402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.253+0000 7fcec3824640 1 -- 172.21.15.19:0/874775117 shutdown_connections 2024-09-10T23:54:07.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.253+0000 7fcec3824640 1 --2- 172.21.15.19:0/874775117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc108020 0x7fcebc10e820 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.253+0000 7fcec3824640 1 --2- 172.21.15.19:0/874775117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc1076a0 0x7fcebc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.253+0000 7fcec3824640 1 --2- 172.21.15.19:0/874775117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcebc101c90 0x7fcebc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.253+0000 7fcec3824640 1 -- 172.21.15.19:0/874775117 >> 172.21.15.19:0/874775117 conn(0x7fcebc0fd700 msgr2=0x7fcebc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:07.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.254+0000 7fcec3824640 1 -- 172.21.15.19:0/874775117 shutdown_connections 2024-09-10T23:54:07.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.254+0000 7fcec3824640 1 -- 172.21.15.19:0/874775117 wait complete. 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.254+0000 7fcec3824640 1 Processor -- start 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec3824640 1 -- start start 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec3824640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc101c90 0x7fcebc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec3824640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcebc1076a0 0x7fcebc199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec3824640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc108020 0x7fcebc19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec3824640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc111d30 con 0x7fcebc101c90 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec3824640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc111bb0 con 0x7fcebc1076a0 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec3824640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc111eb0 con 0x7fcebc108020 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec1dc1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc108020 0x7fcebc19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec1dc1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc108020 0x7fcebc19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:58162/0 (socket says 172.21.15.19:58162) 2024-09-10T23:54:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec1dc1640 1 -- 172.21.15.19:0/801822230 learned_addr learned my addr 172.21.15.19:0/801822230 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec0dbf640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcebc1076a0 0x7fcebc199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.255+0000 7fcec15c0640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc101c90 0x7fcebc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec0dbf640 1 -- 172.21.15.19:0/801822230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc108020 msgr2=0x7fcebc19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec0dbf640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc108020 0x7fcebc19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec0dbf640 1 -- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc101c90 msgr2=0x7fcebc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec0dbf640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc101c90 0x7fcebc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec0dbf640 1 -- 172.21.15.19:0/801822230 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc19f3b0 con 0x7fcebc1076a0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec1dc1640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc108020 0x7fcebc19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec0dbf640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcebc1076a0 0x7fcebc199840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fceac00d6d0 tx=0x7fceac00dad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac017070 con 0x7fcebc1076a0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceac0047a0 con 0x7fcebc1076a0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcebc19f6a0 con 0x7fcebc1076a0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac009ad0 con 0x7fcebc1076a0 2024-09-10T23:54:07.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.256+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcebc0fdd30 con 0x7fcebc1076a0 2024-09-10T23:54:07.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.258+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea0005290 con 0x7fcebc1076a0 2024-09-10T23:54:07.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.258+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7fceac009c70 con 0x7fcebc1076a0 2024-09-10T23:54:07.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.258+0000 7fceb27fc640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcea807a400 0x7fcea807c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.259+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fceac09b4e0 con 0x7fcebc1076a0 2024-09-10T23:54:07.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.259+0000 7fcec15c0640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcea807a400 0x7fcea807c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.260+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f6b9002e5c0 con 0x7f6b90101cd0 2024-09-10T23:54:07.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.262+0000 7fcec15c0640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcea807a400 0x7fcea807c8c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009990 tx=0x7fceb8009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:07.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.262+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f6b80060910 con 0x7f6b90101cd0 2024-09-10T23:54:07.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.262+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fceac05fe80 con 0x7fcebc1076a0 2024-09-10T23:54:07.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.267+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fceac0aed80 con 0x7fcebc1076a0 2024-09-10T23:54:07.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.273+0000 7f6b9497c640 1 -- 172.21.15.19:0/2957952512 <== mon.2 v2:172.21.15.131:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v23)=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f6b80064da0 con 0x7f6b90101cd0 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b7807a400 msgr2=0x7f6b7807c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b7807a400 0x7f6b7807c8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b84031440 tx=0x7f6b84005b50 comp rx=0 tx=0).stop 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 msgr2=0x7f6b901101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 0x7f6b901101e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000eab0 tx=0x7f6b8000ef70 comp rx=0 tx=0).stop 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 shutdown_connections 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b90108060 0x7f6b90110c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b7807a400 0x7f6b7807c8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b901076e0 0x7f6b90110720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 --2- 172.21.15.19:0/2957952512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b90101cd0 0x7f6b901101e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.275+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 >> 172.21.15.19:0/2957952512 conn(0x7f6b900fd720 msgr2=0x7f6b900ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:07.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.276+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 shutdown_connections 2024-09-10T23:54:07.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.276+0000 7f6b9597e640 1 -- 172.21.15.19:0/2957952512 wait complete. 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/639435684' entity='client.admin' 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3876976208' entity='client.admin' 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: Standby manager daemon y started 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:54:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:07 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1764642661' entity='client.admin' 2024-09-10T23:54:07.385 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/639435684' entity='client.admin' 2024-09-10T23:54:07.385 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3876976208' entity='client.admin' 2024-09-10T23:54:07.385 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: Standby manager daemon y started 2024-09-10T23:54:07.385 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:54:07.385 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:54:07.385 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:54:07.386 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:54:07.386 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:07 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1764642661' entity='client.admin' 2024-09-10T23:54:07.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/639435684' entity='client.admin' 2024-09-10T23:54:07.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3876976208' entity='client.admin' 2024-09-10T23:54:07.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: Standby manager daemon y started 2024-09-10T23:54:07.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:54:07.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:54:07.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:54:07.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: from='mgr.? 172.21.15.131:0/1660368579' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:54:07.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:07 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1764642661' entity='client.admin' 2024-09-10T23:54:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.459+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fcea0005580 con 0x7fcebc1076a0 2024-09-10T23:54:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.465+0000 7fceb27fc640 1 -- 172.21.15.19:0/801822230 <== mon.2 v2:172.21.15.131:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v24)=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7fceac0b3160 con 0x7fcebc1076a0 2024-09-10T23:54:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcea807a400 msgr2=0x7fcea807c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcea807a400 0x7fcea807c8c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009990 tx=0x7fceb8009110 comp rx=0 tx=0).stop 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcebc1076a0 msgr2=0x7fcebc199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcebc1076a0 0x7fcebc199840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fceac00d6d0 tx=0x7fceac00dad0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 shutdown_connections 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc108020 0x7fcebc19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcebc1076a0 0x7fcebc199840 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcea807a400 0x7fcea807c8c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 --2- 172.21.15.19:0/801822230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcebc101c90 0x7fcebc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 >> 172.21.15.19:0/801822230 conn(0x7fcebc0fd700 msgr2=0x7fcebc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 shutdown_connections 2024-09-10T23:54:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:07.468+0000 7fcec3824640 1 -- 172.21.15.19:0/801822230 wait complete. 2024-09-10T23:54:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:08 smithi019 ceph-mon[30859]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-10T23:54:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:54:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:08 smithi019 ceph-mon[30859]: from='client.? ' entity='client.admin' 2024-09-10T23:54:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:08 smithi019 ceph-mon[30859]: from='client.? ' entity='client.admin' 2024-09-10T23:54:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:08 smithi131 ceph-mon[35491]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-10T23:54:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:54:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:08 smithi131 ceph-mon[35491]: from='client.? ' entity='client.admin' 2024-09-10T23:54:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:08 smithi131 ceph-mon[35491]: from='client.? ' entity='client.admin' 2024-09-10T23:54:08.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:08 smithi135 ceph-mon[35432]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-10T23:54:08.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:54:08.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:08 smithi135 ceph-mon[35432]: from='client.? ' entity='client.admin' 2024-09-10T23:54:08.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:08 smithi135 ceph-mon[35432]: from='client.? ' entity='client.admin' 2024-09-10T23:54:08.765 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 -- 172.21.15.19:0/2071076525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064103ce0 msgr2=0x7f00641040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 --2- 172.21.15.19:0/2071076525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064103ce0 0x7f00641040c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c02a410 comp rx=0 tx=0).stop 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 -- 172.21.15.19:0/2071076525 shutdown_connections 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 --2- 172.21.15.19:0/2071076525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006410d140 0x7f006410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 --2- 172.21.15.19:0/2071076525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0064104600 0x7f006410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 --2- 172.21.15.19:0/2071076525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064103ce0 0x7f00641040c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 -- 172.21.15.19:0/2071076525 >> 172.21.15.19:0/2071076525 conn(0x7f00640fd740 msgr2=0x7f00640ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 -- 172.21.15.19:0/2071076525 shutdown_connections 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 -- 172.21.15.19:0/2071076525 wait complete. 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.989+0000 7f0069ac9640 1 Processor -- start 2024-09-10T23:54:08.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0069ac9640 1 -- start start 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0069ac9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0064103ce0 0x7f006419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0069ac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064104600 0x7f006419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0069ac9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006410d140 0x7f00641a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0069ac9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0064112e00 con 0x7f0064104600 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0069ac9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0064112c80 con 0x7f006410d140 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0069ac9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0064112f80 con 0x7f0064103ce0 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0062ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064104600 0x7f006419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0062ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064104600 0x7f006419ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40278/0 (socket says 172.21.15.19:40278) 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0062ffd640 1 -- 172.21.15.19:0/970628571 learned_addr learned my addr 172.21.15.19:0/970628571 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f00637fe640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0064103ce0 0x7f006419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.990+0000 7f0063fff640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006410d140 0x7f00641a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f00637fe640 1 -- 172.21.15.19:0/970628571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006410d140 msgr2=0x7f00641a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:08.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f00637fe640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006410d140 0x7f00641a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f00637fe640 1 -- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064104600 msgr2=0x7f006419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f00637fe640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064104600 0x7f006419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f00637fe640 1 -- 172.21.15.19:0/970628571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00641a15a0 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f0062ffd640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064104600 0x7f006419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f0063fff640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006410d140 0x7f00641a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f00637fe640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0064103ce0 0x7f006419b4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f004c02aa00 tx=0x7f004c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f0060ff9640 1 -- 172.21.15.19:0/970628571 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c03f070 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f0060ff9640 1 -- 172.21.15.19:0/970628571 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c031b50 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00641a1830 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f0060ff9640 1 -- 172.21.15.19:0/970628571 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c035030 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.991+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00641a7f50 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.992+0000 7f0060ff9640 1 -- 172.21.15.19:0/970628571 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f004c03bb40 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.992+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00641040c0 con 0x7f0064103ce0 2024-09-10T23:54:08.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.992+0000 7f0060ff9640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f005003f560 0x7f0050041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.992+0000 7f0060ff9640 1 -- 172.21.15.19:0/970628571 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f004c0746c0 con 0x7f0064103ce0 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.992+0000 7f0062ffd640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f005003f560 0x7f0050041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.993+0000 7f0062ffd640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f005003f560 0x7f0050041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f006410e840 tx=0x7f0054005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:02.997+0000 7f0060ff9640 1 -- 172.21.15.19:0/970628571 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f004c03fe40 con 0x7f0064103ce0 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.201+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f006419c620 con 0x7f0064103ce0 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.207+0000 7f0060ff9640 1 -- 172.21.15.19:0/970628571 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f004c031d00 con 0x7f0064103ce0 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f005003f560 msgr2=0x7f0050041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f005003f560 0x7f0050041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f006410e840 tx=0x7f0054005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0064103ce0 msgr2=0x7f006419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0064103ce0 0x7f006419b4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f004c02aa00 tx=0x7f004c003b90 comp rx=0 tx=0).stop 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 shutdown_connections 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f006410d140 0x7f00641a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f005003f560 0x7f0050041a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0064104600 0x7f006419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 --2- 172.21.15.19:0/970628571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0064103ce0 0x7f006419b4f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 >> 172.21.15.19:0/970628571 conn(0x7f00640fd740 msgr2=0x7f006410f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 shutdown_connections 2024-09-10T23:54:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:03.210+0000 7f0069ac9640 1 -- 172.21.15.19:0/970628571 wait complete. 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 -- 172.21.15.19:0/326378375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd801021f0 msgr2=0x7fdd8010ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 --2- 172.21.15.19:0/326378375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd801021f0 0x7fdd8010ef40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009900 tx=0x7fdd7002a410 comp rx=0 tx=0).stop 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 -- 172.21.15.19:0/326378375 shutdown_connections 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 --2- 172.21.15.19:0/326378375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd8010f480 0x7fdd80111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 --2- 172.21.15.19:0/326378375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd801021f0 0x7fdd8010ef40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 --2- 172.21.15.19:0/326378375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd801018d0 0x7fdd80101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 -- 172.21.15.19:0/326378375 >> 172.21.15.19:0/326378375 conn(0x7fdd800fd700 msgr2=0x7fdd800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 -- 172.21.15.19:0/326378375 shutdown_connections 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.730+0000 7fdd87379640 1 -- 172.21.15.19:0/326378375 wait complete. 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 Processor -- start 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 -- start start 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd801018d0 0x7fdd8019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd801021f0 0x7fdd8019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8010f480 0x7fdd801a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80114f90 con 0x7fdd8010f480 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80114e10 con 0x7fdd801021f0 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd87379640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80115110 con 0x7fdd801018d0 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd85916640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8010f480 0x7fdd801a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd85916640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8010f480 0x7fdd801a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40426/0 (socket says 172.21.15.19:40426) 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.731+0000 7fdd85916640 1 -- 172.21.15.19:0/4223297931 learned_addr learned my addr 172.21.15.19:0/4223297931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd85115640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd801018d0 0x7fdd8019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd84914640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd801021f0 0x7fdd8019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd85916640 1 -- 172.21.15.19:0/4223297931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd801018d0 msgr2=0x7fdd8019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd85916640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd801018d0 0x7fdd8019b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd85916640 1 -- 172.21.15.19:0/4223297931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd801021f0 msgr2=0x7fdd8019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd85916640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd801021f0 0x7fdd8019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd85916640 1 -- 172.21.15.19:0/4223297931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd801a1450 con 0x7fdd8010f480 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd85916640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8010f480 0x7fdd801a0c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800ccb0 tx=0x7fdd7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd767fc640 1 -- 172.21.15.19:0/4223297931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800f450 con 0x7fdd8010f480 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd767fc640 1 -- 172.21.15.19:0/4223297931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd7800faa0 con 0x7fdd8010f480 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd801a1740 con 0x7fdd8010f480 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd767fc640 1 -- 172.21.15.19:0/4223297931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd780189d0 con 0x7fdd8010f480 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.732+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd801a7e00 con 0x7fdd8010f480 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.733+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd80101cb0 con 0x7fdd8010f480 2024-09-10T23:54:09.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.735+0000 7fdd767fc640 1 -- 172.21.15.19:0/4223297931 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fdd78020030 con 0x7fdd8010f480 2024-09-10T23:54:09.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.735+0000 7fdd767fc640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdd6c0b5320 0x7fdd6c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.736+0000 7fdd85115640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdd6c0b5320 0x7fdd6c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.736+0000 7fdd767fc640 1 -- 172.21.15.19:0/4223297931 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdd780e3fa0 con 0x7fdd8010f480 2024-09-10T23:54:09.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.736+0000 7fdd85115640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdd6c0b5320 0x7fdd6c0b77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00abe0 tx=0x7fdd7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:09.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.739+0000 7fdd767fc640 1 -- 172.21.15.19:0/4223297931 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdd78014030 con 0x7fdd8010f480 2024-09-10T23:54:09.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:09 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/577794323' entity='client.admin' 2024-09-10T23:54:09.836 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:09 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/577794323' entity='client.admin' 2024-09-10T23:54:09.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 -- 172.21.15.19:0/2354048770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 msgr2=0x7f73fc101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 --2- 172.21.15.19:0/2354048770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 0x7f73fc101e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009900 tx=0x7f73f802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 -- 172.21.15.19:0/2354048770 shutdown_connections 2024-09-10T23:54:09.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 --2- 172.21.15.19:0/2354048770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73fc106ed0 0x7f73fc107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 --2- 172.21.15.19:0/2354048770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 0x7f73fc106880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 --2- 172.21.15.19:0/2354048770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 0x7f73fc101e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 -- 172.21.15.19:0/2354048770 >> 172.21.15.19:0/2354048770 conn(0x7f73fc0fd700 msgr2=0x7f73fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:09.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 -- 172.21.15.19:0/2354048770 shutdown_connections 2024-09-10T23:54:09.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 -- 172.21.15.19:0/2354048770 wait complete. 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 Processor -- start 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.920+0000 7f740391b640 1 -- start start 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f740391b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 0x7f73fc19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f740391b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 0x7f73fc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f740391b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73fc106ed0 0x7f73fc1a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f740391b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc119360 con 0x7f73fc1023b0 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f740391b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1191e0 con 0x7f73fc101a90 2024-09-10T23:54:09.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f740391b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1194e0 con 0x7f73fc106ed0 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 0x7f73fc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 0x7f73fc19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40446/0 (socket says 172.21.15.19:40446) 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 -- 172.21.15.19:0/1734009347 learned_addr learned my addr 172.21.15.19:0/1734009347 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f74016b7640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 0x7f73fc19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7401eb8640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73fc106ed0 0x7f73fc1a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 -- 172.21.15.19:0/1734009347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73fc106ed0 msgr2=0x7f73fc1a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73fc106ed0 0x7f73fc1a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 -- 172.21.15.19:0/1734009347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 msgr2=0x7f73fc19f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 0x7f73fc19f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 -- 172.21.15.19:0/1734009347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc1a5940 con 0x7f73fc1023b0 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7401eb8640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73fc106ed0 0x7f73fc1a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.921+0000 7f7400eb6640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 0x7f73fc19fdd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00e9c0 tx=0x7f73ec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:09.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.922+0000 7f73f27fc640 1 -- 172.21.15.19:0/1734009347 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00ccc0 con 0x7f73fc1023b0 2024-09-10T23:54:09.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.922+0000 7f73f27fc640 1 -- 172.21.15.19:0/1734009347 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73ec0035f0 con 0x7f73fc1023b0 2024-09-10T23:54:09.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.922+0000 7f73f27fc640 1 -- 172.21.15.19:0/1734009347 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00ce60 con 0x7f73fc1023b0 2024-09-10T23:54:09.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.922+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc1a5c30 con 0x7f73fc1023b0 2024-09-10T23:54:09.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.922+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc1ac2f0 con 0x7f73fc1023b0 2024-09-10T23:54:09.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.923+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73fc106880 con 0x7f73fc1023b0 2024-09-10T23:54:09.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:09 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/577794323' entity='client.admin' 2024-09-10T23:54:09.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.925+0000 7f73f27fc640 1 -- 172.21.15.19:0/1734009347 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f73ec004000 con 0x7f73fc1023b0 2024-09-10T23:54:09.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.926+0000 7f73f27fc640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73e80b52a0 0x7f73e80b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:09.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.926+0000 7f74016b7640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73e80b52a0 0x7f73e80b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:09.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.926+0000 7f73f27fc640 1 -- 172.21.15.19:0/1734009347 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f73ec0e43e0 con 0x7f73fc1023b0 2024-09-10T23:54:09.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.927+0000 7f74016b7640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73e80b52a0 0x7f73e80b7760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f73f8031440 tx=0x7f73f8005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:09.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.930+0000 7f73f27fc640 1 -- 172.21.15.19:0/1734009347 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f73ec0ace00 con 0x7f73fc1023b0 2024-09-10T23:54:09.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.934+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fdd8019c4d0 con 0x7fdd8010f480 2024-09-10T23:54:09.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.938+0000 7fdd767fc640 1 -- 172.21.15.19:0/4223297931 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7fdd780acae0 con 0x7fdd8010f480 2024-09-10T23:54:09.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdd6c0b5320 msgr2=0x7fdd6c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdd6c0b5320 0x7fdd6c0b77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00abe0 tx=0x7fdd7c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8010f480 msgr2=0x7fdd801a0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:09.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8010f480 0x7fdd801a0c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800ccb0 tx=0x7fdd7800a620 comp rx=0 tx=0).stop 2024-09-10T23:54:09.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 shutdown_connections 2024-09-10T23:54:09.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdd6c0b5320 0x7fdd6c0b77e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8010f480 0x7fdd801a0c80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd801021f0 0x7fdd8019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 --2- 172.21.15.19:0/4223297931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd801018d0 0x7fdd8019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:09.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 >> 172.21.15.19:0/4223297931 conn(0x7fdd800fd700 msgr2=0x7fdd80111630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 shutdown_connections 2024-09-10T23:54:09.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:09.940+0000 7fdd87379640 1 -- 172.21.15.19:0/4223297931 wait complete. 2024-09-10T23:54:10.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.120+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f73fc1ac6c0 con 0x7f73fc1023b0 2024-09-10T23:54:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.126+0000 7f73f27fc640 1 -- 172.21.15.19:0/1734009347 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7f73ec0ac700 con 0x7f73fc1023b0 2024-09-10T23:54:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.128+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73e80b52a0 msgr2=0x7f73e80b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.128+0000 7f740391b640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73e80b52a0 0x7f73e80b7760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f73f8031440 tx=0x7f73f8005b50 comp rx=0 tx=0).stop 2024-09-10T23:54:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.128+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 msgr2=0x7f73fc19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.128+0000 7f740391b640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 0x7f73fc19fdd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00e9c0 tx=0x7f73ec00ee80 comp rx=0 tx=0).stop 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 shutdown_connections 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73fc106ed0 0x7f73fc1a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73e80b52a0 0x7f73e80b7760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73fc1023b0 0x7f73fc19fdd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 --2- 172.21.15.19:0/1734009347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73fc101a90 0x7f73fc19f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 >> 172.21.15.19:0/1734009347 conn(0x7f73fc0fd700 msgr2=0x7f73fc104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 shutdown_connections 2024-09-10T23:54:10.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:10.129+0000 7f740391b640 1 -- 172.21.15.19:0/1734009347 wait complete. 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 -- 172.21.15.19:0/2268042731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780103b70 msgr2=0x7f9780103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2268042731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780103b70 0x7f9780103f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f977c009900 tx=0x7f977c02a410 comp rx=0 tx=0).stop 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 -- 172.21.15.19:0/2268042731 shutdown_connections 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2268042731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f978010d120 0x7f978010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2268042731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9780104570 0x7f978010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2268042731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780103b70 0x7f9780103f50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 -- 172.21.15.19:0/2268042731 >> 172.21.15.19:0/2268042731 conn(0x7f97800fd700 msgr2=0x7f97800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 -- 172.21.15.19:0/2268042731 shutdown_connections 2024-09-10T23:54:10.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.266+0000 7f9787d0e640 1 -- 172.21.15.19:0/2268042731 wait complete. 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 Processor -- start 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 -- start start 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9780103b70 0x7f978019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780104570 0x7f978019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f978010d120 0x7f97801a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9780112da0 con 0x7f9780104570 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9780112c20 con 0x7f978010d120 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f9787d0e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9780112f20 con 0x7f9780103b70 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f97852a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780104570 0x7f978019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f97852a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780104570 0x7f978019ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40296/0 (socket says 172.21.15.19:40296) 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f97852a9640 1 -- 172.21.15.19:0/2620189514 learned_addr learned my addr 172.21.15.19:0/2620189514 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:10.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.267+0000 7f97862ab640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f978010d120 0x7f97801a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f9785aaa640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9780103b70 0x7f978019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f97852a9640 1 -- 172.21.15.19:0/2620189514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9780103b70 msgr2=0x7f978019b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f97852a9640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9780103b70 0x7f978019b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f97852a9640 1 -- 172.21.15.19:0/2620189514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f978010d120 msgr2=0x7f97801a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f97852a9640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f978010d120 0x7f97801a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f97852a9640 1 -- 172.21.15.19:0/2620189514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97801a15a0 con 0x7f9780104570 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f97852a9640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780104570 0x7f978019ba30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f977000d950 tx=0x7f977000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f9776ffd640 1 -- 172.21.15.19:0/2620189514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770017070 con 0x7f9780104570 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f9776ffd640 1 -- 172.21.15.19:0/2620189514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9770009c30 con 0x7f9780104570 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97801a1890 con 0x7f9780104570 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f9776ffd640 1 -- 172.21.15.19:0/2620189514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977000f620 con 0x7f9780104570 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.268+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97801a7f50 con 0x7f9780104570 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.269+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9780103f50 con 0x7f9780104570 2024-09-10T23:54:10.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.270+0000 7f9776ffd640 1 -- 172.21.15.19:0/2620189514 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f9770010460 con 0x7f9780104570 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.270+0000 7f9776ffd640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f976c07a400 0x7f976c07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.271+0000 7f9776ffd640 1 -- 172.21.15.19:0/2620189514 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f977009bad0 con 0x7f9780104570 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.271+0000 7f9785aaa640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f976c07a400 0x7f976c07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.271+0000 7f9785aaa640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f976c07a400 0x7f976c07c8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f977c031440 tx=0x7f977c005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.275+0000 7f9776ffd640 1 -- 172.21.15.19:0/2620189514 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9770009de0 con 0x7f9780104570 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.478+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f97801a82f0 con 0x7f9780104570 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.481+0000 7f9776ffd640 1 -- 172.21.15.19:0/2620189514 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f97700640e0 con 0x7f9780104570 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f976c07a400 msgr2=0x7f976c07c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f976c07a400 0x7f976c07c8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f977c031440 tx=0x7f977c005b50 comp rx=0 tx=0).stop 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780104570 msgr2=0x7f978019ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780104570 0x7f978019ba30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f977000d950 tx=0x7f977000de10 comp rx=0 tx=0).stop 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 shutdown_connections 2024-09-10T23:54:10.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f978010d120 0x7f97801a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f976c07a400 0x7f976c07c8c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9780104570 0x7f978019ba30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 --2- 172.21.15.19:0/2620189514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9780103b70 0x7f978019b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 >> 172.21.15.19:0/2620189514 conn(0x7f97800fd700 msgr2=0x7f978010f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 shutdown_connections 2024-09-10T23:54:10.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:05.484+0000 7f9787d0e640 1 -- 172.21.15.19:0/2620189514 wait complete. 2024-09-10T23:54:11.153 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:10 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4223297931' entity='client.admin' 2024-09-10T23:54:11.153 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:10 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1734009347' entity='client.admin' 2024-09-10T23:54:11.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:10 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4223297931' entity='client.admin' 2024-09-10T23:54:11.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:10 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1734009347' entity='client.admin' 2024-09-10T23:54:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:10 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4223297931' entity='client.admin' 2024-09-10T23:54:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:10 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1734009347' entity='client.admin' 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 -- 172.21.15.19:0/1239862995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a010d100 msgr2=0x7ff3a010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1239862995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a010d100 0x7ff3a010f560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff390009900 tx=0x7ff39002a410 comp rx=0 tx=0).stop 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 -- 172.21.15.19:0/1239862995 shutdown_connections 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1239862995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a010d100 0x7ff3a010f560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1239862995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a01045c0 0x7ff3a010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1239862995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a0103ca0 0x7ff3a0104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 -- 172.21.15.19:0/1239862995 >> 172.21.15.19:0/1239862995 conn(0x7ff3a00fd700 msgr2=0x7ff3a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 -- 172.21.15.19:0/1239862995 shutdown_connections 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.498+0000 7ff3a499c640 1 -- 172.21.15.19:0/1239862995 wait complete. 2024-09-10T23:54:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 Processor -- start 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 -- start start 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0103ca0 0x7ff3a0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a01045c0 0x7ff3a01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a010d100 0x7ff3a019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0112d70 con 0x7ff3a0103ca0 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0112bf0 con 0x7ff3a010d100 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff3a499c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0112ef0 con 0x7ff3a01045c0 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff39e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0103ca0 0x7ff3a0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff39e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0103ca0 0x7ff3a0199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49216/0 (socket says 172.21.15.19:49216) 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff39e59c640 1 -- 172.21.15.19:0/1128366554 learned_addr learned my addr 172.21.15.19:0/1128366554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.499+0000 7ff39ed9d640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a010d100 0x7ff3a019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39dd9b640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a01045c0 0x7ff3a01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39e59c640 1 -- 172.21.15.19:0/1128366554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a01045c0 msgr2=0x7ff3a01997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39e59c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a01045c0 0x7ff3a01997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39e59c640 1 -- 172.21.15.19:0/1128366554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a010d100 msgr2=0x7ff3a019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39e59c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a010d100 0x7ff3a019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39e59c640 1 -- 172.21.15.19:0/1128366554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a019f330 con 0x7ff3a0103ca0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39dd9b640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a01045c0 0x7ff3a01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff39e59c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0103ca0 0x7ff3a0199280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff39800eab0 tx=0x7ff39800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff3977fe640 1 -- 172.21.15.19:0/1128366554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39800ce40 con 0x7ff3a0103ca0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff3977fe640 1 -- 172.21.15.19:0/1128366554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff398011920 con 0x7ff3a0103ca0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a019f620 con 0x7ff3a0103ca0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff3977fe640 1 -- 172.21.15.19:0/1128366554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398010a30 con 0x7ff3a0103ca0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.500+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a01a5ce0 con 0x7ff3a0103ca0 2024-09-10T23:54:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.501+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a0104080 con 0x7ff3a0103ca0 2024-09-10T23:54:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.503+0000 7ff3977fe640 1 -- 172.21.15.19:0/1128366554 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7ff39800f040 con 0x7ff3a0103ca0 2024-09-10T23:54:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.504+0000 7ff3977fe640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff38c0b52a0 0x7ff38c0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.504+0000 7ff39dd9b640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff38c0b52a0 0x7ff38c0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.504+0000 7ff3977fe640 1 -- 172.21.15.19:0/1128366554 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff3980e43e0 con 0x7ff3a0103ca0 2024-09-10T23:54:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.505+0000 7ff39dd9b640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff38c0b52a0 0x7ff38c0b7760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff388005d00 tx=0x7ff388005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.508+0000 7ff3977fe640 1 -- 172.21.15.19:0/1128366554 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff398016030 con 0x7ff3a0103ca0 2024-09-10T23:54:11.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.696+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff3a019a3b0 con 0x7ff3a0103ca0 2024-09-10T23:54:11.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.699+0000 7ff3977fe640 1 -- 172.21.15.19:0/1128366554 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v28)=0 v28) ==== 106+0+0 (secure 0 0 0) 0x7ff3980ace00 con 0x7ff3a0103ca0 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff38c0b52a0 msgr2=0x7ff38c0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff38c0b52a0 0x7ff38c0b7760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff388005d00 tx=0x7ff388005c70 comp rx=0 tx=0).stop 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0103ca0 msgr2=0x7ff3a0199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0103ca0 0x7ff3a0199280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff39800eab0 tx=0x7ff39800ef70 comp rx=0 tx=0).stop 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 shutdown_connections 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a010d100 0x7ff3a019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3a01045c0 0x7ff3a01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff38c0b52a0 0x7ff38c0b7760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 --2- 172.21.15.19:0/1128366554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0103ca0 0x7ff3a0199280 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 >> 172.21.15.19:0/1128366554 conn(0x7ff3a00fd700 msgr2=0x7ff3a00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:11.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 shutdown_connections 2024-09-10T23:54:11.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:11.702+0000 7ff3a499c640 1 -- 172.21.15.19:0/1128366554 wait complete. 2024-09-10T23:54:11.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 -- 172.21.15.19:0/4157455027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 msgr2=0x7f83a01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 --2- 172.21.15.19:0/4157455027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a01020b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f839c009900 tx=0x7f839c02a410 comp rx=0 tx=0).stop 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 -- 172.21.15.19:0/4157455027 shutdown_connections 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 --2- 172.21.15.19:0/4157455027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a0108060 0x7f83a010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 --2- 172.21.15.19:0/4157455027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83a01076e0 0x7f83a0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 --2- 172.21.15.19:0/4157455027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a01020b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 -- 172.21.15.19:0/4157455027 >> 172.21.15.19:0/4157455027 conn(0x7f83a00fd700 msgr2=0x7f83a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 -- 172.21.15.19:0/4157455027 shutdown_connections 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.328+0000 7f83a76ac640 1 -- 172.21.15.19:0/4157455027 wait complete. 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 Processor -- start 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 -- start start 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a01076e0 0x7f83a019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83a0108060 0x7f83a019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0111d30 con 0x7f83a0101cd0 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0111bb0 con 0x7f83a0108060 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a76ac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0111eb0 con 0x7f83a01076e0 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a5448640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.329+0000 7f83a5448640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a019a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40410/0 (socket says 172.21.15.19:40410) 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5448640 1 -- 172.21.15.19:0/577794323 learned_addr learned my addr 172.21.15.19:0/577794323 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5c49640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83a0108060 0x7f83a019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a4c47640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a01076e0 0x7f83a019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5448640 1 -- 172.21.15.19:0/577794323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a01076e0 msgr2=0x7f83a019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5448640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a01076e0 0x7f83a019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5448640 1 -- 172.21.15.19:0/577794323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83a0108060 msgr2=0x7f83a019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5448640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83a0108060 0x7f83a019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5448640 1 -- 172.21.15.19:0/577794323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a01a54c0 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a4c47640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a01076e0 0x7f83a019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a5448640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a019a0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f839c005ab0 tx=0x7f839c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83967fc640 1 -- 172.21.15.19:0/577794323 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c03f070 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83967fc640 1 -- 172.21.15.19:0/577794323 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c031d60 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a01a5750 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83967fc640 1 -- 172.21.15.19:0/577794323 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c035030 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.330+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a01a5c80 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.331+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a01020b0 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.333+0000 7f83967fc640 1 -- 172.21.15.19:0/577794323 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f839c03b580 con 0x7f83a0101cd0 2024-09-10T23:54:11.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.334+0000 7f83967fc640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f838c0b53a0 0x7f838c0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.334+0000 7f83a4c47640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f838c0b53a0 0x7f838c0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.334+0000 7f83967fc640 1 -- 172.21.15.19:0/577794323 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f839c1051a0 con 0x7f83a0101cd0 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.334+0000 7f83a4c47640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f838c0b53a0 0x7f838c0b7860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83a006c0b0 tx=0x7f8390005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.337+0000 7f83967fc640 1 -- 172.21.15.19:0/577794323 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f839c0cdbc0 con 0x7f83a0101cd0 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.524+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f83a002e5c0 con 0x7f83a0101cd0 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.530+0000 7f83967fc640 1 -- 172.21.15.19:0/577794323 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v25)=0 v25) ==== 116+0+0 (secure 0 0 0) 0x7f839c0cd4c0 con 0x7f83a0101cd0 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f838c0b53a0 msgr2=0x7f838c0b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f838c0b53a0 0x7f838c0b7860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83a006c0b0 tx=0x7f8390005ec0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 msgr2=0x7f83a019a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a019a0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f839c005ab0 tx=0x7f839c003cd0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 shutdown_connections 2024-09-10T23:54:11.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83a0108060 0x7f83a019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a01076e0 0x7f83a019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f838c0b53a0 0x7f838c0b7860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 --2- 172.21.15.19:0/577794323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a0101cd0 0x7f83a019a0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 >> 172.21.15.19:0/577794323 conn(0x7f83a00fd700 msgr2=0x7f83a00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:11.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 shutdown_connections 2024-09-10T23:54:11.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:08.532+0000 7f83a76ac640 1 -- 172.21.15.19:0/577794323 wait complete. 2024-09-10T23:54:12.494 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi019') 2024-09-10T23:54:13.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:12 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1128366554' entity='client.admin' 2024-09-10T23:54:13.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:12 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1128366554' entity='client.admin' 2024-09-10T23:54:13.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:12 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1128366554' entity='client.admin' 2024-09-10T23:54:14.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:13 smithi019 ceph-mon[30859]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:14.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:13 smithi131 ceph-mon[35491]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:14.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:13 smithi135 ceph-mon[35432]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:14.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 -- 172.21.15.19:0/2977206200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c101c90 msgr2=0x7fb49c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 --2- 172.21.15.19:0/2977206200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c101c90 0x7fb49c102070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009ca0 tx=0x7fb48c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 -- 172.21.15.19:0/2977206200 shutdown_connections 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 --2- 172.21.15.19:0/2977206200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb49c108020 0x7fb49c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 --2- 172.21.15.19:0/2977206200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb49c1076a0 0x7fb49c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 --2- 172.21.15.19:0/2977206200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c101c90 0x7fb49c102070 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 -- 172.21.15.19:0/2977206200 >> 172.21.15.19:0/2977206200 conn(0x7fb49c0fd700 msgr2=0x7fb49c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 -- 172.21.15.19:0/2977206200 shutdown_connections 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 -- 172.21.15.19:0/2977206200 wait complete. 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.306+0000 7fb4a3790640 1 Processor -- start 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a3790640 1 -- start start 2024-09-10T23:54:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a3790640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb49c101c90 0x7fb49c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a3790640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c1076a0 0x7fb49c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a3790640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb49c108020 0x7fb49c1a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a3790640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c111d20 con 0x7fb49c1076a0 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a3790640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c111ba0 con 0x7fb49c108020 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a3790640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c111ea0 con 0x7fb49c101c90 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c1076a0 0x7fb49c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a152c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb49c101c90 0x7fb49c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c1076a0 0x7fb49c19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49226/0 (socket says 172.21.15.19:49226) 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 -- 172.21.15.19:0/4229746605 learned_addr learned my addr 172.21.15.19:0/4229746605 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a1d2d640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb49c108020 0x7fb49c1a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 -- 172.21.15.19:0/4229746605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb49c101c90 msgr2=0x7fb49c19b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb49c101c90 0x7fb49c19b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 -- 172.21.15.19:0/4229746605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb49c108020 msgr2=0x7fb49c1a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb49c108020 0x7fb49c1a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 -- 172.21.15.19:0/4229746605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c1a1700 con 0x7fb49c1076a0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.307+0000 7fb4a0d2b640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c1076a0 0x7fb49c19bb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb49000b4a0 tx=0x7fb49000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.308+0000 7fb49a7fc640 1 -- 172.21.15.19:0/4229746605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490014070 con 0x7fb49c1076a0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.308+0000 7fb49a7fc640 1 -- 172.21.15.19:0/4229746605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb490010ac0 con 0x7fb49c1076a0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.308+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49c1a19f0 con 0x7fb49c1076a0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.308+0000 7fb49a7fc640 1 -- 172.21.15.19:0/4229746605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490017c30 con 0x7fb49c1076a0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.308+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49c1a80b0 con 0x7fb49c1076a0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.309+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49c1020f0 con 0x7fb49c1076a0 2024-09-10T23:54:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.311+0000 7fb49a7fc640 1 -- 172.21.15.19:0/4229746605 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fb490010610 con 0x7fb49c1076a0 2024-09-10T23:54:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.312+0000 7fb49a7fc640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb4840b5320 0x7fb4840b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.312+0000 7fb4a152c640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb4840b5320 0x7fb4840b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.312+0000 7fb49a7fc640 1 -- 172.21.15.19:0/4229746605 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb4900e38b0 con 0x7fb49c1076a0 2024-09-10T23:54:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.313+0000 7fb4a152c640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb4840b5320 0x7fb4840b77e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0098d0 tx=0x7fb48c009900 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.315+0000 7fb49a7fc640 1 -- 172.21.15.19:0/4229746605 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb4900abc80 con 0x7fb49c1076a0 2024-09-10T23:54:14.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.505+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fb49c19c780 con 0x7fb49c1076a0 2024-09-10T23:54:14.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.508+0000 7fb49a7fc640 1 -- 172.21.15.19:0/4229746605 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7fb4900b06b0 con 0x7fb49c1076a0 2024-09-10T23:54:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.510+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb4840b5320 msgr2=0x7fb4840b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb4840b5320 0x7fb4840b77e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0098d0 tx=0x7fb48c009900 comp rx=0 tx=0).stop 2024-09-10T23:54:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c1076a0 msgr2=0x7fb49c19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c1076a0 0x7fb49c19bb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb49000b4a0 tx=0x7fb49000b960 comp rx=0 tx=0).stop 2024-09-10T23:54:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 shutdown_connections 2024-09-10T23:54:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb49c108020 0x7fb49c1a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb4840b5320 0x7fb4840b77e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb49c1076a0 0x7fb49c19bb90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 --2- 172.21.15.19:0/4229746605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb49c101c90 0x7fb49c19b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 >> 172.21.15.19:0/4229746605 conn(0x7fb49c0fd700 msgr2=0x7fb49c06b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 shutdown_connections 2024-09-10T23:54:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:14.511+0000 7fb4a3790640 1 -- 172.21.15.19:0/4229746605 wait complete. 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 -- 172.21.15.19:0/2939243097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 msgr2=0x7f807410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2939243097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f807410caf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8064009900 tx=0x7f806402a410 comp rx=0 tx=0).stop 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 -- 172.21.15.19:0/2939243097 shutdown_connections 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2939243097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807410d140 0x7f807410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2939243097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f807410caf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2939243097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8074103ce0 0x7f80741040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 -- 172.21.15.19:0/2939243097 >> 172.21.15.19:0/2939243097 conn(0x7f80740fd720 msgr2=0x7f80740ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 -- 172.21.15.19:0/2939243097 shutdown_connections 2024-09-10T23:54:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.243+0000 7f807bd6a640 1 -- 172.21.15.19:0/2939243097 wait complete. 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 Processor -- start 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 -- start start 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8074103ce0 0x7f8074199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f8074199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807410d140 0x7f807419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8074112db0 con 0x7f8074104600 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8074112c30 con 0x7f8074103ce0 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807bd6a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8074112f30 con 0x7f807410d140 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079305640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f8074199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079305640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f8074199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49246/0 (socket says 172.21.15.19:49246) 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079305640 1 -- 172.21.15.19:0/2782690010 learned_addr learned my addr 172.21.15.19:0/2782690010 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079b06640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8074103ce0 0x7f8074199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f807a307640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807410d140 0x7f807419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079305640 1 -- 172.21.15.19:0/2782690010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807410d140 msgr2=0x7f807419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079305640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807410d140 0x7f807419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079305640 1 -- 172.21.15.19:0/2782690010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8074103ce0 msgr2=0x7f8074199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.244+0000 7f8079305640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8074103ce0 0x7f8074199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f8079305640 1 -- 172.21.15.19:0/2782690010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807419f3d0 con 0x7f8074104600 2024-09-10T23:54:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f8079b06640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8074103ce0 0x7f8074199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f8079305640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f8074199860 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8064004270 tx=0x7f80640042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f806affd640 1 -- 172.21.15.19:0/2782690010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806403f030 con 0x7f8074104600 2024-09-10T23:54:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f806affd640 1 -- 172.21.15.19:0/2782690010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80640044c0 con 0x7f8074104600 2024-09-10T23:54:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807419f660 con 0x7f8074104600 2024-09-10T23:54:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f806affd640 1 -- 172.21.15.19:0/2782690010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064035070 con 0x7f8074104600 2024-09-10T23:54:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.245+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8074101870 con 0x7f8074104600 2024-09-10T23:54:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.246+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80741040c0 con 0x7f8074104600 2024-09-10T23:54:15.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.247+0000 7f806affd640 1 -- 172.21.15.19:0/2782690010 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f806403bbe0 con 0x7f8074104600 2024-09-10T23:54:15.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.248+0000 7f806affd640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80600b53a0 0x7f80600b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:15.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.248+0000 7f806affd640 1 -- 172.21.15.19:0/2782690010 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8064104d10 con 0x7f8074104600 2024-09-10T23:54:15.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.248+0000 7f8079b06640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80600b53a0 0x7f80600b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:15.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.249+0000 7f8079b06640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80600b53a0 0x7f80600b7860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80700058c0 tx=0x7f8070005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:15.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.251+0000 7f806affd640 1 -- 172.21.15.19:0/2782690010 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80640cd730 con 0x7f8074104600 2024-09-10T23:54:15.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.439+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f807419a450 con 0x7f8074104600 2024-09-10T23:54:15.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.442+0000 7f806affd640 1 -- 172.21.15.19:0/2782690010 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7f80640cd030 con 0x7f8074104600 2024-09-10T23:54:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80600b53a0 msgr2=0x7f80600b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80600b53a0 0x7f80600b7860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80700058c0 tx=0x7f8070005ec0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 msgr2=0x7f8074199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f8074199860 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8064004270 tx=0x7f80640042a0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 shutdown_connections 2024-09-10T23:54:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807410d140 0x7f807419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80600b53a0 0x7f80600b7860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8074104600 0x7f8074199860 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.444+0000 7f807bd6a640 1 --2- 172.21.15.19:0/2782690010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8074103ce0 0x7f8074199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.445+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 >> 172.21.15.19:0/2782690010 conn(0x7f80740fd720 msgr2=0x7f80740fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.445+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 shutdown_connections 2024-09-10T23:54:15.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:15.445+0000 7f807bd6a640 1 -- 172.21.15.19:0/2782690010 wait complete. 2024-09-10T23:54:15.541 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi019') 2024-09-10T23:54:15.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:15 smithi019 ceph-mon[30859]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:15.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:15 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4229746605' entity='client.admin' 2024-09-10T23:54:15.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:15 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2782690010' entity='client.admin' 2024-09-10T23:54:15.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:15 smithi131 ceph-mon[35491]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:15.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:15 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4229746605' entity='client.admin' 2024-09-10T23:54:15.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:15 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2782690010' entity='client.admin' 2024-09-10T23:54:15.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:15 smithi135 ceph-mon[35432]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:15.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:15 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4229746605' entity='client.admin' 2024-09-10T23:54:15.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:15 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2782690010' entity='client.admin' 2024-09-10T23:54:16.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 -- 172.21.15.19:0/893260975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88941045c0 msgr2=0x7f889410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 --2- 172.21.15.19:0/893260975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88941045c0 0x7f889410cab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8888009900 tx=0x7f888802a410 comp rx=0 tx=0).stop 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 -- 172.21.15.19:0/893260975 shutdown_connections 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 --2- 172.21.15.19:0/893260975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f889410d100 0x7f889410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 --2- 172.21.15.19:0/893260975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88941045c0 0x7f889410cab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 --2- 172.21.15.19:0/893260975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8894103ca0 0x7f8894104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 -- 172.21.15.19:0/893260975 >> 172.21.15.19:0/893260975 conn(0x7f88940fd700 msgr2=0x7f88940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 -- 172.21.15.19:0/893260975 shutdown_connections 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 -- 172.21.15.19:0/893260975 wait complete. 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.417+0000 7f889b1a7640 1 Processor -- start 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f889b1a7640 1 -- start start 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f889b1a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8894103ca0 0x7f8894101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f889b1a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88941045c0 0x7f8894101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f889b1a7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f889410d100 0x7f88941023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f889b1a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8894112d70 con 0x7f8894103ca0 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f889b1a7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8894112bf0 con 0x7f88941045c0 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f889b1a7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8894112ef0 con 0x7f889410d100 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8894103ca0 0x7f8894101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8894103ca0 0x7f8894101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49268/0 (socket says 172.21.15.19:49268) 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 -- 172.21.15.19:0/4286925697 learned_addr learned my addr 172.21.15.19:0/4286925697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8899744640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f889410d100 0x7f88941023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8893fff640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88941045c0 0x7f8894101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 -- 172.21.15.19:0/4286925697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f889410d100 msgr2=0x7f88941023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f889410d100 0x7f88941023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 -- 172.21.15.19:0/4286925697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88941045c0 msgr2=0x7f8894101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88941045c0 0x7f8894101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 -- 172.21.15.19:0/4286925697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88941a76a0 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.418+0000 7f8898f43640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8894103ca0 0x7f8894101950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f888400c920 tx=0x7f888400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.419+0000 7f8891ffb640 1 -- 172.21.15.19:0/4286925697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884007c70 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.419+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88941a7990 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.419+0000 7f8891ffb640 1 -- 172.21.15.19:0/4286925697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8884007e10 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.419+0000 7f8891ffb640 1 -- 172.21.15.19:0/4286925697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884018820 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.419+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941a7ea0 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.420+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8894104080 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.422+0000 7f8891ffb640 1 -- 172.21.15.19:0/4286925697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f888400f450 con 0x7f8894103ca0 2024-09-10T23:54:16.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.422+0000 7f8891ffb640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f887c0b52a0 0x7f887c0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.422+0000 7f8893fff640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f887c0b52a0 0x7f887c0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.422+0000 7f8891ffb640 1 -- 172.21.15.19:0/4286925697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f88840e4170 con 0x7f8894103ca0 2024-09-10T23:54:16.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.423+0000 7f8893fff640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f887c0b52a0 0x7f887c0b7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8888000c00 tx=0x7f8888031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:16.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.426+0000 7f8891ffb640 1 -- 172.21.15.19:0/4286925697 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8884014030 con 0x7f8894103ca0 2024-09-10T23:54:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.616+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f889402e5c0 con 0x7f8894103ca0 2024-09-10T23:54:16.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.619+0000 7f8891ffb640 1 -- 172.21.15.19:0/4286925697 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f88840acc30 con 0x7f8894103ca0 2024-09-10T23:54:16.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f887c0b52a0 msgr2=0x7f887c0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f887c0b52a0 0x7f887c0b7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8888000c00 tx=0x7f8888031400 comp rx=0 tx=0).stop 2024-09-10T23:54:16.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8894103ca0 msgr2=0x7f8894101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8894103ca0 0x7f8894101950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f888400c920 tx=0x7f888400cde0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 shutdown_connections 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f889410d100 0x7f88941023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88941045c0 0x7f8894101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f887c0b52a0 0x7f887c0b7760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.621+0000 7f889b1a7640 1 --2- 172.21.15.19:0/4286925697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8894103ca0 0x7f8894101950 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.622+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 >> 172.21.15.19:0/4286925697 conn(0x7f88940fd700 msgr2=0x7f88940fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.622+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 shutdown_connections 2024-09-10T23:54:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:16.622+0000 7f889b1a7640 1 -- 172.21.15.19:0/4286925697 wait complete. 2024-09-10T23:54:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi019') 2024-09-10T23:54:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi019') 2024-09-10T23:54:17.892 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:17 smithi019 ceph-mon[30859]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:17.892 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:17 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4286925697' entity='client.admin' 2024-09-10T23:54:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 -- 172.21.15.19:0/1258944202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25401076c0 msgr2=0x7f2540107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1258944202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25401076c0 0x7f2540107b00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f253402a410 comp rx=0 tx=0).stop 2024-09-10T23:54:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 -- 172.21.15.19:0/1258944202 shutdown_connections 2024-09-10T23:54:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1258944202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2540108040 0x7f254010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1258944202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25401076c0 0x7f2540107b00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1258944202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540101cb0 0x7f2540102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 -- 172.21.15.19:0/1258944202 >> 172.21.15.19:0/1258944202 conn(0x7f25400fd700 msgr2=0x7f25400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 -- 172.21.15.19:0/1258944202 shutdown_connections 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 -- 172.21.15.19:0/1258944202 wait complete. 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.550+0000 7f2545fcd640 1 Processor -- start 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f2545fcd640 1 -- start start 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f2545fcd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540101cb0 0x7f254019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f2545fcd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25401076c0 0x7f254019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f2545fcd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540108040 0x7f254019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f2545fcd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2540111d50 con 0x7f2540101cb0 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f2545fcd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2540111bd0 con 0x7f2540108040 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f2545fcd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2540111ed0 con 0x7f25401076c0 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540101cb0 0x7f254019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540101cb0 0x7f254019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40344/0 (socket says 172.21.15.19:40344) 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 -- 172.21.15.19:0/1764642661 learned_addr learned my addr 172.21.15.19:0/1764642661 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253ffff640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540108040 0x7f254019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253effd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25401076c0 0x7f254019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 -- 172.21.15.19:0/1764642661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25401076c0 msgr2=0x7f254019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25401076c0 0x7f254019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 -- 172.21.15.19:0/1764642661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540108040 msgr2=0x7f254019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540108040 0x7f254019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253f7fe640 1 -- 172.21.15.19:0/1764642661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25401a5500 con 0x7f2540101cb0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.551+0000 7f253effd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25401076c0 0x7f254019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.552+0000 7f253f7fe640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540101cb0 0x7f254019a120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f253000e9f0 tx=0x7f253000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.552+0000 7f253cff9640 1 -- 172.21.15.19:0/1764642661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253000cd80 con 0x7f2540101cb0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.552+0000 7f253cff9640 1 -- 172.21.15.19:0/1764642661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25300108e0 con 0x7f2540101cb0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.552+0000 7f253cff9640 1 -- 172.21.15.19:0/1764642661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530018980 con 0x7f2540101cb0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.552+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25401a57f0 con 0x7f2540101cb0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.552+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25401a5cb0 con 0x7f2540101cb0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.553+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2540102090 con 0x7f2540101cb0 2024-09-10T23:54:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.553+0000 7f253cff9640 1 -- 172.21.15.19:0/1764642661 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f2530010430 con 0x7f2540101cb0 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.554+0000 7f253cff9640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f252807a440 0x7f252807c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.554+0000 7f253cff9640 1 -- 172.21.15.19:0/1764642661 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f253009c1c0 con 0x7f2540101cb0 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.554+0000 7f253effd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f252807a440 0x7f252807c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.555+0000 7f253effd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f252807a440 0x7f252807c900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2534000c00 tx=0x7f2534004300 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.558+0000 7f253cff9640 1 -- 172.21.15.19:0/1764642661 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2530064890 con 0x7f2540101cb0 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.748+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f254002e5c0 con 0x7f2540101cb0 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.751+0000 7f253cff9640 1 -- 172.21.15.19:0/1764642661 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v22)=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7f25300692c0 con 0x7f2540101cb0 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f252807a440 msgr2=0x7f252807c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f252807a440 0x7f252807c900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2534000c00 tx=0x7f2534004300 comp rx=0 tx=0).stop 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540101cb0 msgr2=0x7f254019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540101cb0 0x7f254019a120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f253000e9f0 tx=0x7f253000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 shutdown_connections 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2540108040 0x7f254019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25401076c0 0x7f254019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f252807a440 0x7f252807c900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 --2- 172.21.15.19:0/1764642661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2540101cb0 0x7f254019a120 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 >> 172.21.15.19:0/1764642661 conn(0x7f25400fd700 msgr2=0x7f25400ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 shutdown_connections 2024-09-10T23:54:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:06.754+0000 7f2545fcd640 1 -- 172.21.15.19:0/1764642661 wait complete. 2024-09-10T23:54:17.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:17 smithi135 ceph-mon[35432]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:17.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:17 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4286925697' entity='client.admin' 2024-09-10T23:54:18.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 -- 172.21.15.19:0/2596954219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f0103ca0 msgr2=0x7f25f0104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:18.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 --2- 172.21.15.19:0/2596954219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f0103ca0 0x7f25f0104080 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009900 tx=0x7f25e802a410 comp rx=0 tx=0).stop 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 -- 172.21.15.19:0/2596954219 shutdown_connections 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 --2- 172.21.15.19:0/2596954219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f010d100 0x7f25f010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 --2- 172.21.15.19:0/2596954219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25f01045c0 0x7f25f010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 --2- 172.21.15.19:0/2596954219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f0103ca0 0x7f25f0104080 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 -- 172.21.15.19:0/2596954219 >> 172.21.15.19:0/2596954219 conn(0x7f25f00fd700 msgr2=0x7f25f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 -- 172.21.15.19:0/2596954219 shutdown_connections 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 -- 172.21.15.19:0/2596954219 wait complete. 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 Processor -- start 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.890+0000 7f25f8184640 1 -- start start 2024-09-10T23:54:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f8184640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f0103ca0 0x7f25f01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f8184640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25f01045c0 0x7f25f01997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f8184640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f010d100 0x7f25f019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f8184640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0112e20 con 0x7f25f010d100 2024-09-10T23:54:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f8184640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0112ca0 con 0x7f25f0103ca0 2024-09-10T23:54:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f8184640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0112fa0 con 0x7f25f01045c0 2024-09-10T23:54:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f010d100 0x7f25f019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f010d100 0x7f25f019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49310/0 (socket says 172.21.15.19:49310) 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 -- 172.21.15.19:0/3950540876 learned_addr learned my addr 172.21.15.19:0/3950540876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f571f640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25f01045c0 0x7f25f01997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f5f20640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f0103ca0 0x7f25f01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 -- 172.21.15.19:0/3950540876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25f01045c0 msgr2=0x7f25f01997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25f01045c0 0x7f25f01997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 -- 172.21.15.19:0/3950540876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f0103ca0 msgr2=0x7f25f01992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f0103ca0 0x7f25f01992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 -- 172.21.15.19:0/3950540876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f019f360 con 0x7f25f010d100 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f571f640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25f01045c0 0x7f25f01997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25f6721640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f010d100 0x7f25f019eb90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00cce0 tx=0x7f25ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.891+0000 7f25e6ffd640 1 -- 172.21.15.19:0/3950540876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00f450 con 0x7f25f010d100 2024-09-10T23:54:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.892+0000 7f25e6ffd640 1 -- 172.21.15.19:0/3950540876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25ec00faa0 con 0x7f25f010d100 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.892+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f019f650 con 0x7f25f010d100 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.892+0000 7f25e6ffd640 1 -- 172.21.15.19:0/3950540876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec018b70 con 0x7f25f010d100 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.892+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01a5d90 con 0x7f25f010d100 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.893+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f0104080 con 0x7f25f010d100 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.894+0000 7f25e6ffd640 1 -- 172.21.15.19:0/3950540876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f25ec00f5f0 con 0x7f25f010d100 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.895+0000 7f25e6ffd640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25dc0b52a0 0x7f25dc0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.895+0000 7f25f5f20640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25dc0b52a0 0x7f25dc0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.895+0000 7f25e6ffd640 1 -- 172.21.15.19:0/3950540876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f25ec0e47e0 con 0x7f25f010d100 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.895+0000 7f25f5f20640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25dc0b52a0 0x7f25dc0b7760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25e8000c00 tx=0x7f25e8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.899+0000 7f25e6ffd640 1 -- 172.21.15.19:0/3950540876 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25ec014030 con 0x7f25f010d100 2024-09-10T23:54:18.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:17 smithi131 ceph-mon[35491]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:18.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:17 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4286925697' entity='client.admin' 2024-09-10T23:54:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.088+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f25f01a60f0 con 0x7f25f010d100 2024-09-10T23:54:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.092+0000 7f25e6ffd640 1 -- 172.21.15.19:0/3950540876 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7f25ec0ad2a0 con 0x7f25f010d100 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25dc0b52a0 msgr2=0x7f25dc0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25dc0b52a0 0x7f25dc0b7760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25e8000c00 tx=0x7f25e8031400 comp rx=0 tx=0).stop 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f010d100 msgr2=0x7f25f019eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f010d100 0x7f25f019eb90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00cce0 tx=0x7f25ec00a620 comp rx=0 tx=0).stop 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 shutdown_connections 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25dc0b52a0 0x7f25dc0b7760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f010d100 0x7f25f019eb90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25f01045c0 0x7f25f01997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 --2- 172.21.15.19:0/3950540876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f0103ca0 0x7f25f01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:18.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 >> 172.21.15.19:0/3950540876 conn(0x7f25f00fd700 msgr2=0x7f25f010f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:18.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 shutdown_connections 2024-09-10T23:54:18.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:18.094+0000 7f25f8184640 1 -- 172.21.15.19:0/3950540876 wait complete. 2024-09-10T23:54:18.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:18 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3779311456' entity='client.admin' 2024-09-10T23:54:18.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:18 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3950540876' entity='client.admin' 2024-09-10T23:54:19.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:18 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3779311456' entity='client.admin' 2024-09-10T23:54:19.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:18 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3950540876' entity='client.admin' 2024-09-10T23:54:19.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:18 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3779311456' entity='client.admin' 2024-09-10T23:54:19.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:18 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3950540876' entity='client.admin' 2024-09-10T23:54:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 -- 172.21.15.19:0/4241895223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf641087d0 msgr2=0x7fdf64108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 --2- 172.21.15.19:0/4241895223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf641087d0 0x7fdf64108c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009ca0 tx=0x7fdf5802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 -- 172.21.15.19:0/4241895223 shutdown_connections 2024-09-10T23:54:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 --2- 172.21.15.19:0/4241895223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf64109150 0x7fdf6410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 --2- 172.21.15.19:0/4241895223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf641087d0 0x7fdf64108c10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 --2- 172.21.15.19:0/4241895223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf64102dc0 0x7fdf641031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 -- 172.21.15.19:0/4241895223 >> 172.21.15.19:0/4241895223 conn(0x7fdf640fe830 msgr2=0x7fdf64100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.175+0000 7fdf699ab640 1 -- 172.21.15.19:0/4241895223 shutdown_connections 2024-09-10T23:54:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.176+0000 7fdf699ab640 1 -- 172.21.15.19:0/4241895223 wait complete. 2024-09-10T23:54:20.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.176+0000 7fdf699ab640 1 Processor -- start 2024-09-10T23:54:20.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.176+0000 7fdf699ab640 1 -- start start 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf699ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf64102dc0 0x7fdf640754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf699ab640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf641087d0 0x7fdf640759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf699ab640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf64109150 0x7fdf64075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf699ab640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf64112df0 con 0x7fdf64102dc0 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf699ab640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf64112c70 con 0x7fdf64109150 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf699ab640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf64112f70 con 0x7fdf641087d0 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf64102dc0 0x7fdf640754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf64102dc0 0x7fdf640754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49328/0 (socket says 172.21.15.19:49328) 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 -- 172.21.15.19:0/469265024 learned_addr learned my addr 172.21.15.19:0/469265024 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf627fc640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf641087d0 0x7fdf640759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf637fe640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf64109150 0x7fdf64075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 -- 172.21.15.19:0/469265024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf641087d0 msgr2=0x7fdf640759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf641087d0 0x7fdf640759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 -- 172.21.15.19:0/469265024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf64109150 msgr2=0x7fdf64075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf64109150 0x7fdf64075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 -- 172.21.15.19:0/469265024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf641a7600 con 0x7fdf64102dc0 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf637fe640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf64109150 0x7fdf64075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.177+0000 7fdf62ffd640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf64102dc0 0x7fdf640754a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c920 tx=0x7fdf5400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.178+0000 7fdf689a9640 1 -- 172.21.15.19:0/469265024 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54007c70 con 0x7fdf64102dc0 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.178+0000 7fdf689a9640 1 -- 172.21.15.19:0/469265024 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf54007e10 con 0x7fdf64102dc0 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.178+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf641a78f0 con 0x7fdf64102dc0 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.178+0000 7fdf689a9640 1 -- 172.21.15.19:0/469265024 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54018820 con 0x7fdf64102dc0 2024-09-10T23:54:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.178+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf641a7e50 con 0x7fdf64102dc0 2024-09-10T23:54:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.179+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf641031a0 con 0x7fdf64102dc0 2024-09-10T23:54:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.180+0000 7fdf689a9640 1 -- 172.21.15.19:0/469265024 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fdf5400f450 con 0x7fdf64102dc0 2024-09-10T23:54:20.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.181+0000 7fdf689a9640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdf4c0b5320 0x7fdf4c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.181+0000 7fdf627fc640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdf4c0b5320 0x7fdf4c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.181+0000 7fdf689a9640 1 -- 172.21.15.19:0/469265024 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdf540e43a0 con 0x7fdf64102dc0 2024-09-10T23:54:20.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.182+0000 7fdf627fc640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdf4c0b5320 0x7fdf4c0b77e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdf58006010 tx=0x7fdf580093a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:20.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.185+0000 7fdf689a9640 1 -- 172.21.15.19:0/469265024 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf54014030 con 0x7fdf64102dc0 2024-09-10T23:54:20.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:20 smithi019 ceph-mon[30859]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:20.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.373+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fdf640767a0 con 0x7fdf64102dc0 2024-09-10T23:54:20.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.377+0000 7fdf689a9640 1 -- 172.21.15.19:0/469265024 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v34)=0 v34) ==== 125+0+0 (secure 0 0 0) 0x7fdf540aced0 con 0x7fdf64102dc0 2024-09-10T23:54:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdf4c0b5320 msgr2=0x7fdf4c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdf4c0b5320 0x7fdf4c0b77e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdf58006010 tx=0x7fdf580093a0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf64102dc0 msgr2=0x7fdf640754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf64102dc0 0x7fdf640754a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c920 tx=0x7fdf5400cde0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 shutdown_connections 2024-09-10T23:54:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf64109150 0x7fdf64075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf641087d0 0x7fdf640759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdf4c0b5320 0x7fdf4c0b77e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 --2- 172.21.15.19:0/469265024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf64102dc0 0x7fdf640754a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 >> 172.21.15.19:0/469265024 conn(0x7fdf640fe830 msgr2=0x7fdf64100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 shutdown_connections 2024-09-10T23:54:20.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:20.379+0000 7fdf699ab640 1 -- 172.21.15.19:0/469265024 wait complete. 2024-09-10T23:54:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:20 smithi135 ceph-mon[35432]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:20 smithi131 ceph-mon[35491]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 -- 172.21.15.19:0/1533860717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b010d100 msgr2=0x7f16b010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 --2- 172.21.15.19:0/1533860717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b010d100 0x7f16b010f560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009ca0 tx=0x7f16a802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 -- 172.21.15.19:0/1533860717 shutdown_connections 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 --2- 172.21.15.19:0/1533860717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b010d100 0x7f16b010f560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 --2- 172.21.15.19:0/1533860717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16b01045c0 0x7f16b010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 --2- 172.21.15.19:0/1533860717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16b0103ca0 0x7f16b0104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 -- 172.21.15.19:0/1533860717 >> 172.21.15.19:0/1533860717 conn(0x7f16b00fd700 msgr2=0x7f16b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 -- 172.21.15.19:0/1533860717 shutdown_connections 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 -- 172.21.15.19:0/1533860717 wait complete. 2024-09-10T23:54:20.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.447+0000 7f16b7534640 1 Processor -- start 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b7534640 1 -- start start 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b7534640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16b0103ca0 0x7f16b0101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b7534640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b01045c0 0x7f16b0101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b7534640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16b010d100 0x7f16b01023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b7534640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112d70 con 0x7f16b01045c0 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b7534640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112bf0 con 0x7f16b010d100 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b7534640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112ef0 con 0x7f16b0103ca0 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b01045c0 0x7f16b0101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b01045c0 0x7f16b0101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49286/0 (socket says 172.21.15.19:49286) 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 -- 172.21.15.19:0/3779311456 learned_addr learned my addr 172.21.15.19:0/3779311456 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b52d0640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16b0103ca0 0x7f16b0101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 -- 172.21.15.19:0/3779311456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16b0103ca0 msgr2=0x7f16b0101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16b0103ca0 0x7f16b0101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b5ad1640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16b010d100 0x7f16b01023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 -- 172.21.15.19:0/3779311456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16b010d100 msgr2=0x7f16b01023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16b010d100 0x7f16b01023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 -- 172.21.15.19:0/3779311456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b01a7600 con 0x7f16b01045c0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b52d0640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16b0103ca0 0x7f16b0101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16b4acf640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b01045c0 0x7f16b0101e90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16a000d6b0 tx=0x7f16a000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.448+0000 7f16a67fc640 1 -- 172.21.15.19:0/3779311456 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0017070 con 0x7f16b01045c0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.449+0000 7f16a67fc640 1 -- 172.21.15.19:0/3779311456 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16a0010460 con 0x7f16b01045c0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.449+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b01a78f0 con 0x7f16b01045c0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.449+0000 7f16a67fc640 1 -- 172.21.15.19:0/3779311456 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a000f620 con 0x7f16b01045c0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.449+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b01a7e30 con 0x7f16b01045c0 2024-09-10T23:54:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.449+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b0104080 con 0x7f16b01045c0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.451+0000 7f16a67fc640 1 -- 172.21.15.19:0/3779311456 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f16a0010930 con 0x7f16b01045c0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.452+0000 7f16a67fc640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f169c0b5320 0x7f169c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.452+0000 7f16b52d0640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f169c0b5320 0x7f169c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.452+0000 7f16a67fc640 1 -- 172.21.15.19:0/3779311456 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f16a00e3cd0 con 0x7f16b01045c0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.452+0000 7f16b52d0640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f169c0b5320 0x7f169c0b77e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00abe0 tx=0x7f16ac00a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.454+0000 7f16a67fc640 1 -- 172.21.15.19:0/3779311456 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f16a00ac810 con 0x7f16b01045c0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.641+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f16b0102c50 con 0x7f16b01045c0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.644+0000 7f16a67fc640 1 -- 172.21.15.19:0/3779311456 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v32)=0 v32) ==== 127+0+0 (secure 0 0 0) 0x7f16a00ac110 con 0x7f16b01045c0 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f169c0b5320 msgr2=0x7f169c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f169c0b5320 0x7f169c0b77e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00abe0 tx=0x7f16ac00a5c0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b01045c0 msgr2=0x7f16b0101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b01045c0 0x7f16b0101e90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16a000d6b0 tx=0x7f16a000db70 comp rx=0 tx=0).stop 2024-09-10T23:54:20.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 shutdown_connections 2024-09-10T23:54:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16b010d100 0x7f16b01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f169c0b5320 0x7f169c0b77e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16b01045c0 0x7f16b0101e90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 --2- 172.21.15.19:0/3779311456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16b0103ca0 0x7f16b0101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 >> 172.21.15.19:0/3779311456 conn(0x7f16b00fd700 msgr2=0x7f16b010f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 shutdown_connections 2024-09-10T23:54:20.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:17.646+0000 7f16b7534640 1 -- 172.21.15.19:0/3779311456 wait complete. 2024-09-10T23:54:21.402 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.402 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.404 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.404 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:21 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/469265024' entity='client.admin' 2024-09-10T23:54:21.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:21 smithi019 ceph-mon[30859]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.555+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/2111384834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08109150 msgr2=0x7f8a0810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.555+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/2111384834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08109150 0x7f8a0810f950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009ca0 tx=0x7f8a0002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/2111384834 shutdown_connections 2024-09-10T23:54:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/2111384834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08109150 0x7f8a0810f950 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/2111384834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a081087d0 0x7f8a08108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/2111384834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a08102dc0 0x7f8a081031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/2111384834 >> 172.21.15.19:0/2111384834 conn(0x7f8a080fe830 msgr2=0x7f8a08100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/2111384834 shutdown_connections 2024-09-10T23:54:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/2111384834 wait complete. 2024-09-10T23:54:21.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.556+0000 7f8a0e3a0640 1 Processor -- start 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0e3a0640 1 -- start start 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0e3a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08102dc0 0x7f8a08199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0e3a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a081087d0 0x7f8a08199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0e3a0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a08109150 0x7f8a0819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0e3a0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08112e60 con 0x7f8a08102dc0 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0e3a0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08112ce0 con 0x7f8a08109150 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0e3a0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08112fe0 con 0x7f8a081087d0 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08102dc0 0x7f8a08199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08102dc0 0x7f8a08199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44976/0 (socket says 172.21.15.19:44976) 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 -- 172.21.15.19:0/1037319421 learned_addr learned my addr 172.21.15.19:0/1037319421 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a077fe640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a081087d0 0x7f8a08199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a0c93d640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a08109150 0x7f8a0819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 -- 172.21.15.19:0/1037319421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a081087d0 msgr2=0x7f8a08199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a081087d0 0x7f8a08199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 -- 172.21.15.19:0/1037319421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a08109150 msgr2=0x7f8a0819eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a08109150 0x7f8a0819eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.557+0000 7f8a07fff640 1 -- 172.21.15.19:0/1037319421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0819f2e0 con 0x7f8a08102dc0 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.558+0000 7f8a07fff640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08102dc0 0x7f8a08199230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c920 tx=0x7f89f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.558+0000 7f8a057fa640 1 -- 172.21.15.19:0/1037319421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8007c70 con 0x7f8a08102dc0 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.558+0000 7f8a057fa640 1 -- 172.21.15.19:0/1037319421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f8007e10 con 0x7f8a08102dc0 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.558+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0819f5d0 con 0x7f8a08102dc0 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.558+0000 7f8a057fa640 1 -- 172.21.15.19:0/1037319421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8018820 con 0x7f8a08102dc0 2024-09-10T23:54:21.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.558+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a081a5d10 con 0x7f8a08102dc0 2024-09-10T23:54:21.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.559+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a081031a0 con 0x7f8a08102dc0 2024-09-10T23:54:21.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.561+0000 7f8a057fa640 1 -- 172.21.15.19:0/1037319421 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f89f800f450 con 0x7f8a08102dc0 2024-09-10T23:54:21.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.561+0000 7f8a057fa640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89f00b52a0 0x7f89f00b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.562+0000 7f8a077fe640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89f00b52a0 0x7f89f00b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.562+0000 7f8a057fa640 1 -- 172.21.15.19:0/1037319421 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f89f80e4470 con 0x7f8a08102dc0 2024-09-10T23:54:21.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.562+0000 7f8a077fe640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89f00b52a0 0x7f89f00b7760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a08107160 tx=0x7f89fc008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.564+0000 7f8a057fa640 1 -- 172.21.15.19:0/1037319421 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f89f8014030 con 0x7f8a08102dc0 2024-09-10T23:54:21.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:21 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/469265024' entity='client.admin' 2024-09-10T23:54:21.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:21 smithi135 ceph-mon[35432]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.754+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8a0819a360 con 0x7f8a08102dc0 2024-09-10T23:54:21.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.758+0000 7f8a057fa640 1 -- 172.21.15.19:0/1037319421 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f89f80acfc0 con 0x7f8a08102dc0 2024-09-10T23:54:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89f00b52a0 msgr2=0x7f89f00b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89f00b52a0 0x7f89f00b7760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a08107160 tx=0x7f89fc008040 comp rx=0 tx=0).stop 2024-09-10T23:54:21.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08102dc0 msgr2=0x7f8a08199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08102dc0 0x7f8a08199230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c920 tx=0x7f89f800cde0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 shutdown_connections 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a08109150 0x7f8a0819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a081087d0 0x7f8a08199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89f00b52a0 0x7f89f00b7760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 --2- 172.21.15.19:0/1037319421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08102dc0 0x7f8a08199230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 >> 172.21.15.19:0/1037319421 conn(0x7f8a080fe830 msgr2=0x7f8a08100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 shutdown_connections 2024-09-10T23:54:21.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:21.760+0000 7f8a0e3a0640 1 -- 172.21.15.19:0/1037319421 wait complete. 2024-09-10T23:54:21.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:21 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/469265024' entity='client.admin' 2024-09-10T23:54:21.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:21 smithi131 ceph-mon[35491]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:21.991 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi019') 2024-09-10T23:54:21.991 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi019') 2024-09-10T23:54:22.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:22 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1037319421' entity='client.admin' 2024-09-10T23:54:23.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:22 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1037319421' entity='client.admin' 2024-09-10T23:54:23.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:22 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1037319421' entity='client.admin' 2024-09-10T23:54:24.010 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi019') 2024-09-10T23:54:24.010 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi019') 2024-09-10T23:54:24.010 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '8be8ba00-6fcf-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi019') 2024-09-10T23:54:24.010 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T23:54:24.011 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T23:54:24.011 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:54:24.030 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:54:24.030 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-09-10T23:54:24.087 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 23:53:06.172543531 +0000 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 23:48:10.712072439 +0000 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 23:48:10.712072439 +0000 2024-09-10T23:54:24.088 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 23:48:10.712072439 +0000 2024-09-10T23:54:24.088 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:54:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T23:54:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T23:54:24.156 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000203117 s, 2.5 MB/s 2024-09-10T23:54:24.157 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:54:24.216 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-09-10T23:54:24.272 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:54:24.272 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T23:54:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 23:53:06.199543297 +0000 2024-09-10T23:54:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 23:48:11.074069360 +0000 2024-09-10T23:54:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 23:48:11.074069360 +0000 2024-09-10T23:54:24.273 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 23:48:11.074069360 +0000 2024-09-10T23:54:24.273 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:24.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:23 smithi019 ceph-mon[30859]: Reconfiguring daemon mon.b on smithi131 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:23 smithi131 ceph-mon[35491]: Reconfiguring daemon mon.b on smithi131 2024-09-10T23:54:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T23:54:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T23:54:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000256598 s, 2.0 MB/s 2024-09-10T23:54:24.340 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:54:24.398 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-09-10T23:54:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:54:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:54:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:54:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:24.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:23 smithi135 ceph-mon[35432]: Reconfiguring daemon mon.b on smithi131 2024-09-10T23:54:24.455 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:54:24.455 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:24.455 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T23:54:24.455 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:24.456 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:24.456 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 23:53:06.227543055 +0000 2024-09-10T23:54:24.456 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 23:48:11.410066500 +0000 2024-09-10T23:54:24.456 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 23:48:11.410066500 +0000 2024-09-10T23:54:24.456 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 23:48:11.410066500 +0000 2024-09-10T23:54:24.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:54:24.519 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T23:54:24.519 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T23:54:24.519 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000214726 s, 2.4 MB/s 2024-09-10T23:54:24.521 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:54:24.578 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-09-10T23:54:24.634 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:54:24.634 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:24.634 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T23:54:24.634 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:24.634 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:24.635 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 23:53:06.261542760 +0000 2024-09-10T23:54:24.635 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 23:48:11.863062646 +0000 2024-09-10T23:54:24.635 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 23:48:11.863062646 +0000 2024-09-10T23:54:24.635 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 23:48:11.863062646 +0000 2024-09-10T23:54:24.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:54:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T23:54:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T23:54:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000232872 s, 2.2 MB/s 2024-09-10T23:54:24.700 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:54:24.757 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T23:54:24.757 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:54:24.775 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:54:24.775 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-09-10T23:54:24.833 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:54:24.833 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:24.833 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T23:54:24.833 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:24.833 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:24.834 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 23:54:00.984327509 +0000 2024-09-10T23:54:24.834 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 23:48:21.878438183 +0000 2024-09-10T23:54:24.834 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 23:48:21.878438183 +0000 2024-09-10T23:54:24.834 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 23:48:21.878438183 +0000 2024-09-10T23:54:24.835 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:54:24.900 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T23:54:24.900 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T23:54:24.900 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00029393 s, 1.7 MB/s 2024-09-10T23:54:24.902 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:54:24.959 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 23:54:00.984327509 +0000 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 23:48:22.194430925 +0000 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 23:48:22.194430925 +0000 2024-09-10T23:54:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 23:48:22.194430925 +0000 2024-09-10T23:54:25.016 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:54:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T23:54:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T23:54:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.0002119 s, 2.4 MB/s 2024-09-10T23:54:25.081 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:54:25.138 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-09-10T23:54:25.193 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 23:54:00.984327509 +0000 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 23:48:22.526423300 +0000 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 23:48:22.526423300 +0000 2024-09-10T23:54:25.194 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 23:48:22.526423300 +0000 2024-09-10T23:54:25.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:54:25.258 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T23:54:25.258 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T23:54:25.258 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000176754 s, 2.9 MB/s 2024-09-10T23:54:25.259 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:54:25.315 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-09-10T23:54:25.370 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:54:25.370 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:25.371 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T23:54:25.371 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:25.371 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:25.371 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 23:54:00.985327487 +0000 2024-09-10T23:54:25.371 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 23:48:22.850415858 +0000 2024-09-10T23:54:25.371 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 23:48:22.850415858 +0000 2024-09-10T23:54:25.371 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 23:48:22.850415858 +0000 2024-09-10T23:54:25.371 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:54:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T23:54:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T23:54:25.434 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000225913 s, 2.3 MB/s 2024-09-10T23:54:25.437 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:54:25.493 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T23:54:25.493 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:54:25.510 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:54:25.510 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-10T23:54:25.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:25.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:25.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:54:25.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:54:25.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:54:25.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:25.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: Reconfiguring daemon mon.c on smithi135 2024-09-10T23:54:25.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:25 smithi131 ceph-mon[35491]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 23:53:58.773980951 +0000 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 23:48:50.898951512 +0000 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 23:48:50.898951512 +0000 2024-09-10T23:54:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 23:48:50.898951512 +0000 2024-09-10T23:54:25.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:54:25.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:25.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:25.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:54:25.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:54:25.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:54:25.632 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:25.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: Reconfiguring daemon mon.c on smithi135 2024-09-10T23:54:25.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:25 smithi135 ceph-mon[35432]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:25.635 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T23:54:25.635 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T23:54:25.635 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000269772 s, 1.9 MB/s 2024-09-10T23:54:25.637 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:54:25.694 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-10T23:54:25.751 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:54:25.751 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:25.751 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-10T23:54:25.752 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:25.752 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:25.752 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 23:53:58.773980951 +0000 2024-09-10T23:54:25.752 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 23:48:51.229944370 +0000 2024-09-10T23:54:25.752 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 23:48:51.229944370 +0000 2024-09-10T23:54:25.752 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 23:48:51.229944370 +0000 2024-09-10T23:54:25.752 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:54:25.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:25.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:25.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:54:25.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:54:25.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:54:25.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:25.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: Reconfiguring daemon mon.c on smithi135 2024-09-10T23:54:25.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:25 smithi019 ceph-mon[30859]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T23:54:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T23:54:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000230214 s, 2.2 MB/s 2024-09-10T23:54:25.818 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:54:25.874 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-10T23:54:25.929 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:54:25.929 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:25.929 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T23:54:25.929 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:25.929 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:25.930 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 23:53:58.773980951 +0000 2024-09-10T23:54:25.930 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 23:48:51.562937185 +0000 2024-09-10T23:54:25.930 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 23:48:51.562937185 +0000 2024-09-10T23:54:25.930 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 23:48:51.562937185 +0000 2024-09-10T23:54:25.930 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:54:25.993 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T23:54:25.993 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T23:54:25.993 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.0001953 s, 2.6 MB/s 2024-09-10T23:54:25.994 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:54:26.050 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-10T23:54:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:54:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:54:26.105 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T23:54:26.105 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:54:26.105 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:54:26.106 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 23:53:58.774980930 +0000 2024-09-10T23:54:26.106 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 23:48:51.895930000 +0000 2024-09-10T23:54:26.106 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 23:48:51.895930000 +0000 2024-09-10T23:54:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 23:48:51.895930000 +0000 2024-09-10T23:54:26.106 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:54:26.168 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T23:54:26.168 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T23:54:26.168 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000225759 s, 2.3 MB/s 2024-09-10T23:54:26.170 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:54:26.226 INFO:tasks.cephadm:Deploying osd.0 on smithi019 with /dev/vg_nvme/lv_4... 2024-09-10T23:54:26.226 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:54:26.489 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:26.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:26.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:26.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:26.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:26.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:26.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:27.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:27.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:27.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:27.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:27.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:27.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:27.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:27.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:27.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:27.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:27.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:27.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:28.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:27 smithi019 ceph-mon[30859]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:28.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:27 smithi131 ceph-mon[35491]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:27 smithi135 ceph-mon[35432]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:54:28.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_4 2024-09-10T23:54:29.044 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.465+0000 7fd54a612640 1 -- 172.21.15.19:0/3344753740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd544109150 msgr2=0x7fd54410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.465+0000 7fd54a612640 1 --2- 172.21.15.19:0/3344753740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd544109150 0x7fd54410f950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009ca0 tx=0x7fd53c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 -- 172.21.15.19:0/3344753740 shutdown_connections 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 --2- 172.21.15.19:0/3344753740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd544109150 0x7fd54410f950 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 --2- 172.21.15.19:0/3344753740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5441087d0 0x7fd544108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 --2- 172.21.15.19:0/3344753740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544102dc0 0x7fd5441031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 -- 172.21.15.19:0/3344753740 >> 172.21.15.19:0/3344753740 conn(0x7fd5440fe830 msgr2=0x7fd544100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 -- 172.21.15.19:0/3344753740 shutdown_connections 2024-09-10T23:54:29.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 -- 172.21.15.19:0/3344753740 wait complete. 2024-09-10T23:54:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 Processor -- start 2024-09-10T23:54:29.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.466+0000 7fd54a612640 1 -- start start 2024-09-10T23:54:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd54a612640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544102dc0 0x7fd54419b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd54a612640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5441087d0 0x7fd54419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd54a612640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544109150 0x7fd5441a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd54a612640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd544112e60 con 0x7fd5441087d0 2024-09-10T23:54:29.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd54a612640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd544112ce0 con 0x7fd544109150 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd54a612640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd544112fe0 con 0x7fd544102dc0 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5441087d0 0x7fd54419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5441087d0 0x7fd54419b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45000/0 (socket says 172.21.15.19:45000) 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 -- 172.21.15.19:0/2381401389 learned_addr learned my addr 172.21.15.19:0/2381401389 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd543fff640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544102dc0 0x7fd54419b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd548baf640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544109150 0x7fd5441a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 -- 172.21.15.19:0/2381401389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544102dc0 msgr2=0x7fd54419b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544102dc0 0x7fd54419b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 -- 172.21.15.19:0/2381401389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544109150 msgr2=0x7fd5441a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544109150 0x7fd5441a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 -- 172.21.15.19:0/2381401389 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5441a1540 con 0x7fd5441087d0 2024-09-10T23:54:29.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5437fe640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5441087d0 0x7fd54419b9d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b4a0 tx=0x7fd53800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.467+0000 7fd5417fa640 1 -- 172.21.15.19:0/2381401389 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538015020 con 0x7fd5441087d0 2024-09-10T23:54:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.468+0000 7fd5417fa640 1 -- 172.21.15.19:0/2381401389 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd538011ce0 con 0x7fd5441087d0 2024-09-10T23:54:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.468+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5441a1830 con 0x7fd5441087d0 2024-09-10T23:54:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.468+0000 7fd5417fa640 1 -- 172.21.15.19:0/2381401389 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538010dc0 con 0x7fd5441087d0 2024-09-10T23:54:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.468+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5441a7ef0 con 0x7fd5441087d0 2024-09-10T23:54:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.469+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5441031a0 con 0x7fd5441087d0 2024-09-10T23:54:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.470+0000 7fd5417fa640 1 -- 172.21.15.19:0/2381401389 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fd538011830 con 0x7fd5441087d0 2024-09-10T23:54:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.471+0000 7fd5417fa640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd52c0b5320 0x7fd52c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.471+0000 7fd543fff640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd52c0b5320 0x7fd52c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.471+0000 7fd5417fa640 1 -- 172.21.15.19:0/2381401389 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd5380e3ef0 con 0x7fd5441087d0 2024-09-10T23:54:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.472+0000 7fd543fff640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd52c0b5320 0x7fd52c0b77e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd53400abe0 tx=0x7fd53400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.474+0000 7fd5417fa640 1 -- 172.21.15.19:0/2381401389 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd53801f020 con 0x7fd5441087d0 2024-09-10T23:54:29.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:29.669+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd544063590 con 0x7fd52c0b5320 2024-09-10T23:54:30.088 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:29 smithi019 ceph-mon[30859]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:30.088 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:54:30.088 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:54:30.088 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:29 smithi135 ceph-mon[35432]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:54:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:54:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:29 smithi131 ceph-mon[35491]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:54:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:54:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:31.144 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:30 smithi019 ceph-mon[30859]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:31.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:30 smithi135 ceph-mon[35432]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:31.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:30 smithi131 ceph-mon[35491]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:31 smithi135 ceph-mon[35432]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:32.176 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:31 smithi019 ceph-mon[30859]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:31 smithi131 ceph-mon[35491]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/630458512' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c65b9f44-41c2-4115-8a1a-db391d0f931a"} : dispatch 2024-09-10T23:54:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/630458512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c65b9f44-41c2-4115-8a1a-db391d0f931a"}]': finished 2024-09-10T23:54:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:32 smithi135 ceph-mon[35432]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:54:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:32 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1406632540' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:54:33.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/630458512' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c65b9f44-41c2-4115-8a1a-db391d0f931a"} : dispatch 2024-09-10T23:54:33.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/630458512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c65b9f44-41c2-4115-8a1a-db391d0f931a"}]': finished 2024-09-10T23:54:33.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:32 smithi019 ceph-mon[30859]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:54:33.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:32 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:33.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1406632540' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:54:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/630458512' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c65b9f44-41c2-4115-8a1a-db391d0f931a"} : dispatch 2024-09-10T23:54:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/630458512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c65b9f44-41c2-4115-8a1a-db391d0f931a"}]': finished 2024-09-10T23:54:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:32 smithi131 ceph-mon[35491]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:54:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:32 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1406632540' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:54:34.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:33 smithi019 ceph-mon[30859]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:33 smithi131 ceph-mon[35491]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:34.342 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:33 smithi135 ceph-mon[35432]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:36.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:35 smithi019 ceph-mon[30859]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:35 smithi131 ceph-mon[35491]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:35 smithi135 ceph-mon[35432]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:38.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:37 smithi019 ceph-mon[30859]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:37 smithi131 ceph-mon[35491]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:37 smithi135 ceph-mon[35432]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:39 smithi019 ceph-mon[30859]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:54:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:39 smithi131 ceph-mon[35491]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:54:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:39 smithi135 ceph-mon[35432]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:54:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:41.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:40 smithi019 ceph-mon[30859]: Deploying daemon osd.0 on smithi019 2024-09-10T23:54:41.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:40 smithi131 ceph-mon[35491]: Deploying daemon osd.0 on smithi019 2024-09-10T23:54:41.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:40 smithi135 ceph-mon[35432]: Deploying daemon osd.0 on smithi019 2024-09-10T23:54:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:41 smithi019 ceph-mon[30859]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:41 smithi131 ceph-mon[35491]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:41 smithi135 ceph-mon[35432]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:44.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:44 smithi019 ceph-mon[30859]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:44 smithi131 ceph-mon[35491]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:44 smithi135 ceph-mon[35432]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:46.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:46 smithi019 ceph-mon[30859]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:46 smithi131 ceph-mon[35491]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:46 smithi135 ceph-mon[35432]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:47.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:47.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:47.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:47.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:47.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:47.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:48.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:48 smithi019 ceph-mon[30859]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:48 smithi131 ceph-mon[35491]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:48 smithi135 ceph-mon[35432]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:49.897 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:49 smithi019 ceph-mon[30859]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:49.897 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:49.897 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:49.897 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:49.897 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:49.897 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:49.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:49 smithi135 ceph-mon[35432]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:49.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:49.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:49.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:49.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:49.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:49 smithi131 ceph-mon[35491]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.553+0000 7fd5417fa640 1 -- 172.21.15.19:0/2381401389 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd544063590 con 0x7fd52c0b5320 2024-09-10T23:54:50.555 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 0 on host 'smithi019' 2024-09-10T23:54:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd52c0b5320 msgr2=0x7fd52c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd52c0b5320 0x7fd52c0b77e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd53400abe0 tx=0x7fd53400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5441087d0 msgr2=0x7fd54419b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5441087d0 0x7fd54419b9d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b4a0 tx=0x7fd53800b8a0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 shutdown_connections 2024-09-10T23:54:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544109150 0x7fd5441a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd52c0b5320 0x7fd52c0b77e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5441087d0 0x7fd54419b9d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.555+0000 7fd54a612640 1 --2- 172.21.15.19:0/2381401389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544102dc0 0x7fd54419b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.556+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 >> 172.21.15.19:0/2381401389 conn(0x7fd5440fe830 msgr2=0x7fd544105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.556+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 shutdown_connections 2024-09-10T23:54:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:54:50.556+0000 7fd54a612640 1 -- 172.21.15.19:0/2381401389 wait complete. 2024-09-10T23:54:50.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:50.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:50.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:50.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:50.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:50.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:51.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:51.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:51.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:51.087 DEBUG:teuthology.orchestra.run.smithi019:osd.0> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T23:54:51.089 INFO:tasks.cephadm:Deploying osd.1 on smithi131 with /dev/vg_nvme/lv_4... 2024-09-10T23:54:51.090 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:54:51.341 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:54:51.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:51 smithi131 ceph-mon[35491]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:51.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:51 smithi019 ceph-mon[30859]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:51.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:51 smithi135 ceph-mon[35432]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:52 smithi135 ceph-mon[35432]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:54:53.000 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:52 smithi131 ceph-mon[35491]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:54:53.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:52 smithi019 ceph-mon[30859]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:54:53.023 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:54:52 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0[49043]: 2024-09-10T23:54:52.598+0000 7f13f0f97640 -1 osd.0 0 log_to_monitors true 2024-09-10T23:54:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:54:53.741 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_4 2024-09-10T23:54:53.923 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:53 smithi019 ceph-mon[30859]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:53.923 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:53 smithi019 ceph-mon[30859]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:54:53.923 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:53 smithi019 ceph-mon[30859]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:54:53.924 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:53 smithi019 ceph-mon[30859]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:54:53.924 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:53 smithi135 ceph-mon[35432]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:53 smithi135 ceph-mon[35432]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:54:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:53 smithi135 ceph-mon[35432]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:54:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:53 smithi135 ceph-mon[35432]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:54:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:54:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:53 smithi131 ceph-mon[35491]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:53 smithi131 ceph-mon[35491]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:54:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:53 smithi131 ceph-mon[35491]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:54:54.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:53 smithi131 ceph-mon[35491]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:54:54.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:54.272 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0[49043]: 2024-09-10T23:54:54.086+0000 7f13ecf1a640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T23:54:54.272 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0[49043]: 2024-09-10T23:54:54.091+0000 7f13e4d39640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:54:54.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 -- 172.21.15.131:0/3597570621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 msgr2=0x7f645c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 --2- 172.21.15.131:0/3597570621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c10e820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6454009ca0 tx=0x7f645402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 -- 172.21.15.131:0/3597570621 shutdown_connections 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 --2- 172.21.15.131:0/3597570621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c10e820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 --2- 172.21.15.131:0/3597570621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f645c1076a0 0x7f645c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 --2- 172.21.15.131:0/3597570621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c101c90 0x7f645c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 -- 172.21.15.131:0/3597570621 >> 172.21.15.131:0/3597570621 conn(0x7f645c0fd700 msgr2=0x7f645c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 -- 172.21.15.131:0/3597570621 shutdown_connections 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 -- 172.21.15.131:0/3597570621 wait complete. 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 Processor -- start 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.441+0000 7f6461c31640 1 -- start start 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f6461c31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f645c101c90 0x7f645c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f6461c31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c1076a0 0x7f645c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f6461c31640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f6461c31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f645c111ce0 con 0x7f645c101c90 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f6461c31640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f645c111b60 con 0x7f645c108020 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f6461c31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f645c111e60 con 0x7f645c1076a0 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36620/0 (socket says 172.21.15.131:36620) 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 -- 172.21.15.131:0/4103526691 learned_addr learned my addr 172.21.15.131:0/4103526691 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645b7fe640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f645c101c90 0x7f645c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f6452ffd640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c1076a0 0x7f645c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 -- 172.21.15.131:0/4103526691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c1076a0 msgr2=0x7f645c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c1076a0 0x7f645c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 -- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f645c101c90 msgr2=0x7f645c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f645c101c90 0x7f645c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 -- 172.21.15.131:0/4103526691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c19f390 con 0x7f645c108020 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645b7fe640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f645c101c90 0x7f645c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:54.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.442+0000 7f645bfff640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c19ebc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6454005cc0 tx=0x7f645402f470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.443+0000 7f64597fa640 1 -- 172.21.15.131:0/4103526691 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454003cf0 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.443+0000 7f64597fa640 1 -- 172.21.15.131:0/4103526691 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64540044f0 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.443+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c19f620 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.443+0000 7f64597fa640 1 -- 172.21.15.131:0/4103526691 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645402fc30 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.443+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c1a5dc0 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.444+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645c102070 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.445+0000 7f64597fa640 1 -- 172.21.15.131:0/4103526691 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f6454004040 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.445+0000 7f64597fa640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f64480b52a0 0x7f64480b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.446+0000 7f64597fa640 1 -- 172.21.15.131:0/4103526691 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f64541055b0 con 0x7f645c108020 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.446+0000 7f645b7fe640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f64480b52a0 0x7f64480b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.446+0000 7f645b7fe640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f64480b52a0 0x7f64480b7760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f644c0058c0 tx=0x7f644c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:54.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.450+0000 7f64597fa640 1 -- 172.21.15.131:0/4103526691 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64540cdf20 con 0x7f645c108020 2024-09-10T23:54:54.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:54:54.635+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f645c06aab0 con 0x7f64480b52a0 2024-09-10T23:54:54.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi019 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:54.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:54.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' 2024-09-10T23:54:54.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:54:54.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:54:54.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:55.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:54:55.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi019 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:54:55.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:54:55.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:54:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi019 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763]' entity='osd.0' 2024-09-10T23:54:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:54:55.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:54:55.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:55.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:54:55.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:54:55.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:55.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:55.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:55.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] boot 2024-09-10T23:54:55.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:54:55.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:55.963 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:54:55.963 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:54:55.963 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:55.964 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:55.964 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:55.964 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] boot 2024-09-10T23:54:55.964 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:54:55.964 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:56.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:54:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:54:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:54:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: osd.0 [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] boot 2024-09-10T23:54:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:54:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:54:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:57 smithi135 ceph-mon[35432]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:54:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:57 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/1646601839' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"} : dispatch 2024-09-10T23:54:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:57 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"} : dispatch 2024-09-10T23:54:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:57 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"}]': finished 2024-09-10T23:54:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:57 smithi135 ceph-mon[35432]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:54:57.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:54:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:57 smithi131 ceph-mon[35491]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:54:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:57 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/1646601839' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"} : dispatch 2024-09-10T23:54:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:57 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"} : dispatch 2024-09-10T23:54:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:57 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"}]': finished 2024-09-10T23:54:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:57 smithi131 ceph-mon[35491]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:54:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:54:57.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:57 smithi019 ceph-mon[30859]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:54:57.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:57 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/1646601839' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"} : dispatch 2024-09-10T23:54:57.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:57 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"} : dispatch 2024-09-10T23:54:57.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:57 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a58b033b-2df1-4c5a-a9eb-45a186da817c"}]': finished 2024-09-10T23:54:57.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:57 smithi019 ceph-mon[30859]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:54:57.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:54:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:58 smithi135 ceph-mon[35432]: pgmap v30: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:54:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:54:58 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/403247924' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:54:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:58 smithi019 ceph-mon[30859]: pgmap v30: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:54:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:54:58 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/403247924' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:54:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:58 smithi131 ceph-mon[35491]: pgmap v30: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:54:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:54:58 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/403247924' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:55:00.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:00 smithi135 ceph-mon[35432]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:00.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:00 smithi019 ceph-mon[30859]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:00 smithi131 ceph-mon[35491]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:02.399 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:02 smithi131 ceph-mon[35491]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:02.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:02 smithi135 ceph-mon[35432]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:02.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:02 smithi019 ceph-mon[30859]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:04 smithi135 ceph-mon[35432]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:04.437 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:04 smithi131 ceph-mon[35491]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:04.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:04 smithi019 ceph-mon[30859]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:05.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:55:05.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:05.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:55:05.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:05.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:55:05.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:06.415 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:06 smithi131 ceph-mon[35491]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:06.416 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:06 smithi131 ceph-mon[35491]: Deploying daemon osd.1 on smithi131 2024-09-10T23:55:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:06 smithi135 ceph-mon[35432]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:06 smithi135 ceph-mon[35432]: Deploying daemon osd.1 on smithi131 2024-09-10T23:55:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:06 smithi019 ceph-mon[30859]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:06 smithi019 ceph-mon[30859]: Deploying daemon osd.1 on smithi131 2024-09-10T23:55:08.363 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:08 smithi131 ceph-mon[35491]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:08 smithi135 ceph-mon[35432]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:08 smithi019 ceph-mon[30859]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:10 smithi131 ceph-mon[35491]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:10 smithi135 ceph-mon[35432]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:10.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:10 smithi019 ceph-mon[30859]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:11.521 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:11.521 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:11.522 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:11.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:11.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:11.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:12.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:12 smithi019 ceph-mon[30859]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:12.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:12 smithi135 ceph-mon[35432]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:12 smithi131 ceph-mon[35491]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:14 smithi131 ceph-mon[35491]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:14 smithi135 ceph-mon[35432]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:14 smithi019 ceph-mon[30859]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:14.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:15.058 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 1 on host 'smithi131' 2024-09-10T23:55:15.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.057+0000 7f64597fa640 1 -- 172.21.15.131:0/4103526691 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f645c06aab0 con 0x7f64480b52a0 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f64480b52a0 msgr2=0x7f64480b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f64480b52a0 0x7f64480b7760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f644c0058c0 tx=0x7f644c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 msgr2=0x7f645c19ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c19ebc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6454005cc0 tx=0x7f645402f470 comp rx=0 tx=0).stop 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 shutdown_connections 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c108020 0x7f645c19ebc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c1076a0 0x7f645c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f64480b52a0 0x7f64480b7760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 --2- 172.21.15.131:0/4103526691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f645c101c90 0x7f645c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 >> 172.21.15.131:0/4103526691 conn(0x7f645c0fd700 msgr2=0x7f645c100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 shutdown_connections 2024-09-10T23:55:15.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:55:15.059+0000 7f6461c31640 1 -- 172.21.15.131:0/4103526691 wait complete. 2024-09-10T23:55:15.710 DEBUG:teuthology.orchestra.run.smithi131:osd.1> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T23:55:15.713 INFO:tasks.cephadm:Deploying osd.2 on smithi135 with /dev/vg_nvme/lv_4... 2024-09-10T23:55:15.713 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:55:15.963 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:55:16.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:16 smithi131 ceph-mon[35491]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:16.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:16 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:16.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:16 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:16.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:16 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:16.372 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:16 smithi135 ceph-mon[35432]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:16.372 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:16 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:16.372 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:16 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:16.372 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:16 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:16.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:16 smithi019 ceph-mon[30859]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:16.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:16 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:16.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:16 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:16.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:16 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:16.895 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1[41187]: 2024-09-10T23:55:16.630+0000 7f1115260640 -1 osd.1 0 log_to_monitors true 2024-09-10T23:55:17.148 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:17 smithi131 ceph-mon[35491]: from='osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:55:17.148 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:17 smithi131 ceph-mon[35491]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:55:17.262 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:17 smithi135 ceph-mon[35432]: from='osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:55:17.262 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:17 smithi135 ceph-mon[35432]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:55:17.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:17 smithi019 ceph-mon[30859]: from='osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:55:17.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:17 smithi019 ceph-mon[30859]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:55:18.155 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1[41187]: 2024-09-10T23:55:18.044+0000 7f11111e3640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T23:55:18.155 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1[41187]: 2024-09-10T23:55:18.048+0000 7f110d00a640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:55:18.155 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-mon[35491]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:18.155 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-mon[35491]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:55:18.155 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-mon[35491]: from='osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:55:18.155 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-mon[35491]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:55:18.155 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:18.156 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:18 smithi131 ceph-mon[35491]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:55:18.398 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:18 smithi135 ceph-mon[35432]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:18.398 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:18 smithi135 ceph-mon[35432]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:55:18.398 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:18 smithi135 ceph-mon[35432]: from='osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:55:18.398 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:18 smithi135 ceph-mon[35432]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:55:18.398 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:18.398 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:18 smithi135 ceph-mon[35432]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:55:18.401 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:55:18.431 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-09-10T23:55:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:18 smithi019 ceph-mon[30859]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:18 smithi019 ceph-mon[30859]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:55:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:18 smithi019 ceph-mon[30859]: from='osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:55:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:18 smithi019 ceph-mon[30859]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:55:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:18 smithi019 ceph-mon[30859]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:55:18.691 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/2656680747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf01076a0 msgr2=0x7fbcf0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/2656680747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf01076a0 0x7fbcf0107ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009900 tx=0x7fbce402a410 comp rx=0 tx=0).stop 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/2656680747 shutdown_connections 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/2656680747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf0108020 0x7fbcf010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/2656680747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf01076a0 0x7fbcf0107ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/2656680747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcf0101c90 0x7fbcf0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/2656680747 >> 172.21.15.135:0/2656680747 conn(0x7fbcf00fd700 msgr2=0x7fbcf00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/2656680747 shutdown_connections 2024-09-10T23:55:19.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/2656680747 wait complete. 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 Processor -- start 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.122+0000 7fbcf7b3f640 1 -- start start 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf7b3f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf0101c90 0x7fbcf019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf7b3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcf01076a0 0x7fbcf019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf7b3f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf0108020 0x7fbcf019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf7b3f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0111ce0 con 0x7fbcf01076a0 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf7b3f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0111b60 con 0x7fbcf0108020 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf7b3f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0111e60 con 0x7fbcf0101c90 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf0101c90 0x7fbcf019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf0101c90 0x7fbcf019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47422/0 (socket says 172.21.15.135:47422) 2024-09-10T23:55:19.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 -- 172.21.15.135:0/585499877 learned_addr learned my addr 172.21.15.135:0/585499877 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf50da640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcf01076a0 0x7fbcf019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf60dc640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf0108020 0x7fbcf019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 -- 172.21.15.135:0/585499877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf0108020 msgr2=0x7fbcf019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf0108020 0x7fbcf019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 -- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcf01076a0 msgr2=0x7fbcf019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcf01076a0 0x7fbcf019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 -- 172.21.15.135:0/585499877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf01a5490 con 0x7fbcf0101c90 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf60dc640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf0108020 0x7fbcf019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf50da640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcf01076a0 0x7fbcf019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.123+0000 7fbcf58db640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf0101c90 0x7fbcf019a0b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00d950 tx=0x7fbcec00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.124+0000 7fbce2ffd640 1 -- 172.21.15.135:0/585499877 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec017070 con 0x7fbcf0101c90 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.124+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf01a5780 con 0x7fbcf0101c90 2024-09-10T23:55:19.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.124+0000 7fbce2ffd640 1 -- 172.21.15.135:0/585499877 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcec009c30 con 0x7fbcf0101c90 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.124+0000 7fbce2ffd640 1 -- 172.21.15.135:0/585499877 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00f620 con 0x7fbcf0101c90 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.124+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf01a5ce0 con 0x7fbcf0101c90 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.125+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf0102070 con 0x7fbcf0101c90 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.126+0000 7fbce2ffd640 1 -- 172.21.15.135:0/585499877 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fbcec010460 con 0x7fbcf0101c90 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.127+0000 7fbce2ffd640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbcdc0b52a0 0x7fbcdc0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.127+0000 7fbce2ffd640 1 -- 172.21.15.135:0/585499877 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2524+0+0 (secure 0 0 0) 0x7fbcec0e4160 con 0x7fbcf0101c90 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.127+0000 7fbcf50da640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbcdc0b52a0 0x7fbcdc0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.128+0000 7fbcf50da640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbcdc0b52a0 0x7fbcdc0b7760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbce4031440 tx=0x7fbce4005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:19.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.130+0000 7fbce2ffd640 1 -- 172.21.15.135:0/585499877 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbcec0ac7a0 con 0x7fbcf0101c90 2024-09-10T23:55:19.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:19.323+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbcf0063590 con 0x7fbcdc0b52a0 2024-09-10T23:55:19.324 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:19.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:55:19.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:19.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:55:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:55:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:55:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi131 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi131 to 17088M 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] boot 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:20.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:55:20.301 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:55:20.301 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:20 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:20.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:55:20.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi131 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi131 to 17088M 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] boot 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:55:20.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:20 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:55:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:55:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:55:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi131 2024-09-10T23:55:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi131 to 17088M 2024-09-10T23:55:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: osd.1 [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] boot 2024-09-10T23:55:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:55:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:55:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:55:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:55:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:20 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:21.172 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:21 smithi135 ceph-mon[35432]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:21.172 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:21 smithi135 ceph-mon[35432]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T23:55:21.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:21 smithi019 ceph-mon[30859]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:21.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:21 smithi019 ceph-mon[30859]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T23:55:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:21 smithi131 ceph-mon[35491]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:21 smithi131 ceph-mon[35491]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T23:55:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:22 smithi135 ceph-mon[35432]: pgmap v47: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:22 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/1641774844' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"} : dispatch 2024-09-10T23:55:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:22 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"} : dispatch 2024-09-10T23:55:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:22 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"}]': finished 2024-09-10T23:55:22.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:22 smithi135 ceph-mon[35432]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:55:22.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:22.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:22 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/1144493478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:55:22.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:22 smithi019 ceph-mon[30859]: pgmap v47: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:22.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:22 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/1641774844' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"} : dispatch 2024-09-10T23:55:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:22 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"} : dispatch 2024-09-10T23:55:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:22 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"}]': finished 2024-09-10T23:55:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:22 smithi019 ceph-mon[30859]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:55:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:22 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/1144493478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:55:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:22 smithi131 ceph-mon[35491]: pgmap v47: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:22 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/1641774844' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"} : dispatch 2024-09-10T23:55:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:22 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"} : dispatch 2024-09-10T23:55:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:22 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b965c6c5-f9c6-4405-a12d-fbbb3a9db549"}]': finished 2024-09-10T23:55:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:22 smithi131 ceph-mon[35491]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:55:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:22 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/1144493478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:55:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:24 smithi135 ceph-mon[35432]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:24 smithi019 ceph-mon[30859]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:24 smithi131 ceph-mon[35491]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:26.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:26 smithi135 ceph-mon[35432]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:26.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:26 smithi019 ceph-mon[30859]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:26 smithi131 ceph-mon[35491]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:28 smithi135 ceph-mon[35432]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:28 smithi019 ceph-mon[30859]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:28 smithi131 ceph-mon[35491]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:30.362 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:30 smithi135 ceph-mon[35432]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:30.362 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:30 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:55:30.362 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:30 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:30.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:30 smithi019 ceph-mon[30859]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:30.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:30 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:55:30.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:30 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:30.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:30 smithi131 ceph-mon[35491]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:30.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:30 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:55:30.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:30 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:31.306 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:31 smithi135 ceph-mon[35432]: Deploying daemon osd.2 on smithi135 2024-09-10T23:55:31.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:31 smithi019 ceph-mon[30859]: Deploying daemon osd.2 on smithi135 2024-09-10T23:55:31.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:31 smithi131 ceph-mon[35491]: Deploying daemon osd.2 on smithi135 2024-09-10T23:55:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:32 smithi135 ceph-mon[35432]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:32.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:32 smithi019 ceph-mon[30859]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:32 smithi131 ceph-mon[35491]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:34.352 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:34 smithi131 ceph-mon[35491]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:34 smithi135 ceph-mon[35432]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:34 smithi019 ceph-mon[30859]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:36.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:36 smithi135 ceph-mon[35432]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:36.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:36.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:36.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:36 smithi019 ceph-mon[30859]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:36 smithi131 ceph-mon[35491]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:38.312 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:38 smithi135 ceph-mon[35432]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:38 smithi019 ceph-mon[30859]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:38 smithi131 ceph-mon[35491]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:39.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:39 smithi135 ceph-mon[35432]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:39.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:39.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:39.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:39.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:39.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:39 smithi019 ceph-mon[30859]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:40.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:40.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:40.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:39 smithi131 ceph-mon[35491]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:40.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:40.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:40.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.258 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 2 on host 'smithi135' 2024-09-10T23:55:40.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.256+0000 7fbce2ffd640 1 -- 172.21.15.135:0/585499877 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbcf0063590 con 0x7fbcdc0b52a0 2024-09-10T23:55:40.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbcdc0b52a0 msgr2=0x7fbcdc0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbcdc0b52a0 0x7fbcdc0b7760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbce4031440 tx=0x7fbce4005a20 comp rx=0 tx=0).stop 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf0101c90 msgr2=0x7fbcf019a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf0101c90 0x7fbcf019a0b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00d950 tx=0x7fbcec00de10 comp rx=0 tx=0).stop 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 shutdown_connections 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcf0108020 0x7fbcf019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbcdc0b52a0 0x7fbcdc0b7760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcf01076a0 0x7fbcf019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 --2- 172.21.15.135:0/585499877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcf0101c90 0x7fbcf019a0b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 >> 172.21.15.135:0/585499877 conn(0x7fbcf00fd700 msgr2=0x7fbcf00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 shutdown_connections 2024-09-10T23:55:40.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:55:40.259+0000 7fbcf7b3f640 1 -- 172.21.15.135:0/585499877 wait complete. 2024-09-10T23:55:40.881 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:40 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:40.881 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:40 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.881 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:40 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.908 DEBUG:teuthology.orchestra.run.smithi135:osd.2> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T23:55:40.911 INFO:tasks.cephadm:Deploying osd.3 on smithi019 with /dev/vg_nvme/lv_3... 2024-09-10T23:55:40.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:55:40.940 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:40 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:40.940 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:40 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:40.940 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:40 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:41.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:40 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:41.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:40 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:41.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:40 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:41.178 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:41.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:41 smithi135 ceph-mon[35432]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:42.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:41 smithi019 ceph-mon[30859]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:42.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:41 smithi131 ceph-mon[35491]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:42.240 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2[41588]: 2024-09-10T23:55:41.988+0000 7f8c71327640 -1 osd.2 0 log_to_monitors true 2024-09-10T23:55:42.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:42 smithi135 ceph-mon[35432]: from='osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:55:42.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:42 smithi135 ceph-mon[35432]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:55:43.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:42 smithi019 ceph-mon[30859]: from='osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:55:43.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:42 smithi019 ceph-mon[30859]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:55:43.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:42 smithi131 ceph-mon[35491]: from='osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:55:43.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:42 smithi131 ceph-mon[35491]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:55:43.772 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:55:43.805 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_3 2024-09-10T23:55:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:43 smithi135 ceph-mon[35432]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:43 smithi135 ceph-mon[35432]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:55:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:43 smithi135 ceph-mon[35432]: from='osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:55:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:43 smithi135 ceph-mon[35432]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:55:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:43 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:43 smithi135 ceph-mon[35432]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:55:44.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:43 smithi019 ceph-mon[30859]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:44.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:43 smithi019 ceph-mon[30859]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:55:44.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:43 smithi019 ceph-mon[30859]: from='osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:55:44.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:43 smithi019 ceph-mon[30859]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:55:44.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:43 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:44.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:43 smithi019 ceph-mon[30859]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:55:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:43 smithi131 ceph-mon[35491]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:43 smithi131 ceph-mon[35491]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:55:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:43 smithi131 ceph-mon[35491]: from='osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:55:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:43 smithi131 ceph-mon[35491]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:55:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:43 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:43 smithi131 ceph-mon[35491]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:55:44.104 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:44.425 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2[41588]: 2024-09-10T23:55:44.102+0000 7f8c6dabe640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T23:55:44.425 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2[41588]: 2024-09-10T23:55:44.106+0000 7f8c650c9640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 -- 172.21.15.19:0/1346516111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58102920 msgr2=0x7f3c58102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/1346516111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58102920 0x7f3c58102d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009900 tx=0x7f3c4802a410 comp rx=0 tx=0).stop 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 -- 172.21.15.19:0/1346516111 shutdown_connections 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/1346516111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c58108120 0x7f3c5810e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/1346516111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58107780 0x7f3c58107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/1346516111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58102920 0x7f3c58102d00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 -- 172.21.15.19:0/1346516111 >> 172.21.15.19:0/1346516111 conn(0x7f3c58076f50 msgr2=0x7f3c58077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 -- 172.21.15.19:0/1346516111 shutdown_connections 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.608+0000 7f3c5cd07640 1 -- 172.21.15.19:0/1346516111 wait complete. 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 Processor -- start 2024-09-10T23:55:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 -- start start 2024-09-10T23:55:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c58102920 0x7f3c581037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58107780 0x7f3c58103d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58108120 0x7f3c58104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58111cb0 con 0x7f3c58108120 2024-09-10T23:55:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58111b30 con 0x7f3c58102920 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5cd07640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58111e30 con 0x7f3c58107780 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58108120 0x7f3c58104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58108120 0x7f3c58104270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34598/0 (socket says 172.21.15.19:34598) 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 -- 172.21.15.19:0/198664208 learned_addr learned my addr 172.21.15.19:0/198664208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c55d9b640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58107780 0x7f3c58103d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5659c640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c58102920 0x7f3c581037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 -- 172.21.15.19:0/198664208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58107780 msgr2=0x7f3c58103d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58107780 0x7f3c58103d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 -- 172.21.15.19:0/198664208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c58102920 msgr2=0x7f3c581037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c58102920 0x7f3c581037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c56d9d640 1 -- 172.21.15.19:0/198664208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c581a76b0 con 0x7f3c58108120 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.609+0000 7f3c5659c640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c58102920 0x7f3c581037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.610+0000 7f3c56d9d640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58108120 0x7f3c58104270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000eaa0 tx=0x7f3c5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.610+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000cdb0 con 0x7f3c58108120 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.610+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c50005020 con 0x7f3c58108120 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.610+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c581a79a0 con 0x7f3c58108120 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.610+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c500116d0 con 0x7f3c58108120 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.610+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c581a7ee0 con 0x7f3c58108120 2024-09-10T23:55:44.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.611+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c58102d00 con 0x7f3c58108120 2024-09-10T23:55:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.612+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f3c5000f040 con 0x7f3c58108120 2024-09-10T23:55:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.613+0000 7f3c477fe640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3c400b5320 0x7f3c400b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.613+0000 7f3c5659c640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3c400b5320 0x7f3c400b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.613+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7f3c500e43c0 con 0x7f3c58108120 2024-09-10T23:55:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.613+0000 7f3c5659c640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3c400b5320 0x7f3c400b77e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c48005ab0 tx=0x7f3c48000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:44.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.617+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c50016030 con 0x7f3c58108120 2024-09-10T23:55:44.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi135 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi135 to 5815M 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:44 smithi019 ceph-mon[30859]: from='osd.2 ' entity='osd.2' 2024-09-10T23:55:44.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:44.816+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3c58063590 con 0x7f3c400b5320 2024-09-10T23:55:44.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:55:44.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T23:55:44.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:44.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:44.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi135 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi135 to 5815M 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:44 smithi135 ceph-mon[35432]: from='osd.2 ' entity='osd.2' 2024-09-10T23:55:45.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi135 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi135 to 5815M 2024-09-10T23:55:45.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:45.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:45.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:55:45.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:45.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:44 smithi131 ceph-mon[35491]: from='osd.2 ' entity='osd.2' 2024-09-10T23:55:45.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] boot 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:55:45.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:55:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:55:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] boot 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:55:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:55:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:55:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:55:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:55:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:55:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: osd.2 [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] boot 2024-09-10T23:55:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:55:46.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:55:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: pgmap v64: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:55:47.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:55:47.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2799193721' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e420e13-bffd-43e5-a862-e5d93b92b5fd"} : dispatch 2024-09-10T23:55:47.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:55:47.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2799193721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e420e13-bffd-43e5-a862-e5d93b92b5fd"}]': finished 2024-09-10T23:55:47.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T23:55:47.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:47.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: pgmap v64: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2799193721' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e420e13-bffd-43e5-a862-e5d93b92b5fd"} : dispatch 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2799193721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e420e13-bffd-43e5-a862-e5d93b92b5fd"}]': finished 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:47.944 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:55:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: pgmap v64: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:55:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:55:48.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2799193721' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e420e13-bffd-43e5-a862-e5d93b92b5fd"} : dispatch 2024-09-10T23:55:48.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:55:48.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2799193721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e420e13-bffd-43e5-a862-e5d93b92b5fd"}]': finished 2024-09-10T23:55:48.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T23:55:48.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:48.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:55:48.699 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53510]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:55:48.699 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.700 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.700 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53510]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.700 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53513]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:55:48.700 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53513]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.700 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.700 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53513]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.701 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53503]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:55:48.701 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53503]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.701 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.701 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53503]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.701 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53506]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:55:48.701 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53506]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.702 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.702 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 23:55:48 smithi019 sudo[53506]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.800 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45255]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:55:48.800 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45255]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.800 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.800 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45255]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.800 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45258]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:55:48.800 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45258]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.801 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.801 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45258]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3855235020' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:48.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45261]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45261]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45261]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45264]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45264]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:48 smithi131 sudo[45264]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.925 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45218]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:55:48.925 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45218]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.926 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.926 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45218]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.926 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45221]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:55:48.926 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45221]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.926 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.926 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45221]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45224]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:55:48.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45224]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45224]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45227]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45227]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 sudo[45227]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3855235020' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:48.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:48.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:48.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:48.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:48.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:48.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:49.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3855235020' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:55:49.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:49.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:55:49.376+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f3c500a83c0 con 0x7f3c58108120 2024-09-10T23:55:50.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: mgrmap e20: x(active, since 116s), standbys: z, y 2024-09-10T23:55:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:55:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: mgrmap e20: x(active, since 116s), standbys: z, y 2024-09-10T23:55:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:50.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:55:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:55:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:55:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:55:50.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:55:50.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:55:50.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: mgrmap e20: x(active, since 116s), standbys: z, y 2024-09-10T23:55:50.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:55:52.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:51 smithi019 ceph-mon[30859]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:52.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:51 smithi131 ceph-mon[35491]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:51 smithi135 ceph-mon[35432]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:54.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:53 smithi019 ceph-mon[30859]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:53 smithi131 ceph-mon[35491]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:53 smithi135 ceph-mon[35432]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:56.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:55 smithi019 ceph-mon[30859]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:56.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:55 smithi131 ceph-mon[35491]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:56.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:55 smithi135 ceph-mon[35432]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:55:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:56 smithi019 ceph-mon[30859]: Deploying daemon osd.3 on smithi019 2024-09-10T23:55:57.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:55:57.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:57.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:56 smithi131 ceph-mon[35491]: Deploying daemon osd.3 on smithi019 2024-09-10T23:55:57.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:55:57.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:55:57.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:56 smithi135 ceph-mon[35432]: Deploying daemon osd.3 on smithi019 2024-09-10T23:55:57.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:57 smithi019 ceph-mon[30859]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:58.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:57 smithi131 ceph-mon[35491]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:58.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:57 smithi135 ceph-mon[35432]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:55:59.748 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:55:59 smithi019 ceph-mon[30859]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:55:59 smithi131 ceph-mon[35491]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:55:59 smithi135 ceph-mon[35432]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:01.835 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:01 smithi019 ceph-mon[30859]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:02.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:01 smithi131 ceph-mon[35491]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:02.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:01 smithi135 ceph-mon[35432]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:03.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:03.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:03.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:03.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:03.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:03.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:04.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:03 smithi019 ceph-mon[30859]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:03 smithi131 ceph-mon[35491]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:04.076 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:03 smithi135 ceph-mon[35432]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:06.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:06 smithi019 ceph-mon[30859]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:06.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:06.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:06.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:06 smithi135 ceph-mon[35432]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:06 smithi131 ceph-mon[35491]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:06.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.760+0000 7f3c477fe640 1 -- 172.21.15.19:0/198664208 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3c58063590 con 0x7f3c400b5320 2024-09-10T23:56:06.764 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 3 on host 'smithi019' 2024-09-10T23:56:06.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3c400b5320 msgr2=0x7f3c400b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:06.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3c400b5320 0x7f3c400b77e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c48005ab0 tx=0x7f3c48000bc0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58108120 msgr2=0x7f3c58104270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58108120 0x7f3c58104270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000eaa0 tx=0x7f3c5000ef60 comp rx=0 tx=0).stop 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 shutdown_connections 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3c400b5320 0x7f3c400b77e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c58108120 0x7f3c58104270 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58107780 0x7f3c58103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 --2- 172.21.15.19:0/198664208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c58102920 0x7f3c581037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 >> 172.21.15.19:0/198664208 conn(0x7f3c58076f50 msgr2=0x7f3c58106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 shutdown_connections 2024-09-10T23:56:06.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:56:06.763+0000 7f3c5cd07640 1 -- 172.21.15.19:0/198664208 wait complete. 2024-09-10T23:56:07.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:07.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:07.419 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:07.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:07.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:07.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:07.459 DEBUG:teuthology.orchestra.run.smithi019:osd.3> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T23:56:07.462 INFO:tasks.cephadm:Deploying osd.4 on smithi131 with /dev/vg_nvme/lv_3... 2024-09-10T23:56:07.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:56:07.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:07.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:07.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:07.717 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:56:08.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:08 smithi019 ceph-mon[30859]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:08.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:08 smithi019 ceph-mon[30859]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:56:08.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 23:56:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-10T23:56:07.989+0000 7f88a7f37640 -1 osd.3 0 log_to_monitors true 2024-09-10T23:56:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:08 smithi135 ceph-mon[35432]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:08 smithi135 ceph-mon[35432]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:56:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:08 smithi131 ceph-mon[35491]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:08 smithi131 ceph-mon[35491]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:56:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:09 smithi135 ceph-mon[35432]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:56:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:09 smithi135 ceph-mon[35432]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:56:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:09 smithi135 ceph-mon[35432]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:56:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:09 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:09 smithi135 ceph-mon[35432]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:56:09.457 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:09 smithi131 ceph-mon[35491]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:56:09.458 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:09 smithi131 ceph-mon[35491]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:56:09.458 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:09 smithi131 ceph-mon[35491]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:56:09.458 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:09 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:09.458 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:09 smithi131 ceph-mon[35491]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:56:09.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:09 smithi019 ceph-mon[30859]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:56:09.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:09 smithi019 ceph-mon[30859]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:56:09.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:09 smithi019 ceph-mon[30859]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:56:09.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:09 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:09.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:09 smithi019 ceph-mon[30859]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:56:10.008 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 23:56:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-10T23:56:09.562+0000 7f88a46ce640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T23:56:10.008 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 23:56:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-10T23:56:09.568+0000 7f889bcd9640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:56:10.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] boot 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:56:10.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:10 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.294 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_3 2024-09-10T23:56:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T23:56:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' 2024-09-10T23:56:10.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] boot 2024-09-10T23:56:10.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:56:10.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:10 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.482 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:56:10.483 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T23:56:10.483 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.483 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.483 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: from='osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553]' entity='osd.3' 2024-09-10T23:56:10.483 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: osd.3 [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] boot 2024-09-10T23:56:10.483 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:56:10.483 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:10 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:56:10.595 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:56:11.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 -- 172.21.15.131:0/1313810561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c108020 msgr2=0x7f4a0c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:11.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1313810561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c108020 0x7f4a0c10e820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009ca0 tx=0x7f4a0402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 -- 172.21.15.131:0/1313810561 shutdown_connections 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1313810561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c108020 0x7f4a0c10e820 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1313810561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a0c1076a0 0x7f4a0c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1313810561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a0c101c90 0x7f4a0c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 -- 172.21.15.131:0/1313810561 >> 172.21.15.131:0/1313810561 conn(0x7f4a0c0fd700 msgr2=0x7f4a0c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 -- 172.21.15.131:0/1313810561 shutdown_connections 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.047+0000 7f4a1342c640 1 -- 172.21.15.131:0/1313810561 wait complete. 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 Processor -- start 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 -- start start 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a0c101c90 0x7f4a0c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c1076a0 0x7f4a0c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:11.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a0c108020 0x7f4a0c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c111ca0 con 0x7f4a0c101c90 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c111b20 con 0x7f4a0c1076a0 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a1342c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c111e20 con 0x7f4a0c108020 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c1076a0 0x7f4a0c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c1076a0 0x7f4a0c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:48368/0 (socket says 172.21.15.131:48368) 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 -- 172.21.15.131:0/1008492137 learned_addr learned my addr 172.21.15.131:0/1008492137 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a111c8640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a0c101c90 0x7f4a0c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a119c9640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a0c108020 0x7f4a0c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 -- 172.21.15.131:0/1008492137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a0c108020 msgr2=0x7f4a0c19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a0c108020 0x7f4a0c19da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:11.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 -- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a0c101c90 msgr2=0x7f4a0c198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a0c101c90 0x7f4a0c198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.048+0000 7f4a109c7640 1 -- 172.21.15.131:0/1008492137 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c19e1e0 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.049+0000 7f4a109c7640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c1076a0 0x7f4a0c198670 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000d770 tx=0x7f4a0000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.049+0000 7f49fe7fc640 1 -- 172.21.15.131:0/1008492137 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00017070 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.049+0000 7f49fe7fc640 1 -- 172.21.15.131:0/1008492137 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a000054d0 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.049+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c19e4d0 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.049+0000 7f49fe7fc640 1 -- 172.21.15.131:0/1008492137 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00004c30 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.049+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c1a4b90 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.050+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c102070 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.051+0000 7f49fe7fc640 1 -- 172.21.15.131:0/1008492137 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f4a00004e10 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.052+0000 7f49fe7fc640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49f80b53b0 0x7f49f80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.052+0000 7f49fe7fc640 1 -- 172.21.15.131:0/1008492137 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3917+0+0 (secure 0 0 0) 0x7f4a000e4580 con 0x7f4a0c1076a0 2024-09-10T23:56:11.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.053+0000 7f4a111c8640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49f80b53b0 0x7f49f80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:11.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.053+0000 7f4a111c8640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49f80b53b0 0x7f49f80b7870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800bbe0 tx=0x7f4a0800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:11.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.057+0000 7f49fe7fc640 1 -- 172.21.15.131:0/1008492137 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4a000ac570 con 0x7f4a0c1076a0 2024-09-10T23:56:11.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:11.290+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4a0c063590 con 0x7f49f80b53b0 2024-09-10T23:56:11.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:56:11.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi019 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: pgmap v83: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:56:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:56:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:56:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:11.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi019 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:11.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: pgmap v83: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:11.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:56:11.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:56:11.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:56:11.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi019 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-10T23:56:11.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:11.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:11.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:11.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: pgmap v83: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:11.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:56:11.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:56:11.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:56:11.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:13.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:13 smithi131 ceph-mon[35491]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:13.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:13 smithi131 ceph-mon[35491]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T23:56:13.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:13 smithi135 ceph-mon[35432]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:13.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:13 smithi135 ceph-mon[35432]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T23:56:13.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:13 smithi019 ceph-mon[30859]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:13.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:13 smithi019 ceph-mon[30859]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T23:56:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:14 smithi135 ceph-mon[35432]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:14 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/2692468503' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"} : dispatch 2024-09-10T23:56:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:14 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"} : dispatch 2024-09-10T23:56:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:14 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"}]': finished 2024-09-10T23:56:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:14 smithi135 ceph-mon[35432]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:56:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:14.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:14 smithi019 ceph-mon[30859]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:14.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:14 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/2692468503' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"} : dispatch 2024-09-10T23:56:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:14 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"} : dispatch 2024-09-10T23:56:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:14 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"}]': finished 2024-09-10T23:56:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:14 smithi019 ceph-mon[30859]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:56:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:14 smithi131 ceph-mon[35491]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:14 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/2692468503' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"} : dispatch 2024-09-10T23:56:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:14 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"} : dispatch 2024-09-10T23:56:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:14 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491c3970-0871-473e-9346-4f960d917f97"}]': finished 2024-09-10T23:56:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:14 smithi131 ceph-mon[35491]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:56:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:15 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/2668260759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:56:15.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:15 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/2668260759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:56:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:15 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/2668260759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:56:16.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:16 smithi135 ceph-mon[35432]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:16.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:16 smithi019 ceph-mon[30859]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:16 smithi131 ceph-mon[35491]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:18 smithi135 ceph-mon[35432]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:56:18.430 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:18 smithi131 ceph-mon[35491]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:56:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:18 smithi019 ceph-mon[30859]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:56:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:20 smithi135 ceph-mon[35432]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:56:20.429 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:20 smithi131 ceph-mon[35491]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:56:20.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:20 smithi019 ceph-mon[30859]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:56:22.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:22 smithi131 ceph-mon[35491]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:56:22.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:56:22.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:22 smithi135 ceph-mon[35432]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:56:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:56:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:22.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:22 smithi019 ceph-mon[30859]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:56:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:56:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:23.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:23 smithi135 ceph-mon[35432]: Deploying daemon osd.4 on smithi131 2024-09-10T23:56:23.435 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:23 smithi131 ceph-mon[35491]: Deploying daemon osd.4 on smithi131 2024-09-10T23:56:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:23 smithi019 ceph-mon[30859]: Deploying daemon osd.4 on smithi131 2024-09-10T23:56:24.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:24 smithi131 ceph-mon[35491]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:56:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:24 smithi135 ceph-mon[35432]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:56:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:24 smithi019 ceph-mon[30859]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:56:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:26 smithi135 ceph-mon[35432]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T23:56:26.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:26 smithi019 ceph-mon[30859]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T23:56:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:26 smithi131 ceph-mon[35491]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T23:56:28.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:28 smithi135 ceph-mon[35432]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:56:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:28 smithi019 ceph-mon[30859]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:56:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:28 smithi131 ceph-mon[35491]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:56:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:29.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:29.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:29.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:29.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:29.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:29.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:30.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:30 smithi019 ceph-mon[30859]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:30 smithi131 ceph-mon[35491]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:30.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:30 smithi135 ceph-mon[35432]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:32.184 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:31 smithi131 ceph-mon[35491]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:32.184 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.184 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.184 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:32.184 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:32.184 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.223+0000 7f49fe7fc640 1 -- 172.21.15.131:0/1008492137 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4a0c063590 con 0x7f49f80b53b0 2024-09-10T23:56:32.225 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 4 on host 'smithi131' 2024-09-10T23:56:32.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49f80b53b0 msgr2=0x7f49f80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:32.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49f80b53b0 0x7f49f80b7870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800bbe0 tx=0x7f4a0800b390 comp rx=0 tx=0).stop 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c1076a0 msgr2=0x7f4a0c198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c1076a0 0x7f4a0c198670 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000d770 tx=0x7f4a0000dc30 comp rx=0 tx=0).stop 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 shutdown_connections 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a0c108020 0x7f4a0c19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a0c1076a0 0x7f4a0c198670 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49f80b53b0 0x7f49f80b7870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 --2- 172.21.15.131:0/1008492137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a0c101c90 0x7f4a0c198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 >> 172.21.15.131:0/1008492137 conn(0x7f4a0c0fd700 msgr2=0x7f4a0c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 shutdown_connections 2024-09-10T23:56:32.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:56:32.225+0000 7f4a1342c640 1 -- 172.21.15.131:0/1008492137 wait complete. 2024-09-10T23:56:32.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:31 smithi019 ceph-mon[30859]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:32.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:31 smithi135 ceph-mon[35432]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:32.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:32.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:32.890 DEBUG:teuthology.orchestra.run.smithi131:osd.4> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T23:56:32.892 INFO:tasks.cephadm:Deploying osd.5 on smithi135 with /dev/vg_nvme/lv_3... 2024-09-10T23:56:32.892 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:56:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:56:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:32 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:32 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:33.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:32 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:33.179 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:32 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:33.179 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:32 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:33.179 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:32 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:33.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:32 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:33.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:32 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:33.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:32 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:34.296 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:34 smithi131 ceph-mon[35491]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:34 smithi019 ceph-mon[30859]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:34.523 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:34 smithi135 ceph-mon[35432]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:34.550 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 10 23:56:34 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-10T23:56:34.540+0000 7fda08248640 -1 osd.4 0 log_to_monitors true 2024-09-10T23:56:35.269 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:35 smithi131 ceph-mon[35491]: from='osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:56:35.269 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:35 smithi131 ceph-mon[35491]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:56:35.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:35 smithi135 ceph-mon[35432]: from='osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:56:35.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:35 smithi135 ceph-mon[35432]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:56:35.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:35 smithi019 ceph-mon[30859]: from='osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:56:35.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:35 smithi019 ceph-mon[30859]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:56:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:56:35.868 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-09-10T23:56:36.110 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:56:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:56:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:56:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:56:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:36.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/751777617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108060 msgr2=0x7f3dd410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:36.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/751777617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108060 0x7f3dd410e860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009ca0 tx=0x7f3dcc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:36.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/751777617 shutdown_connections 2024-09-10T23:56:36.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/751777617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108060 0x7f3dd410e860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:36.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/751777617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd41076e0 0x7f3dd4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:36.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/751777617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd4101cd0 0x7f3dd41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:36.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/751777617 >> 172.21.15.135:0/751777617 conn(0x7f3dd40fd700 msgr2=0x7f3dd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:36.560 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:56:36.561 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.561 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:36.561 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:36.561 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:36.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/751777617 shutdown_connections 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.557+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/751777617 wait complete. 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 Processor -- start 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 -- start start 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4101cd0 0x7f3dd4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd41076e0 0x7f3dd4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd4108060 0x7f3dd419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111ce0 con 0x7f3dd41076e0 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111b60 con 0x7f3dd4108060 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.558+0000 7f3ddb3bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111e60 con 0x7f3dd4101cd0 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4101cd0 0x7f3dd4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9958640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd4108060 0x7f3dd419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:36.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4101cd0 0x7f3dd4199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53534/0 (socket says 172.21.15.135:53534) 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 -- 172.21.15.135:0/1743287098 learned_addr learned my addr 172.21.15.135:0/1743287098 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd8956640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd41076e0 0x7f3dd4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 -- 172.21.15.135:0/1743287098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd4108060 msgr2=0x7f3dd419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd4108060 0x7f3dd419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 -- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd41076e0 msgr2=0x7f3dd4199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd41076e0 0x7f3dd4199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 -- 172.21.15.135:0/1743287098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd419f2f0 con 0x7f3dd4101cd0 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9958640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd4108060 0x7f3dd419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dd9157640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4101cd0 0x7f3dd4199240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c890 tx=0x7f3dd000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dca7fc640 1 -- 172.21.15.135:0/1743287098 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004220 con 0x7f3dd4101cd0 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dca7fc640 1 -- 172.21.15.135:0/1743287098 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dd00043c0 con 0x7f3dd4101cd0 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd419f5e0 con 0x7f3dd4101cd0 2024-09-10T23:56:36.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd41a5e70 con 0x7f3dd4101cd0 2024-09-10T23:56:36.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.559+0000 7f3dca7fc640 1 -- 172.21.15.135:0/1743287098 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004a00 con 0x7f3dd4101cd0 2024-09-10T23:56:36.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.561+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd41020b0 con 0x7f3dd4101cd0 2024-09-10T23:56:36.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.562+0000 7f3dca7fc640 1 -- 172.21.15.135:0/1743287098 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f3dd00079b0 con 0x7f3dd4101cd0 2024-09-10T23:56:36.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.563+0000 7f3dca7fc640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3dc00b53b0 0x7f3dc00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:36.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.563+0000 7f3dca7fc640 1 -- 172.21.15.135:0/1743287098 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4036+0+0 (secure 0 0 0) 0x7f3dd00e4bf0 con 0x7f3dd4101cd0 2024-09-10T23:56:36.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.563+0000 7f3dd8956640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3dc00b53b0 0x7f3dc00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:36.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.564+0000 7f3dd8956640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3dc00b53b0 0x7f3dc00b7870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4104260 tx=0x7f3dc4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:36.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.566+0000 7f3dca7fc640 1 -- 172.21.15.135:0/1743287098 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3dd0014030 con 0x7f3dd4101cd0 2024-09-10T23:56:36.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:36.751+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3dd4063590 con 0x7f3dc00b53b0 2024-09-10T23:56:37.050 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-10T23:56:36.639+0000 7fda041cb640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T23:56:37.050 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 10 23:56:36 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-10T23:56:36.644+0000 7fd9fbfea640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:56:37.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi131 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi131 to 8544M 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='osd.4 ' entity='osd.4' 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:56:37.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:37.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:37 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.519 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi131 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi131 to 8544M 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='osd.4 ' entity='osd.4' 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:37.520 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:37 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi131 2024-09-10T23:56:37.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi131 to 8544M 2024-09-10T23:56:37.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:56:37.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T23:56:37.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='osd.4 ' entity='osd.4' 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:37.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:37 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:38.394 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:38 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:56:38.395 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:38 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:56:38.395 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:38 smithi135 ceph-mon[35432]: osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] boot 2024-09-10T23:56:38.395 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:38 smithi135 ceph-mon[35432]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:56:38.395 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:38 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:38 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:56:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:38 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:56:38.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:38 smithi019 ceph-mon[30859]: osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] boot 2024-09-10T23:56:38.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:38 smithi019 ceph-mon[30859]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:56:38.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:38 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:38 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:56:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:38 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:56:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:38 smithi131 ceph-mon[35491]: osd.4 [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] boot 2024-09-10T23:56:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:38 smithi131 ceph-mon[35491]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:56:38.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:38 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:56:39.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:39 smithi019 ceph-mon[30859]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:39.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:39 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/1847477424' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"} : dispatch 2024-09-10T23:56:39.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:39 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"} : dispatch 2024-09-10T23:56:39.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:39 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"}]': finished 2024-09-10T23:56:39.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:39 smithi019 ceph-mon[30859]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:56:39.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:39 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:56:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:39 smithi131 ceph-mon[35491]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:39 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/1847477424' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"} : dispatch 2024-09-10T23:56:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:39 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"} : dispatch 2024-09-10T23:56:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:39 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"}]': finished 2024-09-10T23:56:39.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:39 smithi131 ceph-mon[35491]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:56:39.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:39 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:56:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:39 smithi135 ceph-mon[35432]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:39 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/1847477424' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"} : dispatch 2024-09-10T23:56:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:39 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"} : dispatch 2024-09-10T23:56:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:39 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd207285-b240-4e77-a654-99fac9fa4349"}]': finished 2024-09-10T23:56:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:39 smithi135 ceph-mon[35432]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:56:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:39 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:56:40.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:40 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/2046266856' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:56:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:40 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/2046266856' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:56:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:40 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/2046266856' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:56:41.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:41 smithi019 ceph-mon[30859]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:41 smithi131 ceph-mon[35491]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:41.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:41 smithi135 ceph-mon[35432]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:43.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:43 smithi019 ceph-mon[30859]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:43.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:43 smithi131 ceph-mon[35491]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:43.896 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:43 smithi135 ceph-mon[35432]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:45.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:45 smithi135 ceph-mon[35432]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:45.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:45 smithi019 ceph-mon[30859]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:45.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:45 smithi131 ceph-mon[35491]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:47.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:47 smithi019 ceph-mon[30859]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:47.778 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:47 smithi131 ceph-mon[35491]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:47 smithi135 ceph-mon[35432]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:56:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:48 smithi135 ceph-mon[35432]: Deploying daemon osd.5 on smithi135 2024-09-10T23:56:48.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:56:48.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:48.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:48 smithi019 ceph-mon[30859]: Deploying daemon osd.5 on smithi135 2024-09-10T23:56:48.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:56:48.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:48.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:48 smithi131 ceph-mon[35491]: Deploying daemon osd.5 on smithi135 2024-09-10T23:56:49.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:49 smithi135 ceph-mon[35432]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:49.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:49 smithi019 ceph-mon[30859]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:49.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:49 smithi131 ceph-mon[35491]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:51.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:51 smithi135 ceph-mon[35432]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:51.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:51 smithi019 ceph-mon[30859]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:51.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:51 smithi131 ceph-mon[35491]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:53.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:53 smithi135 ceph-mon[35432]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:53 smithi019 ceph-mon[30859]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:53.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:53 smithi131 ceph-mon[35491]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:54.750 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:54.750 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:54.750 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:56.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:56 smithi135 ceph-mon[35432]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:56 smithi019 ceph-mon[30859]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:56 smithi131 ceph-mon[35491]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:58.009 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:57 smithi135 ceph-mon[35432]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:58.010 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.010 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.010 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:58.010 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:58.010 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:57 smithi019 ceph-mon[30859]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.048+0000 7f3dca7fc640 1 -- 172.21.15.135:0/1743287098 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3dd4063590 con 0x7f3dc00b53b0 2024-09-10T23:56:58.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:57 smithi131 ceph-mon[35491]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:56:58.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:58.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:58.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:58.051 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 5 on host 'smithi135' 2024-09-10T23:56:58.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3dc00b53b0 msgr2=0x7f3dc00b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3dc00b53b0 0x7f3dc00b7870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4104260 tx=0x7f3dc4005f90 comp rx=0 tx=0).stop 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4101cd0 msgr2=0x7f3dd4199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4101cd0 0x7f3dd4199240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c890 tx=0x7f3dd000cd50 comp rx=0 tx=0).stop 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 shutdown_connections 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3dd4108060 0x7f3dd419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3dc00b53b0 0x7f3dc00b7870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd41076e0 0x7f3dd4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 --2- 172.21.15.135:0/1743287098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4101cd0 0x7f3dd4199240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 >> 172.21.15.135:0/1743287098 conn(0x7f3dd40fd700 msgr2=0x7f3dd406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 shutdown_connections 2024-09-10T23:56:58.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:56:58.051+0000 7f3ddb3bb640 1 -- 172.21.15.135:0/1743287098 wait complete. 2024-09-10T23:56:58.712 DEBUG:teuthology.orchestra.run.smithi135:osd.5> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T23:56:58.714 INFO:tasks.cephadm:Deploying osd.6 on smithi019 with /dev/vg_nvme/lv_2... 2024-09-10T23:56:58.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:56:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:59.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:59.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:59.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:56:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:59.039 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:59.039 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:59.040 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:56:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:59.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:59.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:59.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:56:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:56:59.890 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 23:56:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-10T23:56:59.565+0000 7fd688def640 -1 osd.5 0 log_to_monitors true 2024-09-10T23:57:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:00 smithi135 ceph-mon[35432]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:00 smithi135 ceph-mon[35432]: from='osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:57:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:00 smithi135 ceph-mon[35432]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:57:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:00 smithi131 ceph-mon[35491]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:00 smithi131 ceph-mon[35491]: from='osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:57:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:00 smithi131 ceph-mon[35491]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:57:00.306 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:00 smithi019 ceph-mon[30859]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:00.306 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:00 smithi019 ceph-mon[30859]: from='osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:57:00.306 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:00 smithi019 ceph-mon[30859]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:57:01.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:01 smithi019 ceph-mon[30859]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:57:01.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:01 smithi019 ceph-mon[30859]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:57:01.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:01 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:01.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:01 smithi019 ceph-mon[30859]: from='osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:57:01.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:01 smithi019 ceph-mon[30859]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:57:01.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:01 smithi135 ceph-mon[35432]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:57:01.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:01 smithi135 ceph-mon[35432]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:57:01.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:01 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:01.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:01 smithi135 ceph-mon[35432]: from='osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:57:01.282 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:01 smithi135 ceph-mon[35432]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:57:01.282 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 23:57:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-10T23:57:01.072+0000 7fd684d72640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:57:01.282 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 23:57:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-10T23:57:01.077+0000 7fd680b99640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:57:01.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:01 smithi131 ceph-mon[35491]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:01 smithi131 ceph-mon[35491]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:01 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:01 smithi131 ceph-mon[35491]: from='osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:01 smithi131 ceph-mon[35491]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:57:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:57:02.037 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_2 2024-09-10T23:57:02.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:02.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:57:02.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:57:02.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:02.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:02.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:02.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:02.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:02.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:02.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:02 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:02.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:02.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:57:02.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:57:02.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:02.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:02.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:02 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:57:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:57:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:02.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:02.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:02.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:02.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:02 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:02.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.770+0000 7fb89c97a640 1 -- 172.21.15.19:0/2197111766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8981087d0 msgr2=0x7fb898108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:02.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.770+0000 7fb89c97a640 1 --2- 172.21.15.19:0/2197111766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8981087d0 0x7fb898108c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb880009900 tx=0x7fb88002a410 comp rx=0 tx=0).stop 2024-09-10T23:57:02.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 -- 172.21.15.19:0/2197111766 shutdown_connections 2024-09-10T23:57:02.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 --2- 172.21.15.19:0/2197111766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb898109150 0x7fb89810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:02.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 --2- 172.21.15.19:0/2197111766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8981087d0 0x7fb898108c10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:02.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 --2- 172.21.15.19:0/2197111766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb898102dc0 0x7fb8981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 -- 172.21.15.19:0/2197111766 >> 172.21.15.19:0/2197111766 conn(0x7fb8980fe830 msgr2=0x7fb898100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 -- 172.21.15.19:0/2197111766 shutdown_connections 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 -- 172.21.15.19:0/2197111766 wait complete. 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 Processor -- start 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.771+0000 7fb89c97a640 1 -- start start 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb898102dc0 0x7fb898199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8981087d0 0x7fb898199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb898109150 0x7fb89819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb898112e10 con 0x7fb898109150 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb898112c90 con 0x7fb898102dc0 2024-09-10T23:57:02.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb898112f90 con 0x7fb8981087d0 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb898109150 0x7fb89819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb898109150 0x7fb89819ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43026/0 (socket says 172.21.15.19:43026) 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 -- 172.21.15.19:0/3248817669 learned_addr learned my addr 172.21.15.19:0/3248817669 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb895d9b640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8981087d0 0x7fb898199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89659c640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb898102dc0 0x7fb898199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 -- 172.21.15.19:0/3248817669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8981087d0 msgr2=0x7fb898199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8981087d0 0x7fb898199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 -- 172.21.15.19:0/3248817669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb898102dc0 msgr2=0x7fb898199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb898102dc0 0x7fb898199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:02.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 -- 172.21.15.19:0/3248817669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89819f3d0 con 0x7fb898109150 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89659c640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb898102dc0 0x7fb898199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb896d9d640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb898109150 0x7fb89819ec00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb890009fd0 tx=0x7fb89000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb88f7fe640 1 -- 172.21.15.19:0/3248817669 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890011830 con 0x7fb898109150 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb88f7fe640 1 -- 172.21.15.19:0/3248817669 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb890016070 con 0x7fb898109150 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89819f6c0 con 0x7fb898109150 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb88f7fe640 1 -- 172.21.15.19:0/3248817669 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890010de0 con 0x7fb898109150 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.772+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8981a5e00 con 0x7fb898109150 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.774+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8981031a0 con 0x7fb898109150 2024-09-10T23:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.775+0000 7fb88f7fe640 1 -- 172.21.15.19:0/3248817669 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fb8900119d0 con 0x7fb898109150 2024-09-10T23:57:02.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.776+0000 7fb88f7fe640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb8840b53b0 0x7fb8840b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:02.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.776+0000 7fb88f7fe640 1 -- 172.21.15.19:0/3248817669 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4781+0+0 (secure 0 0 0) 0x7fb8900e4ad0 con 0x7fb898109150 2024-09-10T23:57:02.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.776+0000 7fb89659c640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb8840b53b0 0x7fb8840b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:02.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.777+0000 7fb89659c640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb8840b53b0 0x7fb8840b7870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb888005fd0 tx=0x7fb8880093e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:02.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.779+0000 7fb88f7fe640 1 -- 172.21.15.19:0/3248817669 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8900ac6c0 con 0x7fb898109150 2024-09-10T23:57:02.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:02.974+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb898063590 con 0x7fb8840b53b0 2024-09-10T23:57:03.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:57:03.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:57:03.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi135 2024-09-10T23:57:03.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi135 to 2907M 2024-09-10T23:57:03.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] boot 2024-09-10T23:57:03.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:57:03.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:03.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:03.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:03.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:03.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:57:03.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:57:03.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi135 2024-09-10T23:57:03.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi135 to 2907M 2024-09-10T23:57:03.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] boot 2024-09-10T23:57:03.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:57:03.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:03.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:03.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:03.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:57:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:57:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi135 2024-09-10T23:57:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi135 to 2907M 2024-09-10T23:57:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: osd.5 [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] boot 2024-09-10T23:57:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:57:03.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:57:03.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:03.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:03.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:04.340 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:04 smithi135 ceph-mon[35432]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:04.340 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:04 smithi135 ceph-mon[35432]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:04.341 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:04 smithi135 ceph-mon[35432]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:57:04.493 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:04 smithi019 ceph-mon[30859]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:04.493 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:04 smithi019 ceph-mon[30859]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:04.493 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:04 smithi019 ceph-mon[30859]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:57:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:04 smithi131 ceph-mon[35491]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:57:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:04 smithi131 ceph-mon[35491]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:04 smithi131 ceph-mon[35491]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:57:05.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:05 smithi135 ceph-mon[35432]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:57:05.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:05 smithi019 ceph-mon[30859]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:57:05.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:05 smithi131 ceph-mon[35491]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:57:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:06 smithi135 ceph-mon[35432]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:06 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2403328771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0306c2d-d4e6-4369-b19c-f3b947a2098a"} : dispatch 2024-09-10T23:57:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:06 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2403328771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0306c2d-d4e6-4369-b19c-f3b947a2098a"}]': finished 2024-09-10T23:57:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:06 smithi135 ceph-mon[35432]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:57:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:06.451 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:06 smithi131 ceph-mon[35491]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:06.451 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:06 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2403328771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0306c2d-d4e6-4369-b19c-f3b947a2098a"} : dispatch 2024-09-10T23:57:06.451 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:06 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2403328771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0306c2d-d4e6-4369-b19c-f3b947a2098a"}]': finished 2024-09-10T23:57:06.451 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:06 smithi131 ceph-mon[35491]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:57:06.452 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:06 smithi019 ceph-mon[30859]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:06 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2403328771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0306c2d-d4e6-4369-b19c-f3b947a2098a"} : dispatch 2024-09-10T23:57:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:06 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2403328771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0306c2d-d4e6-4369-b19c-f3b947a2098a"}]': finished 2024-09-10T23:57:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:06 smithi019 ceph-mon[30859]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:57:06.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:07.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:07 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4231358676' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:07.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:07 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4231358676' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:07.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:07 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4231358676' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:08 smithi135 ceph-mon[35432]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-10T23:57:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:08 smithi019 ceph-mon[30859]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-10T23:57:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:08 smithi131 ceph-mon[35491]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-10T23:57:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:10 smithi135 ceph-mon[35432]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:57:10.509 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:10 smithi019 ceph-mon[30859]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:57:10.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:10 smithi131 ceph-mon[35491]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:57:12.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:12 smithi135 ceph-mon[35432]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T23:57:12.581 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:12 smithi131 ceph-mon[35491]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T23:57:12.581 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:12 smithi019 ceph-mon[30859]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T23:57:14.219 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:14 smithi019 ceph-mon[30859]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:57:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:14 smithi135 ceph-mon[35432]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:57:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:14 smithi131 ceph-mon[35491]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:57:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:57:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:15.493 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:57:15.494 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:57:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:16.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:16 smithi019 ceph-mon[30859]: Deploying daemon osd.6 on smithi019 2024-09-10T23:57:16.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:16 smithi019 ceph-mon[30859]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:57:16.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:16 smithi135 ceph-mon[35432]: Deploying daemon osd.6 on smithi019 2024-09-10T23:57:16.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:16 smithi135 ceph-mon[35432]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:57:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:16 smithi131 ceph-mon[35491]: Deploying daemon osd.6 on smithi019 2024-09-10T23:57:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:16 smithi131 ceph-mon[35491]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:57:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:18 smithi135 ceph-mon[35432]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:18 smithi019 ceph-mon[30859]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:18 smithi131 ceph-mon[35491]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:20 smithi135 ceph-mon[35432]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:20.457 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:20 smithi019 ceph-mon[30859]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:20 smithi131 ceph-mon[35491]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:21.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:21.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:21.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:21.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:21.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:21.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:22.405 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:22 smithi019 ceph-mon[30859]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:22 smithi135 ceph-mon[35432]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:22 smithi131 ceph-mon[35491]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:24.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:24 smithi019 ceph-mon[30859]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:24.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.411 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:24.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:24.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:24 smithi135 ceph-mon[35432]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:24.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:24 smithi131 ceph-mon[35491]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.826+0000 7fb88f7fe640 1 -- 172.21.15.19:0/3248817669 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb898063590 con 0x7fb8840b53b0 2024-09-10T23:57:24.829 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 6 on host 'smithi019' 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb8840b53b0 msgr2=0x7fb8840b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb8840b53b0 0x7fb8840b7870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb888005fd0 tx=0x7fb8880093e0 comp rx=0 tx=0).stop 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb898109150 msgr2=0x7fb89819ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb898109150 0x7fb89819ec00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb890009fd0 tx=0x7fb89000b8e0 comp rx=0 tx=0).stop 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 shutdown_connections 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb8840b53b0 0x7fb8840b7870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb898109150 0x7fb89819ec00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8981087d0 0x7fb898199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 --2- 172.21.15.19:0/3248817669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb898102dc0 0x7fb898199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 >> 172.21.15.19:0/3248817669 conn(0x7fb8980fe830 msgr2=0x7fb898100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 shutdown_connections 2024-09-10T23:57:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:57:24.829+0000 7fb89c97a640 1 -- 172.21.15.19:0/3248817669 wait complete. 2024-09-10T23:57:25.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:25.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:25.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:25 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:25.483 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:25.483 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:25.483 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:25 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:25.511 DEBUG:teuthology.orchestra.run.smithi019:osd.6> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T23:57:25.513 INFO:tasks.cephadm:Deploying osd.7 on smithi131 with /dev/vg_nvme/lv_2... 2024-09-10T23:57:25.513 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:57:25.542 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:25.542 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:25.542 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:25 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:25.770 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:57:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:26 smithi135 ceph-mon[35432]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:26.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:26 smithi019 ceph-mon[30859]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:26 smithi131 ceph-mon[35491]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:27.051 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 23:57:26 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-10T23:57:26.783+0000 7f3f30e27640 -1 osd.6 0 log_to_monitors true 2024-09-10T23:57:27.264 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:27 smithi131 ceph-mon[35491]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:57:27.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:27 smithi135 ceph-mon[35432]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:57:27.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:27 smithi019 ceph-mon[30859]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:57:28.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:28 smithi135 ceph-mon[35432]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:28.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:28 smithi135 ceph-mon[35432]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:57:28.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:28 smithi135 ceph-mon[35432]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:57:28.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:28 smithi135 ceph-mon[35432]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:57:28.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:28.486 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:28 smithi131 ceph-mon[35491]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:28.486 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:28 smithi131 ceph-mon[35491]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:57:28.486 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:28 smithi131 ceph-mon[35491]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:57:28.486 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:28 smithi131 ceph-mon[35491]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:57:28.487 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:28 smithi019 ceph-mon[30859]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:28 smithi019 ceph-mon[30859]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:57:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:28 smithi019 ceph-mon[30859]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:57:28.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:28 smithi019 ceph-mon[30859]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:57:28.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:28.523 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 23:57:28 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-10T23:57:28.161+0000 7f3f2cdaa640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:57:28.523 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 23:57:28 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-10T23:57:28.171+0000 7f3f28bd1640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:57:28.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:57:28.590 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_2 2024-09-10T23:57:28.881 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:57:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:57:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:29.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:29.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:29 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 -- 172.21.15.131:0/222483576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4101c90 msgr2=0x7efdd4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:29.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 --2- 172.21.15.131:0/222483576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4101c90 0x7efdd4102070 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009900 tx=0x7efdd002a410 comp rx=0 tx=0).stop 2024-09-10T23:57:29.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 -- 172.21.15.131:0/222483576 shutdown_connections 2024-09-10T23:57:29.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 --2- 172.21.15.131:0/222483576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd4108020 0x7efdd410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 --2- 172.21.15.131:0/222483576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd41076a0 0x7efdd4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 --2- 172.21.15.131:0/222483576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4101c90 0x7efdd4102070 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 -- 172.21.15.131:0/222483576 >> 172.21.15.131:0/222483576 conn(0x7efdd40fd700 msgr2=0x7efdd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 -- 172.21.15.131:0/222483576 shutdown_connections 2024-09-10T23:57:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.388+0000 7efddc6f2640 1 -- 172.21.15.131:0/222483576 wait complete. 2024-09-10T23:57:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.389+0000 7efddc6f2640 1 Processor -- start 2024-09-10T23:57:29.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.389+0000 7efddc6f2640 1 -- start start 2024-09-10T23:57:29.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.389+0000 7efddc6f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd4101c90 0x7efdd4199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:29.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.389+0000 7efddc6f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd41076a0 0x7efdd4199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:29.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddc6f2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4108020 0x7efdd419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddc6f2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4111ce0 con 0x7efdd41076a0 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddc6f2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4111b60 con 0x7efdd4108020 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddc6f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4111e60 con 0x7efdd4101c90 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4108020 0x7efdd419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4108020 0x7efdd419eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52722/0 (socket says 172.21.15.131:52722) 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 -- 172.21.15.131:0/652220792 learned_addr learned my addr 172.21.15.131:0/652220792 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efdda48e640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd4101c90 0x7efdd4199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efdd9c8d640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd41076a0 0x7efdd4199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 -- 172.21.15.131:0/652220792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd4101c90 msgr2=0x7efdd4199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd4101c90 0x7efdd4199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 -- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd41076a0 msgr2=0x7efdd4199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd41076a0 0x7efdd4199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:29.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 -- 172.21.15.131:0/652220792 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd419f300 con 0x7efdd4108020 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efdda48e640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd4101c90 0x7efdd4199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddac8f640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4108020 0x7efdd419eb30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00eb10 tx=0x7efdcc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efdcb7fe640 1 -- 172.21.15.131:0/652220792 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004b20 con 0x7efdd4108020 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efdcb7fe640 1 -- 172.21.15.131:0/652220792 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdcc004cc0 con 0x7efdd4108020 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd419f5f0 con 0x7efdd4108020 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efdcb7fe640 1 -- 172.21.15.131:0/652220792 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc010670 con 0x7efdd4108020 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.390+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd40fdae0 con 0x7efdd4108020 2024-09-10T23:57:29.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.392+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd4102070 con 0x7efdd4108020 2024-09-10T23:57:29.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.394+0000 7efdcb7fe640 1 -- 172.21.15.131:0/652220792 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7efdcc005000 con 0x7efdd4108020 2024-09-10T23:57:29.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.394+0000 7efdcb7fe640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efdc00b5330 0x7efdc00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:29.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.395+0000 7efdcb7fe640 1 -- 172.21.15.131:0/652220792 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5180+0+0 (secure 0 0 0) 0x7efdcc0e5740 con 0x7efdd4108020 2024-09-10T23:57:29.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.395+0000 7efdda48e640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efdc00b5330 0x7efdc00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:29.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.395+0000 7efdda48e640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efdc00b5330 0x7efdc00b77f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdd0031440 tx=0x7efdd0005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:29.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.397+0000 7efdcb7fe640 1 -- 172.21.15.131:0/652220792 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efdcc056220 con 0x7efdd4108020 2024-09-10T23:57:29.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:57:29.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:57:29.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:29.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:29 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:29 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:29.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:29.590+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7efdd4063590 con 0x7efdc00b5330 2024-09-10T23:57:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:57:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi019 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] boot 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:30.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:30 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:57:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:57:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi019 2024-09-10T23:57:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-10T23:57:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:30.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] boot 2024-09-10T23:57:30.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:57:30.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:30.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:30.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:30.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:30 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:30.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi019 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: osd.6 [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] boot 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:30 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:31.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:31 smithi131 ceph-mon[35491]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:31.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:31 smithi131 ceph-mon[35491]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:57:31.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:31 smithi135 ceph-mon[35432]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:31.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:31 smithi135 ceph-mon[35432]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:57:31.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:31 smithi019 ceph-mon[30859]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:31.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:31 smithi019 ceph-mon[30859]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:57:32.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:32 smithi019 ceph-mon[30859]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:32.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/2552946500' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"} : dispatch 2024-09-10T23:57:32.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:32 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"} : dispatch 2024-09-10T23:57:32.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:32 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"}]': finished 2024-09-10T23:57:32.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:32 smithi019 ceph-mon[30859]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:57:32.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:32 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:32 smithi131 ceph-mon[35491]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/2552946500' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"} : dispatch 2024-09-10T23:57:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:32 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"} : dispatch 2024-09-10T23:57:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:32 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"}]': finished 2024-09-10T23:57:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:32 smithi131 ceph-mon[35491]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:57:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:32 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:32 smithi135 ceph-mon[35432]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/2552946500' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"} : dispatch 2024-09-10T23:57:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:32 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"} : dispatch 2024-09-10T23:57:32.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:32 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a074eb86-fefd-4818-9c8b-0acceff1769c"}]': finished 2024-09-10T23:57:32.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:32 smithi135 ceph-mon[35432]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:57:32.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:32 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:33.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:33 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/807510434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:33.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:33 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/807510434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:33.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:33 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/807510434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:34.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:34 smithi019 ceph-mon[30859]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:34.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:34 smithi131 ceph-mon[35491]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:34.576 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:34 smithi135 ceph-mon[35432]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:36 smithi019 ceph-mon[30859]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:36 smithi131 ceph-mon[35491]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:36.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:36 smithi135 ceph-mon[35432]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:38.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:38 smithi131 ceph-mon[35491]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:38 smithi019 ceph-mon[30859]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:38 smithi135 ceph-mon[35432]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:40.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:40 smithi131 ceph-mon[35491]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:40.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:40 smithi019 ceph-mon[30859]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:40 smithi135 ceph-mon[35432]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:41.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:41 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:57:41.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:41 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:41 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:57:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:41 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:41.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:41 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:57:41.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:41 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:42.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:42 smithi131 ceph-mon[35491]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:42.468 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:42 smithi131 ceph-mon[35491]: Deploying daemon osd.7 on smithi131 2024-09-10T23:57:42.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:42 smithi019 ceph-mon[30859]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:42.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:42 smithi019 ceph-mon[30859]: Deploying daemon osd.7 on smithi131 2024-09-10T23:57:42.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:42 smithi135 ceph-mon[35432]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:42.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:42 smithi135 ceph-mon[35432]: Deploying daemon osd.7 on smithi131 2024-09-10T23:57:44.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:44 smithi019 ceph-mon[30859]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:44.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:44 smithi131 ceph-mon[35491]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:44.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:44 smithi135 ceph-mon[35432]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:46.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:46 smithi019 ceph-mon[30859]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:46.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:46 smithi131 ceph-mon[35491]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:46.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:46 smithi135 ceph-mon[35432]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:47.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:47.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:47.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:47.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:47.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:47.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:47.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:47.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:47.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:48.449 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:48 smithi131 ceph-mon[35491]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:48 smithi019 ceph-mon[30859]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:48 smithi135 ceph-mon[35432]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:49.806 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 7 on host 'smithi131' 2024-09-10T23:57:49.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.805+0000 7efdcb7fe640 1 -- 172.21.15.131:0/652220792 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efdd4063590 con 0x7efdc00b5330 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efdc00b5330 msgr2=0x7efdc00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efdc00b5330 0x7efdc00b77f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdd0031440 tx=0x7efdd0005b50 comp rx=0 tx=0).stop 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4108020 msgr2=0x7efdd419eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4108020 0x7efdd419eb30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00eb10 tx=0x7efdcc00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 shutdown_connections 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd4108020 0x7efdd419eb30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efdc00b5330 0x7efdc00b77f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd41076a0 0x7efdd4199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 --2- 172.21.15.131:0/652220792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd4101c90 0x7efdd4199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 >> 172.21.15.131:0/652220792 conn(0x7efdd40fd700 msgr2=0x7efdd406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:49.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 shutdown_connections 2024-09-10T23:57:49.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:57:49.807+0000 7efddc6f2640 1 -- 172.21.15.131:0/652220792 wait complete. 2024-09-10T23:57:50.378 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:50 smithi131 ceph-mon[35491]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:50.378 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:50.378 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:50.380 DEBUG:teuthology.orchestra.run.smithi131:osd.7> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T23:57:50.382 INFO:tasks.cephadm:Deploying osd.8 on smithi135 with /dev/vg_nvme/lv_2... 2024-09-10T23:57:50.382 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:57:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:50 smithi019 ceph-mon[30859]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:50.641 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:57:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:50 smithi135 ceph-mon[35432]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:51.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:51 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:51.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:51 smithi131 ceph-mon[35491]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:51.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:51 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:51.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:51 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:51.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:51 smithi135 ceph-mon[35432]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:51.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:51 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:51.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:51 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:51.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:51 smithi019 ceph-mon[30859]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:51.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:51 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:53.051 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 10 23:57:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-10T23:57:52.780+0000 7f56c3823640 -1 osd.7 0 log_to_monitors true 2024-09-10T23:57:53.246 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:57:53.273 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-09-10T23:57:53.526 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:57:53.548 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:53 smithi135 ceph-mon[35432]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:53.548 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:53 smithi135 ceph-mon[35432]: from='osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:57:53.548 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:53 smithi135 ceph-mon[35432]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:57:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:53 smithi019 ceph-mon[30859]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:53 smithi019 ceph-mon[30859]: from='osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:57:53.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:53 smithi019 ceph-mon[30859]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:57:53.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:53 smithi131 ceph-mon[35491]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:53.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:53 smithi131 ceph-mon[35491]: from='osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:57:53.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:53 smithi131 ceph-mon[35491]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 -- 172.21.15.135:0/2800937569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8108020 msgr2=0x7f19d810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 --2- 172.21.15.135:0/2800937569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8108020 0x7f19d810e820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009ca0 tx=0x7f19d002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 -- 172.21.15.135:0/2800937569 shutdown_connections 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 --2- 172.21.15.135:0/2800937569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8108020 0x7f19d810e820 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 --2- 172.21.15.135:0/2800937569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d81076a0 0x7f19d8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 --2- 172.21.15.135:0/2800937569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d8101c90 0x7f19d8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 -- 172.21.15.135:0/2800937569 >> 172.21.15.135:0/2800937569 conn(0x7f19d80fd700 msgr2=0x7f19d80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 -- 172.21.15.135:0/2800937569 shutdown_connections 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.033+0000 7f19dc96b640 1 -- 172.21.15.135:0/2800937569 wait complete. 2024-09-10T23:57:54.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 Processor -- start 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 -- start start 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8101c90 0x7f19d8199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d81076a0 0x7f19d8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d8108020 0x7f19d819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8111ca0 con 0x7f19d81076a0 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8111b20 con 0x7f19d8108020 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19dc96b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8111e20 con 0x7f19d8101c90 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8101c90 0x7f19d8199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8101c90 0x7f19d8199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53824/0 (socket says 172.21.15.135:53824) 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d659c640 1 -- 172.21.15.135:0/3782164250 learned_addr learned my addr 172.21.15.135:0/3782164250 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d5d9b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d81076a0 0x7f19d8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d6d9d640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d8108020 0x7f19d819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d659c640 1 -- 172.21.15.135:0/3782164250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d8108020 msgr2=0x7f19d819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d659c640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d8108020 0x7f19d819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d659c640 1 -- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d81076a0 msgr2=0x7f19d8199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.034+0000 7f19d659c640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d81076a0 0x7f19d8199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19d659c640 1 -- 172.21.15.135:0/3782164250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d819f2d0 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19d6d9d640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d8108020 0x7f19d819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19d659c640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8101c90 0x7f19d8199220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19c800e9f0 tx=0x7f19c800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19c77fe640 1 -- 172.21.15.135:0/3782164250 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c800cd80 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19c77fe640 1 -- 172.21.15.135:0/3782164250 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19c80108e0 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d819f5c0 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19c77fe640 1 -- 172.21.15.135:0/3782164250 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8018980 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.035+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81a5e50 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.036+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d8102070 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.038+0000 7f19c77fe640 1 -- 172.21.15.135:0/3782164250 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f19c8010430 con 0x7f19d8101c90 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.039+0000 7f19c77fe640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f19c00b53b0 0x7f19c00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.039+0000 7f19d5d9b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f19c00b53b0 0x7f19c00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.039+0000 7f19c77fe640 1 -- 172.21.15.135:0/3782164250 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5316+0+0 (secure 0 0 0) 0x7f19c80e5920 con 0x7f19d8101c90 2024-09-10T23:57:54.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.039+0000 7f19d5d9b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f19c00b53b0 0x7f19c00b7870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19d8103d70 tx=0x7f19cc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.041+0000 7f19c77fe640 1 -- 172.21.15.135:0/3782164250 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f19c80ad2f0 con 0x7f19d8101c90 2024-09-10T23:57:54.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:57:54.237+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f19d80fde40 con 0x7f19c00b53b0 2024-09-10T23:57:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi131 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi131 to 5696M 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:54.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:54.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:54.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.791 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi131 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi131 to 5696M 2024-09-10T23:57:54.792 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:54.793 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:57:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:57:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:57:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi131 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi131 to 5696M 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:54.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:54.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:54.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:57:54.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:57:54.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:57:54.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:57:54.802 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:55.300 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-10T23:57:54.852+0000 7f56bf7a6640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:57:55.301 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 10 23:57:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-10T23:57:54.859+0000 7f56b75c5640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:57:55.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:55 smithi135 ceph-mon[35432]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:55.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:55 smithi135 ceph-mon[35432]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:57:55.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:55 smithi135 ceph-mon[35432]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:57:55.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:55.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:55 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:55.656 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:55 smithi135 ceph-mon[35432]: from='osd.7 ' entity='osd.7' 2024-09-10T23:57:55.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:55 smithi019 ceph-mon[30859]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:55.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:55 smithi019 ceph-mon[30859]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:57:55.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:55 smithi019 ceph-mon[30859]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:57:55.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:55.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:55 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:55.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:55 smithi019 ceph-mon[30859]: from='osd.7 ' entity='osd.7' 2024-09-10T23:57:55.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:55 smithi131 ceph-mon[35491]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:55.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:55 smithi131 ceph-mon[35491]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:57:55.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:55 smithi131 ceph-mon[35491]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:57:55.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:55.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:55 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:55.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:55 smithi131 ceph-mon[35491]: from='osd.7 ' entity='osd.7' 2024-09-10T23:57:56.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:56 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:57:56.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:56 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:57:56.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:56 smithi135 ceph-mon[35432]: osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] boot 2024-09-10T23:57:56.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:56 smithi135 ceph-mon[35432]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:57:56.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:56.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:56 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:57:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:56 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:57:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:56 smithi019 ceph-mon[30859]: osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] boot 2024-09-10T23:57:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:56 smithi019 ceph-mon[30859]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:57:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:56.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:56 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:57:56.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:56 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:57:56.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:56 smithi131 ceph-mon[35491]: osd.7 [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] boot 2024-09-10T23:57:56.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:56 smithi131 ceph-mon[35491]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:57:56.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:57:57.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:57:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/717568420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"} : dispatch 2024-09-10T23:57:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"} : dispatch 2024-09-10T23:57:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"}]': finished 2024-09-10T23:57:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T23:57:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:57:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:57 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/2182591308' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:57:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/717568420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"} : dispatch 2024-09-10T23:57:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"} : dispatch 2024-09-10T23:57:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"}]': finished 2024-09-10T23:57:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T23:57:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:57:57.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:57 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/2182591308' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:57:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:57:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/717568420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"} : dispatch 2024-09-10T23:57:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"} : dispatch 2024-09-10T23:57:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2127bf94-dfd0-46c0-885d-53f1144476d1"}]': finished 2024-09-10T23:57:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T23:57:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:57:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:57 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/2182591308' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:57:59.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:58 smithi019 ceph-mon[30859]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:57:59.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:57:59.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:58 smithi131 ceph-mon[35491]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:57:59.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:57:59.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:58 smithi135 ceph-mon[35432]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:57:59.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:00.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:57:59 smithi019 ceph-mon[30859]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:57:59 smithi131 ceph-mon[35491]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:57:59 smithi135 ceph-mon[35432]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:01.796 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:01 smithi135 ceph-mon[35432]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:02.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:01 smithi019 ceph-mon[30859]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:02.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:01 smithi131 ceph-mon[35491]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:03.860 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:03 smithi135 ceph-mon[35432]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:58:04.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:03 smithi019 ceph-mon[30859]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:58:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:03 smithi131 ceph-mon[35491]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:58:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:05 smithi019 ceph-mon[30859]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:58:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:58:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:05 smithi019 ceph-mon[30859]: Deploying daemon osd.8 on smithi135 2024-09-10T23:58:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:05 smithi131 ceph-mon[35491]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:58:06.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:58:06.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:06.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:05 smithi131 ceph-mon[35491]: Deploying daemon osd.8 on smithi135 2024-09-10T23:58:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:05 smithi135 ceph-mon[35432]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:58:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:58:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:05 smithi135 ceph-mon[35432]: Deploying daemon osd.8 on smithi135 2024-09-10T23:58:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:07 smithi019 ceph-mon[30859]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T23:58:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:07 smithi131 ceph-mon[35491]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T23:58:08.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:07 smithi135 ceph-mon[35432]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T23:58:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:09 smithi019 ceph-mon[30859]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:58:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:09 smithi131 ceph-mon[35491]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:58:10.082 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:09 smithi135 ceph-mon[35432]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:58:12.011 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:11 smithi135 ceph-mon[35432]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:58:12.011 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:12.011 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:12.012 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:12.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:11 smithi019 ceph-mon[30859]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:58:12.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:12.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:12.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:11 smithi131 ceph-mon[35491]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:58:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:13.909 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:13 smithi135 ceph-mon[35432]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:58:14.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:13 smithi019 ceph-mon[30859]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:58:14.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:13 smithi131 ceph-mon[35491]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:58:15.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:15.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:15.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.204 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 8 on host 'smithi135' 2024-09-10T23:58:15.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.202+0000 7f19c77fe640 1 -- 172.21.15.135:0/3782164250 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f19d80fde40 con 0x7f19c00b53b0 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.204+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f19c00b53b0 msgr2=0x7f19c00b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.204+0000 7f19dc96b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f19c00b53b0 0x7f19c00b7870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19d8103d70 tx=0x7f19cc00b390 comp rx=0 tx=0).stop 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.204+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8101c90 msgr2=0x7f19d8199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.204+0000 7f19dc96b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8101c90 0x7f19d8199220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19c800e9f0 tx=0x7f19c800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 shutdown_connections 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d8108020 0x7f19d819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f19c00b53b0 0x7f19c00b7870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d81076a0 0x7f19d8199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 --2- 172.21.15.135:0/3782164250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d8101c90 0x7f19d8199220 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:15.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 >> 172.21.15.135:0/3782164250 conn(0x7f19d80fd700 msgr2=0x7f19d8106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:15.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 shutdown_connections 2024-09-10T23:58:15.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:58:15.205+0000 7f19dc96b640 1 -- 172.21.15.135:0/3782164250 wait complete. 2024-09-10T23:58:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:15.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:15.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:15.964 DEBUG:teuthology.orchestra.run.smithi135:osd.8> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T23:58:15.967 INFO:tasks.cephadm:Deploying osd.9 on smithi019 with /dev/vg_nvme/lv_1... 2024-09-10T23:58:15.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:58:16.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:16 smithi135 ceph-mon[35432]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:16.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:16 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:16.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:16 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:16.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:16 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:16.240 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:58:16.270 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:16 smithi019 ceph-mon[30859]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:16.270 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:16 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:16.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:16 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:16.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:16 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:16 smithi131 ceph-mon[35491]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:16 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:16 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:16 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:17.112 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 10 23:58:16 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-10T23:58:16.844+0000 7f9ea054e640 -1 osd.8 0 log_to_monitors true 2024-09-10T23:58:17.369 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:17 smithi135 ceph-mon[35432]: from='osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:58:17.369 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:17 smithi135 ceph-mon[35432]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:58:17.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:17 smithi019 ceph-mon[30859]: from='osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:58:17.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:17 smithi019 ceph-mon[30859]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:58:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:17 smithi131 ceph-mon[35491]: from='osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:58:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:17 smithi131 ceph-mon[35491]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:58:18.215 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:18 smithi019 ceph-mon[30859]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:18.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:18 smithi019 ceph-mon[30859]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:58:18.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:18 smithi019 ceph-mon[30859]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:58:18.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:18.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:18 smithi019 ceph-mon[30859]: from='osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:58:18.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:18 smithi019 ceph-mon[30859]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:58:18.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-10T23:58:18.117+0000 7f9e9c4d1640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T23:58:18.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-10T23:58:18.129+0000 7f9e982f8640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:58:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-mon[35432]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-mon[35432]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:58:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-mon[35432]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:58:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-mon[35432]: from='osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:58:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:18 smithi135 ceph-mon[35432]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:58:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:18 smithi131 ceph-mon[35491]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:18 smithi131 ceph-mon[35491]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:58:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:18 smithi131 ceph-mon[35491]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:58:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:18 smithi131 ceph-mon[35491]: from='osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:58:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:18 smithi131 ceph-mon[35491]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:58:19.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] boot 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:19.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:19.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:19 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:58:19.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:58:19.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] boot 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:19.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:19.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:19 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.332 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:58:19.357 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_1 2024-09-10T23:58:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:58:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:58:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: osd.8 [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] boot 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:19 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:58:20.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 -- 172.21.15.19:0/2595517401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30103ca0 msgr2=0x7f1a30104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/2595517401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30103ca0 0x7f1a30104080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009900 tx=0x7f1a2002a410 comp rx=0 tx=0).stop 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 -- 172.21.15.19:0/2595517401 shutdown_connections 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/2595517401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3010d100 0x7f1a3010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/2595517401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a301045c0 0x7f1a3010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/2595517401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30103ca0 0x7f1a30104080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 -- 172.21.15.19:0/2595517401 >> 172.21.15.19:0/2595517401 conn(0x7f1a300fd700 msgr2=0x7f1a300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 -- 172.21.15.19:0/2595517401 shutdown_connections 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 -- 172.21.15.19:0/2595517401 wait complete. 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 Processor -- start 2024-09-10T23:58:20.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.128+0000 7f1a35d1f640 1 -- start start 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a35d1f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a30103ca0 0x7f1a301992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a35d1f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301045c0 0x7f1a30199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a35d1f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3010d100 0x7f1a3019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a35d1f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112dc0 con 0x7f1a301045c0 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a35d1f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112c40 con 0x7f1a30103ca0 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a35d1f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112f40 con 0x7f1a3010d100 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301045c0 0x7f1a30199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301045c0 0x7f1a30199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43968/0 (socket says 172.21.15.19:43968) 2024-09-10T23:58:20.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 -- 172.21.15.19:0/3150242011 learned_addr learned my addr 172.21.15.19:0/3150242011 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2f7fe640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a30103ca0 0x7f1a301992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3010d100 0x7f1a3019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 -- 172.21.15.19:0/3150242011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3010d100 msgr2=0x7f1a3019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3010d100 0x7f1a3019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 -- 172.21.15.19:0/3150242011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a30103ca0 msgr2=0x7f1a301992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a30103ca0 0x7f1a301992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 -- 172.21.15.19:0/3150242011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3019f3a0 con 0x7f1a301045c0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.129+0000 7f1a2effd640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301045c0 0x7f1a30199830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e9c0 tx=0x7f1a2400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.130+0000 7f1a2cff9640 1 -- 172.21.15.19:0/3150242011 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400ccc0 con 0x7f1a301045c0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.130+0000 7f1a2cff9640 1 -- 172.21.15.19:0/3150242011 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a240035f0 con 0x7f1a301045c0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.130+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3019f690 con 0x7f1a301045c0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.130+0000 7f1a2cff9640 1 -- 172.21.15.19:0/3150242011 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400ce60 con 0x7f1a301045c0 2024-09-10T23:58:20.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.130+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301a5d50 con 0x7f1a301045c0 2024-09-10T23:58:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.131+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a30104080 con 0x7f1a301045c0 2024-09-10T23:58:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.132+0000 7f1a2cff9640 1 -- 172.21.15.19:0/3150242011 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f1a24004000 con 0x7f1a301045c0 2024-09-10T23:58:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.133+0000 7f1a2cff9640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a180b53b0 0x7f1a180b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.133+0000 7f1a2f7fe640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a180b53b0 0x7f1a180b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.133+0000 7f1a2cff9640 1 -- 172.21.15.19:0/3150242011 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6044+0+0 (secure 0 0 0) 0x7f1a240e56a0 con 0x7f1a301045c0 2024-09-10T23:58:20.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.133+0000 7f1a2f7fe640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a180b53b0 0x7f1a180b7870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a20005ab0 tx=0x7f1a20005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.136+0000 7f1a2cff9640 1 -- 172.21.15.19:0/3150242011 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1a240ace40 con 0x7f1a301045c0 2024-09-10T23:58:20.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:20.336+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1a300ff310 con 0x7f1a180b53b0 2024-09-10T23:58:20.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:20 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:58:20.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:20 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:58:20.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:20 smithi019 ceph-mon[30859]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:20.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:20 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi135 2024-09-10T23:58:20.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:20 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi135 to 1938M 2024-09-10T23:58:20.338 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:20 smithi019 ceph-mon[30859]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:58:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:20 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:58:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:20 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:58:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:20 smithi135 ceph-mon[35432]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:20 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi135 2024-09-10T23:58:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:20 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi135 to 1938M 2024-09-10T23:58:20.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:20 smithi135 ceph-mon[35432]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:58:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:20 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:58:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:20 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:58:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:20 smithi131 ceph-mon[35491]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:58:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:20 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi135 2024-09-10T23:58:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:20 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi135 to 1938M 2024-09-10T23:58:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:20 smithi131 ceph-mon[35491]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:58:21.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:58:21.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:58:21.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:21.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:21 smithi135 ceph-mon[35432]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:58:21.465 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:58:21.465 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:58:21.465 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:21.465 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:21 smithi019 ceph-mon[30859]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:58:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:58:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:58:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:21.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:21 smithi131 ceph-mon[35491]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:58:22.239 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:22 smithi019 ceph-mon[30859]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:58:22.239 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:22 smithi019 ceph-mon[30859]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:22 smithi135 ceph-mon[35432]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:58:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:22 smithi135 ceph-mon[35432]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:22 smithi131 ceph-mon[35491]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:58:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:22 smithi131 ceph-mon[35491]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:23.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:23 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1048310247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cccb62ba-6dfe-49a3-9f16-698180c729b2"} : dispatch 2024-09-10T23:58:23.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:23 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1048310247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cccb62ba-6dfe-49a3-9f16-698180c729b2"}]': finished 2024-09-10T23:58:23.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:23 smithi135 ceph-mon[35432]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:58:23.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:23 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:23 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1048310247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cccb62ba-6dfe-49a3-9f16-698180c729b2"} : dispatch 2024-09-10T23:58:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:23 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1048310247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cccb62ba-6dfe-49a3-9f16-698180c729b2"}]': finished 2024-09-10T23:58:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:23 smithi019 ceph-mon[30859]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:58:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:23 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:23 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1048310247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cccb62ba-6dfe-49a3-9f16-698180c729b2"} : dispatch 2024-09-10T23:58:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:23 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1048310247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cccb62ba-6dfe-49a3-9f16-698180c729b2"}]': finished 2024-09-10T23:58:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:23 smithi131 ceph-mon[35491]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:58:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:23 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:24 smithi135 ceph-mon[35432]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-10T23:58:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:24 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/547825405' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:58:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:24 smithi019 ceph-mon[30859]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-10T23:58:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:24 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/547825405' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:58:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:24 smithi131 ceph-mon[35491]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-10T23:58:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:24 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/547825405' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:58:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:26 smithi135 ceph-mon[35432]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T23:58:26.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:26 smithi019 ceph-mon[30859]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T23:58:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:26 smithi131 ceph-mon[35491]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T23:58:28.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:28 smithi135 ceph-mon[35432]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T23:58:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:28 smithi019 ceph-mon[30859]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T23:58:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:28 smithi131 ceph-mon[35491]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T23:58:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:30 smithi135 ceph-mon[35432]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:58:30.490 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:30 smithi019 ceph-mon[30859]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:58:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:30 smithi131 ceph-mon[35491]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:58:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:32 smithi135 ceph-mon[35432]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:58:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:32 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:58:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:32 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:32.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:32 smithi019 ceph-mon[30859]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:58:32.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:32 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:58:32.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:32 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:32 smithi131 ceph-mon[35491]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:58:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:32 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:58:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:32 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:33.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:33 smithi135 ceph-mon[35432]: Deploying daemon osd.9 on smithi019 2024-09-10T23:58:33.456 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:33 smithi019 ceph-mon[30859]: Deploying daemon osd.9 on smithi019 2024-09-10T23:58:33.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:33 smithi131 ceph-mon[35491]: Deploying daemon osd.9 on smithi019 2024-09-10T23:58:34.332 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:34 smithi019 ceph-mon[30859]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:34 smithi135 ceph-mon[35432]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:34.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:34 smithi131 ceph-mon[35491]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:36.265 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:36 smithi019 ceph-mon[30859]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:36 smithi135 ceph-mon[35432]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:36 smithi131 ceph-mon[35491]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:38.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:38 smithi019 ceph-mon[30859]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:38.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:38 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:38.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:38 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:38.249 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:38 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:38 smithi135 ceph-mon[35432]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:38 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:38 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:38 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:38 smithi131 ceph-mon[35491]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:38 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:38 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:38 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:40 smithi135 ceph-mon[35432]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:40.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:40 smithi019 ceph-mon[30859]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:40 smithi131 ceph-mon[35491]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:41.040 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 9 on host 'smithi019' 2024-09-10T23:58:41.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.038+0000 7f1a2cff9640 1 -- 172.21.15.19:0/3150242011 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1a300ff310 con 0x7f1a180b53b0 2024-09-10T23:58:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a180b53b0 msgr2=0x7f1a180b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a180b53b0 0x7f1a180b7870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a20005ab0 tx=0x7f1a20005a20 comp rx=0 tx=0).stop 2024-09-10T23:58:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301045c0 msgr2=0x7f1a30199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301045c0 0x7f1a30199830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e9c0 tx=0x7f1a2400ee80 comp rx=0 tx=0).stop 2024-09-10T23:58:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 shutdown_connections 2024-09-10T23:58:41.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3010d100 0x7f1a3019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a180b53b0 0x7f1a180b7870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301045c0 0x7f1a30199830 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 --2- 172.21.15.19:0/3150242011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a30103ca0 0x7f1a301992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 >> 172.21.15.19:0/3150242011 conn(0x7f1a300fd700 msgr2=0x7f1a3010f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 shutdown_connections 2024-09-10T23:58:41.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:58:41.041+0000 7f1a35d1f640 1 -- 172.21.15.19:0/3150242011 wait complete. 2024-09-10T23:58:41.744 DEBUG:teuthology.orchestra.run.smithi019:osd.9> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T23:58:41.747 INFO:tasks.cephadm:Deploying osd.10 on smithi131 with /dev/vg_nvme/lv_1... 2024-09-10T23:58:41.747 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:58:42.005 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:58:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:42 smithi131 ceph-mon[35491]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:42 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:42 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:42 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:42 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.361 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:42 smithi019 ceph-mon[30859]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:42.361 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:42 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.361 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:42 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.361 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:42 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.361 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:42 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:42 smithi135 ceph-mon[35432]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:42 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:42 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:42 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:42 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:44.023 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 23:58:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-10T23:58:43.574+0000 7f0cdefe5640 -1 osd.9 0 log_to_monitors true 2024-09-10T23:58:44.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:44 smithi131 ceph-mon[35491]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:44.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:44 smithi131 ceph-mon[35491]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:58:44.289 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:44 smithi019 ceph-mon[30859]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:44.289 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:44 smithi019 ceph-mon[30859]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:58:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:44 smithi135 ceph-mon[35432]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:44 smithi135 ceph-mon[35432]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:58:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T23:58:44.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_1 2024-09-10T23:58:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:58:45.233 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:45 smithi131 ceph-mon[35491]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:58:45.233 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:45 smithi131 ceph-mon[35491]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:58:45.233 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:45 smithi131 ceph-mon[35491]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:58:45.233 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:45.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:45 smithi135 ceph-mon[35432]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:58:45.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:45 smithi135 ceph-mon[35432]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:58:45.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:45 smithi135 ceph-mon[35432]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:58:45.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:45.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:45 smithi019 ceph-mon[30859]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:58:45.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:45 smithi019 ceph-mon[30859]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:58:45.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:45 smithi019 ceph-mon[30859]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T23:58:45.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:45.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 23:58:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-10T23:58:45.048+0000 7f0cdaf68640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T23:58:45.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 23:58:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-10T23:58:45.058+0000 7f0cd6d8f640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:58:45.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 -- 172.21.15.131:0/1774231402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe581076e0 msgr2=0x7efe58107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:45.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 --2- 172.21.15.131:0/1774231402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe581076e0 0x7efe58107b20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009900 tx=0x7efe4c02a410 comp rx=0 tx=0).stop 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 -- 172.21.15.131:0/1774231402 shutdown_connections 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 --2- 172.21.15.131:0/1774231402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58108060 0x7efe5810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 --2- 172.21.15.131:0/1774231402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe581076e0 0x7efe58107b20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 --2- 172.21.15.131:0/1774231402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe58101cd0 0x7efe581020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 -- 172.21.15.131:0/1774231402 >> 172.21.15.131:0/1774231402 conn(0x7efe580fd700 msgr2=0x7efe580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 -- 172.21.15.131:0/1774231402 shutdown_connections 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.606+0000 7efe5c962640 1 -- 172.21.15.131:0/1774231402 wait complete. 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 Processor -- start 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 -- start start 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58101cd0 0x7efe58199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe581076e0 0x7efe58199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe58108060 0x7efe5819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:45.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111d20 con 0x7efe58101cd0 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111ba0 con 0x7efe58108060 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe5c962640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111ea0 con 0x7efe581076e0 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe56d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe58108060 0x7efe5819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe56d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe58108060 0x7efe5819ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53670/0 (socket says 172.21.15.131:53670) 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.607+0000 7efe56d9d640 1 -- 172.21.15.131:0/1241849016 learned_addr learned my addr 172.21.15.131:0/1241849016 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe55d9b640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe581076e0 0x7efe58199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe5659c640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58101cd0 0x7efe58199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe56d9d640 1 -- 172.21.15.131:0/1241849016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe581076e0 msgr2=0x7efe58199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe56d9d640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe581076e0 0x7efe58199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe56d9d640 1 -- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58101cd0 msgr2=0x7efe58199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe56d9d640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58101cd0 0x7efe58199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe56d9d640 1 -- 172.21.15.131:0/1241849016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5819f3c0 con 0x7efe58108060 2024-09-10T23:58:45.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe56d9d640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe58108060 0x7efe5819ebf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efe5000b970 tx=0x7efe5000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe477fe640 1 -- 172.21.15.131:0/1241849016 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50019070 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5819f6b0 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe477fe640 1 -- 172.21.15.131:0/1241849016 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe50014440 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe477fe640 1 -- 172.21.15.131:0/1241849016 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500075d0 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.608+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe581a5df0 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.609+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe581020b0 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.610+0000 7efe477fe640 1 -- 172.21.15.131:0/1241849016 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7efe5000cb40 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.611+0000 7efe477fe640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efe400b5330 0x7efe400b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.612+0000 7efe477fe640 1 -- 172.21.15.131:0/1241849016 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6196+0+0 (secure 0 0 0) 0x7efe500e5090 con 0x7efe58108060 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.612+0000 7efe5659c640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efe400b5330 0x7efe400b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.612+0000 7efe5659c640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efe400b5330 0x7efe400b77f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe4800bbe0 tx=0x7efe4800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.615+0000 7efe477fe640 1 -- 172.21.15.131:0/1241849016 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efe500ac0a0 con 0x7efe58108060 2024-09-10T23:58:45.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:58:45.798+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7efe581002d0 con 0x7efe400b5330 2024-09-10T23:58:46.319 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi019 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.320 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:58:46.321 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi019 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:58:46.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi019 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:58:46.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:47.196 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:47 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:58:47.196 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:47 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:58:47.196 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:47 smithi131 ceph-mon[35491]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:58:47.196 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:47 smithi131 ceph-mon[35491]: osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] boot 2024-09-10T23:58:47.196 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:47 smithi131 ceph-mon[35491]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:58:47.196 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:47.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:47 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:58:47.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:47 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:58:47.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:47 smithi019 ceph-mon[30859]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:58:47.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:47 smithi019 ceph-mon[30859]: osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] boot 2024-09-10T23:58:47.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:47 smithi019 ceph-mon[30859]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:58:47.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:47 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:58:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:47 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:58:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:47 smithi135 ceph-mon[35432]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:58:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:47 smithi135 ceph-mon[35432]: osd.9 [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] boot 2024-09-10T23:58:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:47 smithi135 ceph-mon[35432]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:58:47.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:58:48.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:48 smithi019 ceph-mon[30859]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:48.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:48 smithi019 ceph-mon[30859]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:58:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:48 smithi131 ceph-mon[35491]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:48 smithi131 ceph-mon[35491]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:58:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:48 smithi135 ceph-mon[35432]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:58:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:48 smithi135 ceph-mon[35432]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:58:49.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:49 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/2215529763' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"} : dispatch 2024-09-10T23:58:49.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:49 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"} : dispatch 2024-09-10T23:58:49.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:49 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"}]': finished 2024-09-10T23:58:49.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:49 smithi135 ceph-mon[35432]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:58:49.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:58:49.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:49 smithi135 ceph-mon[35432]: from='client.? 172.21.15.131:0/3092592792' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:58:49.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:49 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/2215529763' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"} : dispatch 2024-09-10T23:58:49.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:49 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"} : dispatch 2024-09-10T23:58:49.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:49 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"}]': finished 2024-09-10T23:58:49.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:49 smithi019 ceph-mon[30859]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:58:49.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:58:49.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:49 smithi019 ceph-mon[30859]: from='client.? 172.21.15.131:0/3092592792' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:58:49.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:49 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/2215529763' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"} : dispatch 2024-09-10T23:58:49.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:49 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"} : dispatch 2024-09-10T23:58:49.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:49 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09ffbe08-03ae-468f-bf97-3e4698091550"}]': finished 2024-09-10T23:58:49.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:49 smithi131 ceph-mon[35491]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:58:49.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:58:49.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:49 smithi131 ceph-mon[35491]: from='client.? 172.21.15.131:0/3092592792' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:58:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:50 smithi019 ceph-mon[30859]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:50 smithi131 ceph-mon[35491]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:50 smithi135 ceph-mon[35432]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:52.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:52 smithi019 ceph-mon[30859]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:52.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:52 smithi131 ceph-mon[35491]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:52.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:52 smithi135 ceph-mon[35432]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:54.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:54 smithi131 ceph-mon[35491]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:54.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:54 smithi019 ceph-mon[30859]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:54.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:54 smithi135 ceph-mon[35432]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:56.519 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:56 smithi131 ceph-mon[35491]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:56.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:56 smithi019 ceph-mon[30859]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:56.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:56 smithi135 ceph-mon[35432]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:57.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:58:57.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:57.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:58:57.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:57.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:58:57.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:58.469 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:58 smithi131 ceph-mon[35491]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:58.469 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:58:58 smithi131 ceph-mon[35491]: Deploying daemon osd.10 on smithi131 2024-09-10T23:58:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:58 smithi019 ceph-mon[30859]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:58:58 smithi019 ceph-mon[30859]: Deploying daemon osd.10 on smithi131 2024-09-10T23:58:58.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:58 smithi135 ceph-mon[35432]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:58:58.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:58:58 smithi135 ceph-mon[35432]: Deploying daemon osd.10 on smithi131 2024-09-10T23:59:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:00 smithi131 ceph-mon[35491]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:00.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:00 smithi019 ceph-mon[30859]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:00 smithi135 ceph-mon[35432]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:02.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:02 smithi019 ceph-mon[30859]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:02.544 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:02 smithi131 ceph-mon[35491]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:02.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:02 smithi135 ceph-mon[35432]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:03.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:03.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:03.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:03.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:03.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:03.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:03.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:04.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:04 smithi131 ceph-mon[35491]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:04.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:04 smithi019 ceph-mon[30859]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:04.576 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:04 smithi135 ceph-mon[35432]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:05.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.924+0000 7efe477fe640 1 -- 172.21.15.131:0/1241849016 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7efe581002d0 con 0x7efe400b5330 2024-09-10T23:59:05.925 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 10 on host 'smithi131' 2024-09-10T23:59:05.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efe400b5330 msgr2=0x7efe400b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:05.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efe400b5330 0x7efe400b77f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe4800bbe0 tx=0x7efe4800b390 comp rx=0 tx=0).stop 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe58108060 msgr2=0x7efe5819ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe58108060 0x7efe5819ebf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efe5000b970 tx=0x7efe5000be30 comp rx=0 tx=0).stop 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 shutdown_connections 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe58108060 0x7efe5819ebf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe581076e0 0x7efe58199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efe400b5330 0x7efe400b77f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 --2- 172.21.15.131:0/1241849016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58101cd0 0x7efe58199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 >> 172.21.15.131:0/1241849016 conn(0x7efe580fd700 msgr2=0x7efe5806b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 shutdown_connections 2024-09-10T23:59:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T23:59:05.926+0000 7efe5c962640 1 -- 172.21.15.131:0/1241849016 wait complete. 2024-09-10T23:59:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:06 smithi019 ceph-mon[30859]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:06.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:06 smithi131 ceph-mon[35491]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:06.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:06 smithi135 ceph-mon[35432]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:06.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:06.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:06.933 DEBUG:teuthology.orchestra.run.smithi131:osd.10> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T23:59:06.935 INFO:tasks.cephadm:Deploying osd.11 on smithi135 with /dev/vg_nvme/lv_1... 2024-09-10T23:59:06.936 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:59:07.188 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:59:08.176 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:08 smithi131 ceph-mon[35491]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:08.177 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:08.177 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:08 smithi135 ceph-mon[35432]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:08 smithi019 ceph-mon[30859]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:08.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:09.118 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 10 23:59:08 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-10T23:59:08.825+0000 7f4863faf640 -1 osd.10 0 log_to_monitors true 2024-09-10T23:59:09.402 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:09 smithi131 ceph-mon[35491]: from='osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:59:09.402 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:09 smithi131 ceph-mon[35491]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:59:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:09 smithi135 ceph-mon[35432]: from='osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:59:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:09 smithi135 ceph-mon[35432]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:59:09.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:09 smithi019 ceph-mon[30859]: from='osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:59:09.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:09 smithi019 ceph-mon[30859]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:59:09.963 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T23:59:09.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-09-10T23:59:10.237 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:59:10.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:10 smithi135 ceph-mon[35432]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:10.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:10 smithi135 ceph-mon[35432]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:59:10.358 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:10 smithi135 ceph-mon[35432]: from='osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:59:10.358 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:10 smithi135 ceph-mon[35432]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:59:10.358 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:10 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:10.358 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:10 smithi135 ceph-mon[35432]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:59:10.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:10 smithi019 ceph-mon[30859]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:10.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:10 smithi019 ceph-mon[30859]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:59:10.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:10 smithi019 ceph-mon[30859]: from='osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:59:10.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:10 smithi019 ceph-mon[30859]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:59:10.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:10 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:10.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:10 smithi019 ceph-mon[30859]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:59:10.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-10T23:59:10.127+0000 7f485ff32640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T23:59:10.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-10T23:59:10.141+0000 7f485bd59640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:59:10.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-mon[35491]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:10.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-mon[35491]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:59:10.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-mon[35491]: from='osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:59:10.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-mon[35491]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:59:10.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:10.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:10 smithi131 ceph-mon[35491]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]} : dispatch 2024-09-10T23:59:10.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.715+0000 7f90e148a640 1 -- 172.21.15.135:0/267549237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc101cb0 msgr2=0x7f90dc102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.715+0000 7f90e148a640 1 --2- 172.21.15.135:0/267549237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc101cb0 0x7f90dc102090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009900 tx=0x7f90cc02a410 comp rx=0 tx=0).stop 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 -- 172.21.15.135:0/267549237 shutdown_connections 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 --2- 172.21.15.135:0/267549237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90dc108040 0x7f90dc10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 --2- 172.21.15.135:0/267549237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90dc1076c0 0x7f90dc107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 --2- 172.21.15.135:0/267549237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc101cb0 0x7f90dc102090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 -- 172.21.15.135:0/267549237 >> 172.21.15.135:0/267549237 conn(0x7f90dc0fd700 msgr2=0x7f90dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 -- 172.21.15.135:0/267549237 shutdown_connections 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 -- 172.21.15.135:0/267549237 wait complete. 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 Processor -- start 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 -- start start 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90dc101cb0 0x7f90dc1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc1076c0 0x7f90dc199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:10.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.716+0000 7f90e148a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90dc108040 0x7f90dc19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90e148a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc111d00 con 0x7f90dc101cb0 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90e148a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc111b80 con 0x7f90dc108040 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90e148a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc111e80 con 0x7f90dc1076c0 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc1076c0 0x7f90dc199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc1076c0 0x7f90dc199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53690/0 (socket says 172.21.15.135:53690) 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 -- 172.21.15.135:0/1965397783 learned_addr learned my addr 172.21.15.135:0/1965397783 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90daffd640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90dc101cb0 0x7f90dc1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90db7fe640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90dc108040 0x7f90dc19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 -- 172.21.15.135:0/1965397783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90dc108040 msgr2=0x7f90dc19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90dc108040 0x7f90dc19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 -- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90dc101cb0 msgr2=0x7f90dc1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90dc101cb0 0x7f90dc1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 -- 172.21.15.135:0/1965397783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc19f380 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d3fff640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc1076c0 0x7f90dc199810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90c400e9f0 tx=0x7f90c400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d8ff9640 1 -- 172.21.15.135:0/1965397783 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c400cd80 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d8ff9640 1 -- 172.21.15.135:0/1965397783 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90c40054d0 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90dc19f670 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90d8ff9640 1 -- 172.21.15.135:0/1965397783 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c4010690 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.717+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90dc1a5d30 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.719+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90dc102090 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.720+0000 7f90d8ff9640 1 -- 172.21.15.135:0/1965397783 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f90c4004e90 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.721+0000 7f90d8ff9640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f90c80b53b0 0x7f90c80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.721+0000 7f90d8ff9640 1 -- 172.21.15.135:0/1965397783 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6629+0+0 (secure 0 0 0) 0x7f90c40e5980 con 0x7f90dc1076c0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.721+0000 7f90daffd640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f90c80b53b0 0x7f90c80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.722+0000 7f90daffd640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f90c80b53b0 0x7f90c80b7870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90cc031440 tx=0x7f90cc005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:10.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.725+0000 7f90d8ff9640 1 -- 172.21.15.135:0/1965397783 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f90c40aced0 con 0x7f90dc1076c0 2024-09-10T23:59:10.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:10.915+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f90dc063590 con 0x7f90c80b53b0 2024-09-10T23:59:11.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:59:11.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:59:11.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:11.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:11.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:59:11.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:59:11.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:59:11.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:59:11.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-10T23:59:11.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:59:11.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:59:11.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi131 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi131 to 4272M 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] boot 2024-09-10T23:59:12.325 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:59:12.326 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:12 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:12.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:59:12.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:59:12.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:12.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi131 2024-09-10T23:59:12.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi131 to 4272M 2024-09-10T23:59:12.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:12.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] boot 2024-09-10T23:59:12.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:59:12.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:12 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi131 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi131 to 4272M 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: osd.10 [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] boot 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:59:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:12 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:59:13.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:13 smithi135 ceph-mon[35432]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:59:13.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:13 smithi019 ceph-mon[30859]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:59:13.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:13 smithi131 ceph-mon[35491]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:59:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:59:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/1571684785' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"} : dispatch 2024-09-10T23:59:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"} : dispatch 2024-09-10T23:59:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"}]': finished 2024-09-10T23:59:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:59:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:14 smithi135 ceph-mon[35432]: from='client.? 172.21.15.135:0/1514367310' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:59:14.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:14.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:59:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/1571684785' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"} : dispatch 2024-09-10T23:59:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"} : dispatch 2024-09-10T23:59:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"}]': finished 2024-09-10T23:59:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:59:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:14.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:14 smithi019 ceph-mon[30859]: from='client.? 172.21.15.135:0/1514367310' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/1571684785' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"} : dispatch 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"} : dispatch 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc762f9a-dc74-4101-8173-04b4736231d9"}]': finished 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:14 smithi131 ceph-mon[35491]: from='client.? 172.21.15.135:0/1514367310' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:59:16.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:16 smithi135 ceph-mon[35432]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:16.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:16 smithi019 ceph-mon[30859]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:16 smithi131 ceph-mon[35491]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:18 smithi135 ceph-mon[35432]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:18 smithi019 ceph-mon[30859]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:18 smithi131 ceph-mon[35491]: pgmap v217: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:20.381 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:20 smithi135 ceph-mon[35432]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T23:59:20.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:20 smithi019 ceph-mon[30859]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T23:59:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:20 smithi131 ceph-mon[35491]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T23:59:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:22 smithi135 ceph-mon[35432]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:59:22.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:59:22.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:22.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:22 smithi019 ceph-mon[30859]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:59:22.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:59:22.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:22 smithi131 ceph-mon[35491]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:59:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:59:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:23.300 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:23 smithi135 ceph-mon[35432]: Deploying daemon osd.11 on smithi135 2024-09-10T23:59:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:23 smithi019 ceph-mon[30859]: Deploying daemon osd.11 on smithi135 2024-09-10T23:59:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:23 smithi131 ceph-mon[35491]: Deploying daemon osd.11 on smithi135 2024-09-10T23:59:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:24 smithi135 ceph-mon[35432]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:59:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:24 smithi019 ceph-mon[30859]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:59:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:24 smithi131 ceph-mon[35491]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:59:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:26 smithi135 ceph-mon[35432]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:59:26.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:26 smithi019 ceph-mon[30859]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:59:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:26 smithi131 ceph-mon[35491]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:59:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:28 smithi019 ceph-mon[30859]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:59:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:28.549 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:28 smithi135 ceph-mon[35432]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:59:28.549 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:28.549 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:28.549 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:28 smithi131 ceph-mon[35491]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:59:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:30 smithi135 ceph-mon[35432]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:59:30.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:30 smithi019 ceph-mon[30859]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:59:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:30 smithi131 ceph-mon[35491]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:59:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.577+0000 7f90d8ff9640 1 -- 172.21.15.135:0/1965397783 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f90dc063590 con 0x7f90c80b53b0 2024-09-10T23:59:31.579 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 11 on host 'smithi135' 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f90c80b53b0 msgr2=0x7f90c80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f90c80b53b0 0x7f90c80b7870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90cc031440 tx=0x7f90cc005b50 comp rx=0 tx=0).stop 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc1076c0 msgr2=0x7f90dc199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc1076c0 0x7f90dc199810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90c400e9f0 tx=0x7f90c400edf0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 shutdown_connections 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90dc108040 0x7f90dc19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90dc1076c0 0x7f90dc199810 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f90c80b53b0 0x7f90c80b7870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 --2- 172.21.15.135:0/1965397783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90dc101cb0 0x7f90dc1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 >> 172.21.15.135:0/1965397783 conn(0x7f90dc0fd700 msgr2=0x7f90dc06b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 shutdown_connections 2024-09-10T23:59:31.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:31.580+0000 7f90e148a640 1 -- 172.21.15.135:0/1965397783 wait complete. 2024-09-10T23:59:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:32.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:31 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.231 DEBUG:teuthology.orchestra.run.smithi135:osd.11> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T23:59:32.233 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T23:59:32.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:59:32.262 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:32.262 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.262 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.262 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:32.262 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:32.263 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.263 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:32.263 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.263 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:31 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:32.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:31 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:32.505 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.086+0000 7f5337691640 1 -- 172.21.15.19:0/2702788052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53301087d0 msgr2=0x7f5330108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.086+0000 7f5337691640 1 --2- 172.21.15.19:0/2702788052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53301087d0 0x7f5330108c10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5324009900 tx=0x7f532402a410 comp rx=0 tx=0).stop 2024-09-10T23:59:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- 172.21.15.19:0/2702788052 shutdown_connections 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 --2- 172.21.15.19:0/2702788052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5330109150 0x7f533010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 --2- 172.21.15.19:0/2702788052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53301087d0 0x7f5330108c10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 --2- 172.21.15.19:0/2702788052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5330102dc0 0x7f53301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- 172.21.15.19:0/2702788052 >> 172.21.15.19:0/2702788052 conn(0x7f53300fe830 msgr2=0x7f5330100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- 172.21.15.19:0/2702788052 shutdown_connections 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- 172.21.15.19:0/2702788052 wait complete. 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 Processor -- start 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- start start 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5330102dc0 0x7f53301992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53301087d0 0x7f5330199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5330109150 0x7f533019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5330112e10 con 0x7f5330102dc0 2024-09-10T23:59:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5330112c90 con 0x7f5330109150 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.087+0000 7f5337691640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5330112f90 con 0x7f53301087d0 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5330102dc0 0x7f53301992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5330102dc0 0x7f53301992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33712/0 (socket says 172.21.15.19:33712) 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 -- 172.21.15.19:0/3317191526 learned_addr learned my addr 172.21.15.19:0/3317191526 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f5334c2c640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53301087d0 0x7f5330199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f5335c2e640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5330109150 0x7f533019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 -- 172.21.15.19:0/3317191526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53301087d0 msgr2=0x7f5330199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53301087d0 0x7f5330199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 -- 172.21.15.19:0/3317191526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5330109150 msgr2=0x7f533019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5330109150 0x7f533019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 -- 172.21.15.19:0/3317191526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533019f390 con 0x7f5330102dc0 2024-09-10T23:59:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f533542d640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5330102dc0 0x7f53301992e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f532800d770 tx=0x7f532800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f532e7fc640 1 -- 172.21.15.19:0/3317191526 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328017070 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f532e7fc640 1 -- 172.21.15.19:0/3317191526 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53280054d0 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f532e7fc640 1 -- 172.21.15.19:0/3317191526 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328004c30 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533019f680 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.088+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53301a5d40 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.089+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53301031a0 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.091+0000 7f532e7fc640 1 -- 172.21.15.19:0/3317191526 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f5328004e10 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.091+0000 7f532e7fc640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f53180b53b0 0x7f53180b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.092+0000 7f5334c2c640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f53180b53b0 0x7f53180b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.092+0000 7f532e7fc640 1 -- 172.21.15.19:0/3317191526 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7024+0+0 (secure 0 0 0) 0x7f53280e51a0 con 0x7f5330102dc0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.092+0000 7f5334c2c640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f53180b53b0 0x7f53180b7870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5324031440 tx=0x7f53240095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.096+0000 7f532e7fc640 1 -- 172.21.15.19:0/3317191526 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f53280ac570 con 0x7f5330102dc0 2024-09-10T23:59:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.282+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f533019a410 con 0x7f5330102dc0 2024-09-10T23:59:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.283+0000 7f532e7fc640 1 -- 172.21.15.19:0/3317191526 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f53280abe70 con 0x7f5330102dc0 2024-09-10T23:59:33.284 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f53180b53b0 msgr2=0x7f53180b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f53180b53b0 0x7f53180b7870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5324031440 tx=0x7f53240095f0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5330102dc0 msgr2=0x7f53301992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5330102dc0 0x7f53301992e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f532800d770 tx=0x7f532800dc30 comp rx=0 tx=0).stop 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 shutdown_connections 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5330109150 0x7f533019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53301087d0 0x7f5330199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f53180b53b0 0x7f53180b7870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 --2- 172.21.15.19:0/3317191526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5330102dc0 0x7f53301992e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 >> 172.21.15.19:0/3317191526 conn(0x7f53300fe830 msgr2=0x7f5330100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 shutdown_connections 2024-09-10T23:59:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:33.285+0000 7f5337691640 1 -- 172.21.15.19:0/3317191526 wait complete. 2024-09-10T23:59:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:33 smithi135 ceph-mon[35432]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:33 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3317191526' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:34.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:33 smithi135 ceph-mon[35432]: from='osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:59:34.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:33 smithi135 ceph-mon[35432]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:59:34.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 10 23:59:33 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-10T23:59:33.788+0000 7f9606fd5640 -1 osd.11 0 log_to_monitors true 2024-09-10T23:59:34.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:33 smithi019 ceph-mon[30859]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:33 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3317191526' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:33 smithi019 ceph-mon[30859]: from='osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:59:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:33 smithi019 ceph-mon[30859]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:59:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:33 smithi131 ceph-mon[35491]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:33 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3317191526' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:33 smithi131 ceph-mon[35491]: from='osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:59:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:33 smithi131 ceph-mon[35491]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:59:34.354 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726012751,"num_in_osds":12,"osd_in_since":1726012753,"num_remapped_pgs":0} 2024-09-10T23:59:35.089 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:34 smithi135 ceph-mon[35432]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:59:35.089 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:34 smithi135 ceph-mon[35432]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:59:35.089 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:34 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:35.089 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:34 smithi135 ceph-mon[35432]: from='osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:59:35.089 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:34 smithi135 ceph-mon[35432]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:59:35.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:34 smithi019 ceph-mon[30859]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:59:35.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:34 smithi019 ceph-mon[30859]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:59:35.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:34 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:35.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:34 smithi019 ceph-mon[30859]: from='osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:59:35.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:34 smithi019 ceph-mon[30859]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:59:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:34 smithi131 ceph-mon[35491]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:59:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:34 smithi131 ceph-mon[35491]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:59:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:34 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:34 smithi131 ceph-mon[35491]: from='osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:59:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:34 smithi131 ceph-mon[35491]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T23:59:35.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:59:35.425 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-10T23:59:35.292+0000 7f9602f58640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T23:59:35.425 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-10T23:59:35.305+0000 7f95fad77640 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:59:35.614 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:35.994 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: Detected new or changed devices on smithi135 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:35.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi135 to 1453M 2024-09-10T23:59:35.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:35.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:35.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:35.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:35.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:35 smithi019 ceph-mon[30859]: from='osd.11 ' entity='osd.11' 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 -- 172.21.15.19:0/4196670087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0109150 msgr2=0x7fb3f010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/4196670087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0109150 0x7fb3f010f950 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009ca0 tx=0x7fb3e802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 -- 172.21.15.19:0/4196670087 shutdown_connections 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/4196670087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0109150 0x7fb3f010f950 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/4196670087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3f01087d0 0x7fb3f0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/4196670087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3f0102dc0 0x7fb3f01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 -- 172.21.15.19:0/4196670087 >> 172.21.15.19:0/4196670087 conn(0x7fb3f00fe830 msgr2=0x7fb3f0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 -- 172.21.15.19:0/4196670087 shutdown_connections 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 -- 172.21.15.19:0/4196670087 wait complete. 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.076+0000 7fb3f49bf640 1 Processor -- start 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3f49bf640 1 -- start start 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3f49bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0102dc0 0x7fb3f0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3f49bf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3f01087d0 0x7fb3f0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3f49bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3f0109150 0x7fb3f019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3f49bf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0112e60 con 0x7fb3f0102dc0 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3f49bf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0112ce0 con 0x7fb3f0109150 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3f49bf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0112fe0 con 0x7fb3f01087d0 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0102dc0 0x7fb3f0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0102dc0 0x7fb3f0199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33740/0 (socket says 172.21.15.19:33740) 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 -- 172.21.15.19:0/1932334343 learned_addr learned my addr 172.21.15.19:0/1932334343 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3eed9d640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3f0109150 0x7fb3f019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3e5d9b640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3f01087d0 0x7fb3f0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 -- 172.21.15.19:0/1932334343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3f01087d0 msgr2=0x7fb3f0199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3f01087d0 0x7fb3f0199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 -- 172.21.15.19:0/1932334343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3f0109150 msgr2=0x7fb3f019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3f0109150 0x7fb3f019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3ee59c640 1 -- 172.21.15.19:0/1932334343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f019f300 con 0x7fb3f0102dc0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.077+0000 7fb3e5d9b640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3f01087d0 0x7fb3f0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.078+0000 7fb3ee59c640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0102dc0 0x7fb3f0199250 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000d950 tx=0x7fb3e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.078+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1932334343 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0017070 con 0x7fb3f0102dc0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.078+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f019f5f0 con 0x7fb3f0102dc0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.078+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1932334343 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e0009c30 con 0x7fb3f0102dc0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.078+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1932334343 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000f620 con 0x7fb3f0102dc0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.078+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f01a5e80 con 0x7fb3f0102dc0 2024-09-10T23:59:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.079+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f0104070 con 0x7fb3f0102dc0 2024-09-10T23:59:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.080+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1932334343 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fb3e0010460 con 0x7fb3f0102dc0 2024-09-10T23:59:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.081+0000 7fb3e7fff640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3dc0b5330 0x7fb3dc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.081+0000 7fb3e5d9b640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3dc0b5330 0x7fb3dc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.081+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1932334343 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7062+0+0 (secure 0 0 0) 0x7fb3e00e5390 con 0x7fb3f0102dc0 2024-09-10T23:59:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.081+0000 7fb3e5d9b640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3dc0b5330 0x7fb3dc0b77f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80058c0 tx=0x7fb3d8005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.084+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1932334343 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3e00ac730 con 0x7fb3f0102dc0 2024-09-10T23:59:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:59:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:59:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: Detected new or changed devices on smithi135 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi135 to 1453M 2024-09-10T23:59:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:36.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:36.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:35 smithi135 ceph-mon[35432]: from='osd.11 ' entity='osd.11' 2024-09-10T23:59:36.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.270+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb3f01a6080 con 0x7fb3f0102dc0 2024-09-10T23:59:36.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.270+0000 7fb3e7fff640 1 -- 172.21.15.19:0/1932334343 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7fb3e0009de0 con 0x7fb3f0102dc0 2024-09-10T23:59:36.272 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.272+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3dc0b5330 msgr2=0x7fb3dc0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.272+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3dc0b5330 0x7fb3dc0b77f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80058c0 tx=0x7fb3d8005850 comp rx=0 tx=0).stop 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0102dc0 msgr2=0x7fb3f0199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0102dc0 0x7fb3f0199250 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000d950 tx=0x7fb3e000de10 comp rx=0 tx=0).stop 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 shutdown_connections 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3f0109150 0x7fb3f019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3f01087d0 0x7fb3f0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3dc0b5330 0x7fb3dc0b77f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 --2- 172.21.15.19:0/1932334343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3f0102dc0 0x7fb3f0199250 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 >> 172.21.15.19:0/1932334343 conn(0x7fb3f00fe830 msgr2=0x7fb3f0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 shutdown_connections 2024-09-10T23:59:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:36.273+0000 7fb3f49bf640 1 -- 172.21.15.19:0/1932334343 wait complete. 2024-09-10T23:59:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: Detected new or changed devices on smithi135 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi135 to 1453M 2024-09-10T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:36.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:36.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:36.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:35 smithi131 ceph-mon[35491]: from='osd.11 ' entity='osd.11' 2024-09-10T23:59:37.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:36 smithi019 ceph-mon[30859]: purged_snaps scrub starts 2024-09-10T23:59:37.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:36 smithi019 ceph-mon[30859]: purged_snaps scrub ok 2024-09-10T23:59:37.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:37.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:36 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1932334343' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:37.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:36 smithi019 ceph-mon[30859]: osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] boot 2024-09-10T23:59:37.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:36 smithi019 ceph-mon[30859]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:59:37.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:36 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:37.093 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726012751,"num_in_osds":12,"osd_in_since":1726012753,"num_remapped_pgs":0} 2024-09-10T23:59:37.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:36 smithi135 ceph-mon[35432]: purged_snaps scrub starts 2024-09-10T23:59:37.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:36 smithi135 ceph-mon[35432]: purged_snaps scrub ok 2024-09-10T23:59:37.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:37.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:36 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1932334343' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:37.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:36 smithi135 ceph-mon[35432]: osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] boot 2024-09-10T23:59:37.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:36 smithi135 ceph-mon[35432]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:59:37.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:36 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:37.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:36 smithi131 ceph-mon[35491]: purged_snaps scrub starts 2024-09-10T23:59:37.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:36 smithi131 ceph-mon[35491]: purged_snaps scrub ok 2024-09-10T23:59:37.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:37.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:36 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1932334343' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:37.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:36 smithi131 ceph-mon[35491]: osd.11 [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] boot 2024-09-10T23:59:37.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:36 smithi131 ceph-mon[35491]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:59:37.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:36 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:59:38.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:59:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:37 smithi135 ceph-mon[35432]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:37 smithi135 ceph-mon[35432]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:59:38.201 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:37 smithi131 ceph-mon[35491]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:38.201 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:37 smithi131 ceph-mon[35491]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:59:38.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:37 smithi019 ceph-mon[30859]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:59:38.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:37 smithi019 ceph-mon[30859]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:59:38.362 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:38.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 -- 172.21.15.19:0/973510923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 msgr2=0x7f96ec107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:38.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 --2- 172.21.15.19:0/973510923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec107b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009900 tx=0x7f96e002a410 comp rx=0 tx=0).stop 2024-09-10T23:59:38.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 -- 172.21.15.19:0/973510923 shutdown_connections 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 --2- 172.21.15.19:0/973510923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec108060 0x7f96ec10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 --2- 172.21.15.19:0/973510923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec107b20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 --2- 172.21.15.19:0/973510923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96ec101cd0 0x7f96ec1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 -- 172.21.15.19:0/973510923 >> 172.21.15.19:0/973510923 conn(0x7f96ec0fd720 msgr2=0x7f96ec0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 -- 172.21.15.19:0/973510923 shutdown_connections 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.833+0000 7f96f330a640 1 -- 172.21.15.19:0/973510923 wait complete. 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 Processor -- start 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 -- start start 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec101cd0 0x7f96ec0fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec0fe160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96ec108060 0x7f96ec0fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec111d20 con 0x7f96ec1076e0 2024-09-10T23:59:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec111ba0 con 0x7f96ec101cd0 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f330a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec111ea0 con 0x7f96ec108060 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f08a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec0fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f08a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec0fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33770/0 (socket says 172.21.15.19:33770) 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f08a5640 1 -- 172.21.15.19:0/2266292487 learned_addr learned my addr 172.21.15.19:0/2266292487 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f10a6640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec101cd0 0x7f96ec0fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f18a7640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96ec108060 0x7f96ec0fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.834+0000 7f96f08a5640 1 -- 172.21.15.19:0/2266292487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96ec108060 msgr2=0x7f96ec0fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96f08a5640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96ec108060 0x7f96ec0fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96f08a5640 1 -- 172.21.15.19:0/2266292487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec101cd0 msgr2=0x7f96ec0fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96f08a5640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec101cd0 0x7f96ec0fdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96f08a5640 1 -- 172.21.15.19:0/2266292487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec1a77a0 con 0x7f96ec1076e0 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96f08a5640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec0fe160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96e0005940 tx=0x7f96e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96ea7fc640 1 -- 172.21.15.19:0/2266292487 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e003f030 con 0x7f96ec1076e0 2024-09-10T23:59:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96ea7fc640 1 -- 172.21.15.19:0/2266292487 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e0003cb0 con 0x7f96ec1076e0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96ea7fc640 1 -- 172.21.15.19:0/2266292487 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0035070 con 0x7f96ec1076e0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec1a7a30 con 0x7f96ec1076e0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.835+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec1a7f60 con 0x7f96ec1076e0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.836+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec1020b0 con 0x7f96ec1076e0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.838+0000 7f96ea7fc640 1 -- 172.21.15.19:0/2266292487 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f96e0003800 con 0x7f96ec1076e0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.839+0000 7f96ea7fc640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d40b53b0 0x7f96d40b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.839+0000 7f96f10a6640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d40b53b0 0x7f96d40b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.839+0000 7f96ea7fc640 1 -- 172.21.15.19:0/2266292487 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f96e01065c0 con 0x7f96ec1076e0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.839+0000 7f96f10a6640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d40b53b0 0x7f96d40b7870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009990 tx=0x7f96dc009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:38.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:38.842+0000 7f96ea7fc640 1 -- 172.21.15.19:0/2266292487 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96e00cd850 con 0x7f96ec1076e0 2024-09-10T23:59:39.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.029+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f96ec1a8340 con 0x7f96ec1076e0 2024-09-10T23:59:39.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.029+0000 7f96ea7fc640 1 -- 172.21.15.19:0/2266292487 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f96e00cd150 con 0x7f96ec1076e0 2024-09-10T23:59:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.031+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d40b53b0 msgr2=0x7f96d40b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.031+0000 7f96f330a640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d40b53b0 0x7f96d40b7870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009990 tx=0x7f96dc009110 comp rx=0 tx=0).stop 2024-09-10T23:59:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.031+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 msgr2=0x7f96ec0fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.031+0000 7f96f330a640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec0fe160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96e0005940 tx=0x7f96e00042f0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 shutdown_connections 2024-09-10T23:59:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96ec108060 0x7f96ec0fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d40b53b0 0x7f96d40b7870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96ec1076e0 0x7f96ec0fe160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 --2- 172.21.15.19:0/2266292487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec101cd0 0x7f96ec0fdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 >> 172.21.15.19:0/2266292487 conn(0x7f96ec0fd720 msgr2=0x7f96ec104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 shutdown_connections 2024-09-10T23:59:39.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:39.032+0000 7f96f330a640 1 -- 172.21.15.19:0/2266292487 wait complete. 2024-09-10T23:59:39.799 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1726012776,"num_in_osds":12,"osd_in_since":1726012753,"num_remapped_pgs":0} 2024-09-10T23:59:39.800 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:59:40.058 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:39 smithi135 ceph-mon[35432]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:39 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2266292487' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:40.178 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:39 smithi019 ceph-mon[30859]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:40.178 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:39 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2266292487' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:39 smithi131 ceph-mon[35491]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:39 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2266292487' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:59:40.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 -- 172.21.15.19:0/54788910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 msgr2=0x7f5da810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:40.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/54788910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da810f950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009ca0 tx=0x7f5da002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 -- 172.21.15.19:0/54788910 shutdown_connections 2024-09-10T23:59:40.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/54788910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da810f950 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/54788910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da81087d0 0x7f5da8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/54788910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da8102dc0 0x7f5da81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 -- 172.21.15.19:0/54788910 >> 172.21.15.19:0/54788910 conn(0x7f5da80fe830 msgr2=0x7f5da8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 -- 172.21.15.19:0/54788910 shutdown_connections 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.559+0000 7f5dae6c1640 1 -- 172.21.15.19:0/54788910 wait complete. 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 Processor -- start 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 -- start start 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8102dc0 0x7f5da8199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da81087d0 0x7f5da8199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8112e10 con 0x7f5da8109150 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8112c90 con 0x7f5da81087d0 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dae6c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8112f90 con 0x7f5da8102dc0 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dacc5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dacc5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da819ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33786/0 (socket says 172.21.15.19:33786) 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.560+0000 7f5dacc5e640 1 -- 172.21.15.19:0/510369594 learned_addr learned my addr 172.21.15.19:0/510369594 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dacc5e640 1 -- 172.21.15.19:0/510369594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8102dc0 msgr2=0x7f5da8199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dacc5e640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8102dc0 0x7f5da8199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dacc5e640 1 -- 172.21.15.19:0/510369594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da81087d0 msgr2=0x7f5da8199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dacc5e640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da81087d0 0x7f5da8199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dacc5e640 1 -- 172.21.15.19:0/510369594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da819f1d0 con 0x7f5da8109150 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dacc5e640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da819ea00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5da0005cc0 tx=0x7f5da002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5da57fa640 1 -- 172.21.15.19:0/510369594 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0003cf0 con 0x7f5da8109150 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da819f460 con 0x7f5da8109150 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5da57fa640 1 -- 172.21.15.19:0/510369594 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5da00044f0 con 0x7f5da8109150 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5da57fa640 1 -- 172.21.15.19:0/510369594 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da002fd10 con 0x7f5da8109150 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.561+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da81a5b80 con 0x7f5da8109150 2024-09-10T23:59:40.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.562+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da81031a0 con 0x7f5da8109150 2024-09-10T23:59:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.564+0000 7f5da57fa640 1 -- 172.21.15.19:0/510369594 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f5da0004040 con 0x7f5da8109150 2024-09-10T23:59:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.564+0000 7f5da57fa640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d900b5330 0x7f5d900b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.564+0000 7f5da7fff640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d900b5330 0x7f5d900b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.564+0000 7f5da57fa640 1 -- 172.21.15.19:0/510369594 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f5da0107100 con 0x7f5da8109150 2024-09-10T23:59:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.565+0000 7f5da7fff640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d900b5330 0x7f5d900b77f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800a990 tx=0x7f5d98005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:40.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.567+0000 7f5da57fa640 1 -- 172.21.15.19:0/510369594 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5da00ce390 con 0x7f5da8109150 2024-09-10T23:59:40.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.752+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5da819a250 con 0x7f5da8109150 2024-09-10T23:59:40.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.753+0000 7f5da57fa640 1 -- 172.21.15.19:0/510369594 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18771 (secure 0 0 0) 0x7f5da00cdc90 con 0x7f5da8109150 2024-09-10T23:59:40.755 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:40.755 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":71,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-10T23:59:37.299877+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:59:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.755+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d900b5330 msgr2=0x7f5d900b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.755+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d900b5330 0x7f5d900b77f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800a990 tx=0x7f5d98005c70 comp rx=0 tx=0).stop 2024-09-10T23:59:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.755+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 msgr2=0x7f5da819ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.755+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da819ea00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5da0005cc0 tx=0x7f5da002f470 comp rx=0 tx=0).stop 2024-09-10T23:59:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 shutdown_connections 2024-09-10T23:59:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d900b5330 0x7f5d900b77f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da8109150 0x7f5da819ea00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da81087d0 0x7f5da8199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 --2- 172.21.15.19:0/510369594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5da8102dc0 0x7f5da8199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 >> 172.21.15.19:0/510369594 conn(0x7f5da80fe830 msgr2=0x7f5da8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 shutdown_connections 2024-09-10T23:59:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:40.756+0000 7f5dae6c1640 1 -- 172.21.15.19:0/510369594 wait complete. 2024-09-10T23:59:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:40 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/510369594' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:59:41.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:40 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/510369594' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:59:41.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:40 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/510369594' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:59:41.574 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:55:46.863932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:59:41.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T23:59:41.833 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:41 smithi135 ceph-mon[35432]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:42.211 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:41 smithi019 ceph-mon[30859]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:41 smithi131 ceph-mon[35491]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:42.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 -- 172.21.15.19:0/3745693965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 msgr2=0x7f26781031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 --2- 172.21.15.19:0/3745693965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26781031a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2674009900 tx=0x7f267402a410 comp rx=0 tx=0).stop 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 -- 172.21.15.19:0/3745693965 shutdown_connections 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 --2- 172.21.15.19:0/3745693965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2678109150 0x7f267810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 --2- 172.21.15.19:0/3745693965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26781087d0 0x7f2678108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 --2- 172.21.15.19:0/3745693965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26781031a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 -- 172.21.15.19:0/3745693965 >> 172.21.15.19:0/3745693965 conn(0x7f26780fe830 msgr2=0x7f2678100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 -- 172.21.15.19:0/3745693965 shutdown_connections 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.295+0000 7f267fb40640 1 -- 172.21.15.19:0/3745693965 wait complete. 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 Processor -- start 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 -- start start 2024-09-10T23:59:42.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26780754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26781087d0 0x7f26780759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2678109150 0x7f2678075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2678112e20 con 0x7f2678102dc0 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2678112ca0 con 0x7f26781087d0 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267fb40640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2678112fa0 con 0x7f2678109150 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267d8dc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26780754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267d8dc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26780754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45624/0 (socket says 172.21.15.19:45624) 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.296+0000 7f267d8dc640 1 -- 172.21.15.19:0/526982235 learned_addr learned my addr 172.21.15.19:0/526982235 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267e0dd640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2678109150 0x7f2678075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d0db640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26781087d0 0x7f26780759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d8dc640 1 -- 172.21.15.19:0/526982235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2678109150 msgr2=0x7f2678075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d8dc640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2678109150 0x7f2678075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d8dc640 1 -- 172.21.15.19:0/526982235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26781087d0 msgr2=0x7f26780759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d8dc640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26781087d0 0x7f26780759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d8dc640 1 -- 172.21.15.19:0/526982235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781a76f0 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d0db640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26781087d0 0x7f26780759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267d8dc640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26780754a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2674005ab0 tx=0x7f2674003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f266effd640 1 -- 172.21.15.19:0/526982235 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267403f070 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f266effd640 1 -- 172.21.15.19:0/526982235 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2674031d60 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26781a7980 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f266effd640 1 -- 172.21.15.19:0/526982235 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674035030 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.297+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26781a7e60 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.298+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26781031a0 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.300+0000 7f266effd640 1 -- 172.21.15.19:0/526982235 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f267403b560 con 0x7f2678102dc0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.300+0000 7f266effd640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f26640b5330 0x7f26640b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.301+0000 7f267d0db640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f26640b5330 0x7f26640b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:42.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.301+0000 7f266effd640 1 -- 172.21.15.19:0/526982235 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f2674106bf0 con 0x7f2678102dc0 2024-09-10T23:59:42.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.301+0000 7f267d0db640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f26640b5330 0x7f26640b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2678076f90 tx=0x7f2668005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:42.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.303+0000 7f266effd640 1 -- 172.21.15.19:0/526982235 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f26740cde80 con 0x7f2678102dc0 2024-09-10T23:59:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.486+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f267802e5c0 con 0x7f2678102dc0 2024-09-10T23:59:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.486+0000 7f266effd640 1 -- 172.21.15.19:0/526982235 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f26740cd780 con 0x7f2678102dc0 2024-09-10T23:59:42.488 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f26640b5330 msgr2=0x7f26640b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f26640b5330 0x7f26640b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2678076f90 tx=0x7f2668005d30 comp rx=0 tx=0).stop 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 msgr2=0x7f26780754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26780754a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2674005ab0 tx=0x7f2674003d50 comp rx=0 tx=0).stop 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 shutdown_connections 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2678109150 0x7f2678075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26781087d0 0x7f26780759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f26640b5330 0x7f26640b77f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 --2- 172.21.15.19:0/526982235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2678102dc0 0x7f26780754a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.488+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 >> 172.21.15.19:0/526982235 conn(0x7f26780fe830 msgr2=0x7f2678100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:42.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.489+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 shutdown_connections 2024-09-10T23:59:42.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:42.489+0000 7f267fb40640 1 -- 172.21.15.19:0/526982235 wait complete. 2024-09-10T23:59:43.145 INFO:tasks.cephadm:Adding mds.a on smithi019 2024-09-10T23:59:43.145 INFO:tasks.cephadm:Adding mds.d on smithi019 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.g on smithi019 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.j on smithi019 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.b on smithi131 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.e on smithi131 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.h on smithi131 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.k on smithi131 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.c on smithi135 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.f on smithi135 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.i on smithi135 2024-09-10T23:59:43.146 INFO:tasks.cephadm:Adding mds.l on smithi135 2024-09-10T23:59:43.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l' 2024-09-10T23:59:43.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:42 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/526982235' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:59:43.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:42 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/526982235' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:59:43.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:42 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/526982235' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:59:43.405 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:59:43.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 -- 172.21.15.135:0/3519043878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba41076a0 msgr2=0x7faba4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:43.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3519043878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba41076a0 0x7faba4107ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab94009900 tx=0x7fab9402a410 comp rx=0 tx=0).stop 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 -- 172.21.15.135:0/3519043878 shutdown_connections 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3519043878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faba4108020 0x7faba410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3519043878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba41076a0 0x7faba4107ae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3519043878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba4101c90 0x7faba4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 -- 172.21.15.135:0/3519043878 >> 172.21.15.135:0/3519043878 conn(0x7faba40fd700 msgr2=0x7faba40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 -- 172.21.15.135:0/3519043878 shutdown_connections 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 -- 172.21.15.135:0/3519043878 wait complete. 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.885+0000 7fabac1dc640 1 Processor -- start 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabac1dc640 1 -- start start 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabac1dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba4101c90 0x7faba4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabac1dc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faba41076a0 0x7faba4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabac1dc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba4108020 0x7faba419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabac1dc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faba4111ce0 con 0x7faba41076a0 2024-09-10T23:59:43.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabac1dc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faba4111b60 con 0x7faba4101c90 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabac1dc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faba4111e60 con 0x7faba4108020 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba4108020 0x7faba419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba4108020 0x7faba419ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49514/0 (socket says 172.21.15.135:49514) 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 -- 172.21.15.135:0/3629227751 learned_addr learned my addr 172.21.15.135:0/3629227751 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7faba9777640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faba41076a0 0x7faba4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7faba9f78640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba4101c90 0x7faba4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 -- 172.21.15.135:0/3629227751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba4101c90 msgr2=0x7faba4199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba4101c90 0x7faba4199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 -- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faba41076a0 msgr2=0x7faba4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faba41076a0 0x7faba4199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 -- 172.21.15.135:0/3629227751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba419f3f0 con 0x7faba4108020 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7faba9777640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faba41076a0 0x7faba4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:43.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7faba9f78640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba4101c90 0x7faba4199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.886+0000 7fabaa779640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba4108020 0x7faba419ec20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00cad0 tx=0x7fab9c00cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.887+0000 7fab9affd640 1 -- 172.21.15.135:0/3629227751 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00ae20 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.887+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba419f6e0 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.887+0000 7fab9affd640 1 -- 172.21.15.135:0/3629227751 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9c005020 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.887+0000 7fab9affd640 1 -- 172.21.15.135:0/3629227751 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00f6b0 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.887+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba41a5da0 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.888+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba4102070 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.889+0000 7fab9affd640 1 -- 172.21.15.135:0/3629227751 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fab9c0054f0 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.890+0000 7fab9affd640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab900b5330 0x7fab900b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.890+0000 7fab9affd640 1 -- 172.21.15.135:0/3629227751 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fab9c0e5960 con 0x7faba4108020 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.890+0000 7faba9f78640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab900b5330 0x7fab900b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.891+0000 7faba9f78640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab900b5330 0x7fab900b77f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faba0006fd0 tx=0x7faba0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:43.894+0000 7fab9affd640 1 -- 172.21.15.135:0/3629227751 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fab9c014030 con 0x7faba4108020 2024-09-10T23:59:44.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.079+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}) -- 0x7faba41003d0 con 0x7fab900b5330 2024-09-10T23:59:44.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:43 smithi135 ceph-mon[35432]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:44.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.089+0000 7fab9affd640 1 -- 172.21.15.135:0/3629227751 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7faba41003d0 con 0x7fab900b5330 2024-09-10T23:59:44.091 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mds.all update... 2024-09-10T23:59:44.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.091+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab900b5330 msgr2=0x7fab900b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:44.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.091+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab900b5330 0x7fab900b77f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faba0006fd0 tx=0x7faba0008040 comp rx=0 tx=0).stop 2024-09-10T23:59:44.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.091+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba4108020 msgr2=0x7faba419ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.091+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba4108020 0x7faba419ec20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00cad0 tx=0x7fab9c00cf90 comp rx=0 tx=0).stop 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 shutdown_connections 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba4108020 0x7faba419ec20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab900b5330 0x7fab900b77f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faba41076a0 0x7faba4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 --2- 172.21.15.135:0/3629227751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faba4101c90 0x7faba4199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 >> 172.21.15.135:0/3629227751 conn(0x7faba40fd700 msgr2=0x7faba4104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 shutdown_connections 2024-09-10T23:59:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T23:59:44.092+0000 7fabac1dc640 1 -- 172.21.15.135:0/3629227751 wait complete. 2024-09-10T23:59:44.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:43 smithi019 ceph-mon[30859]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:43 smithi131 ceph-mon[35491]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:44.779 DEBUG:teuthology.orchestra.run.smithi019:mds.a> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T23:59:44.781 DEBUG:teuthology.orchestra.run.smithi019:mds.d> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T23:59:44.824 DEBUG:teuthology.orchestra.run.smithi019:mds.g> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T23:59:44.867 DEBUG:teuthology.orchestra.run.smithi019:mds.j> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T23:59:44.910 DEBUG:teuthology.orchestra.run.smithi131:mds.b> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T23:59:44.913 DEBUG:teuthology.orchestra.run.smithi131:mds.e> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T23:59:44.956 DEBUG:teuthology.orchestra.run.smithi131:mds.h> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T23:59:45.000 DEBUG:teuthology.orchestra.run.smithi131:mds.k> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T23:59:45.043 DEBUG:teuthology.orchestra.run.smithi135:mds.c> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T23:59:45.046 DEBUG:teuthology.orchestra.run.smithi135:mds.f> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T23:59:45.089 DEBUG:teuthology.orchestra.run.smithi135:mds.i> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T23:59:45.132 DEBUG:teuthology.orchestra.run.smithi135:mds.l> sudo journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T23:59:45.175 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T23:59:45.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:45.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:45 smithi019 ceph-mon[30859]: Deploying daemon mds.l on smithi135 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:45.276 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:45 smithi135 ceph-mon[35432]: Deploying daemon mds.l on smithi135 2024-09-10T23:59:45.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:45.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-09-10T23:59:45.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:45.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:45 smithi131 ceph-mon[35491]: Deploying daemon mds.l on smithi135 2024-09-10T23:59:45.434 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:45.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 -- 172.21.15.19:0/2764257758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b41076b0 msgr2=0x7f01b4107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:45.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/2764257758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b41076b0 0x7f01b4107af0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009900 tx=0x7f01a402a410 comp rx=0 tx=0).stop 2024-09-10T23:59:45.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 -- 172.21.15.19:0/2764257758 shutdown_connections 2024-09-10T23:59:45.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/2764257758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b4108030 0x7f01b410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:45.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/2764257758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b41076b0 0x7f01b4107af0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:45.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/2764257758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b4101ca0 0x7f01b4102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 -- 172.21.15.19:0/2764257758 >> 172.21.15.19:0/2764257758 conn(0x7f01b40fd730 msgr2=0x7f01b40ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 -- 172.21.15.19:0/2764257758 shutdown_connections 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.899+0000 7f01bbf2a640 1 -- 172.21.15.19:0/2764257758 wait complete. 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 Processor -- start 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 -- start start 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b4101ca0 0x7f01b4199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b41076b0 0x7f01b4199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b4108030 0x7f01b419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f01b4111cf0 con 0x7f01b4108030 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f01b4111b70 con 0x7f01b4101ca0 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01bbf2a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01b4111e70 con 0x7f01b41076b0 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b4108030 0x7f01b419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:45.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b4108030 0x7f01b419eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45638/0 (socket says 172.21.15.19:45638) 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 -- 172.21.15.19:0/3381154890 learned_addr learned my addr 172.21.15.19:0/3381154890 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01b9cc6640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b4101ca0 0x7f01b4199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01b94c5640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b41076b0 0x7f01b4199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 -- 172.21.15.19:0/3381154890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b41076b0 msgr2=0x7f01b4199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b41076b0 0x7f01b4199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 -- 172.21.15.19:0/3381154890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b4101ca0 msgr2=0x7f01b4199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b4101ca0 0x7f01b4199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.900+0000 7f01ba4c7640 1 -- 172.21.15.19:0/3381154890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b419f2c0 con 0x7f01b4108030 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.901+0000 7f01ba4c7640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b4108030 0x7f01b419eaf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00cad0 tx=0x7f01ac00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.901+0000 7f01aaffd640 1 -- 172.21.15.19:0/3381154890 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00ad60 con 0x7f01b4108030 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.901+0000 7f01aaffd640 1 -- 172.21.15.19:0/3381154890 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01ac005020 con 0x7f01b4108030 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.901+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b419f5b0 con 0x7f01b4108030 2024-09-10T23:59:45.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.901+0000 7f01aaffd640 1 -- 172.21.15.19:0/3381154890 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00f6b0 con 0x7f01b4108030 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.901+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b41a5c70 con 0x7f01b4108030 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.902+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b4102080 con 0x7f01b4108030 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.903+0000 7f01aaffd640 1 -- 172.21.15.19:0/3381154890 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f01ac0054f0 con 0x7f01b4108030 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.904+0000 7f01aaffd640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f01a00b5330 0x7f01a00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.904+0000 7f01b9cc6640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f01a00b5330 0x7f01a00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.905+0000 7f01aaffd640 1 -- 172.21.15.19:0/3381154890 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f01ac0e5c50 con 0x7f01b4108030 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.905+0000 7f01b9cc6640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f01a00b5330 0x7f01a00b77f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01b000abe0 tx=0x7f01b000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:45.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:45.908+0000 7f01aaffd640 1 -- 172.21.15.19:0/3381154890 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01ac014030 con 0x7f01b4108030 2024-09-10T23:59:46.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.133+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01b419a340 con 0x7f01b4108030 2024-09-10T23:59:46.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.133+0000 7f01aaffd640 1 -- 172.21.15.19:0/3381154890 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f01ac0acec0 con 0x7f01b4108030 2024-09-10T23:59:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:46.135 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":1,"btime":"2024-09-10T23:51:51:848411+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T23:59:46.135 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 1 2024-09-10T23:59:46.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.135+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f01a00b5330 msgr2=0x7f01a00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:46.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.135+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f01a00b5330 0x7f01a00b77f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01b000abe0 tx=0x7f01b000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:59:46.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b4108030 msgr2=0x7f01b419eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:46.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b4108030 0x7f01b419eaf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00cad0 tx=0x7f01ac00ced0 comp rx=0 tx=0).stop 2024-09-10T23:59:46.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 shutdown_connections 2024-09-10T23:59:46.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f01a00b5330 0x7f01a00b77f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:46.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b4108030 0x7f01b419eaf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:46.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b41076b0 0x7f01b4199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:46.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 --2- 172.21.15.19:0/3381154890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b4101ca0 0x7f01b4199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:46.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 >> 172.21.15.19:0/3381154890 conn(0x7f01b40fd730 msgr2=0x7f01b406b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:46.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 shutdown_connections 2024-09-10T23:59:46.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:46.136+0000 7f01bbf2a640 1 -- 172.21.15.19:0/3381154890 wait complete. 2024-09-10T23:59:46.160 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:46 smithi135 ceph-mon[35432]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:46.429 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:46 smithi019 ceph-mon[30859]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:46.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:46 smithi131 ceph-mon[35491]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:46.826 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:46 smithi135 systemd[1]: Starting Ceph mds.l for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:59:47.115 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:46 smithi135 podman[66249]: 2024-09-10 23:59:46.727592239 +0000 UTC m=+0.015784432 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:59:47.115 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:46 smithi135 podman[66249]: 2024-09-10 23:59:46.826376714 +0000 UTC m=+0.114568895 container create 2bda5cb7268ee3ee7c9f239372e183a561d7a18aedfa00bb95b0f671024a7272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:59:47.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:47 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3381154890' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:47 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3381154890' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:47.425 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:47 smithi135 podman[66249]: 2024-09-10 23:59:47.147334891 +0000 UTC m=+0.435527084 container init 2bda5cb7268ee3ee7c9f239372e183a561d7a18aedfa00bb95b0f671024a7272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:59:47.425 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:47 smithi135 podman[66249]: 2024-09-10 23:59:47.150356598 +0000 UTC m=+0.438548793 container start 2bda5cb7268ee3ee7c9f239372e183a561d7a18aedfa00bb95b0f671024a7272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:59:47.426 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:47 smithi135 ceph-mds[66269]: -- 172.21.15.135:0/1366355349 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56502c609860 con 0x56502c5e6800 2024-09-10T23:59:47.426 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:47 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l[66265]: starting mds.l at 2024-09-10T23:59:47.426 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:47 smithi135 bash[66249]: 2bda5cb7268ee3ee7c9f239372e183a561d7a18aedfa00bb95b0f671024a7272 2024-09-10T23:59:47.426 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 10 23:59:47 smithi135 systemd[1]: Started Ceph mds.l for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:59:47.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:47 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3381154890' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:48.438 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:48.438 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6832/324976573,v1:172.21.15.135:6833/324976573] up:boot 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: fsmap 1 up:standby 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:48.439 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6832/324976573,v1:172.21.15.135:6833/324976573] up:boot 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: fsmap 1 up:standby 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6832/324976573,v1:172.21.15.135:6833/324976573] up:boot 2024-09-10T23:59:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: fsmap 1 up:standby 2024-09-10T23:59:48.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:59:48.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:48.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:48.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:48.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:48.896 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:59:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:49.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:49 smithi131 ceph-mon[35491]: Deploying daemon mds.k on smithi131 2024-09-10T23:59:49.488 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 systemd[1]: Starting Ceph mds.k for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:59:49.490 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:49 smithi019 ceph-mon[30859]: Deploying daemon mds.k on smithi131 2024-09-10T23:59:49.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:49 smithi135 ceph-mon[35432]: Deploying daemon mds.k on smithi131 2024-09-10T23:59:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.700+0000 7f4ab5289640 1 -- 172.21.15.19:0/1678949176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab0104570 msgr2=0x7f4ab010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.700+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1678949176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab0104570 0x7f4ab010cb50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009900 tx=0x7f4aa402a410 comp rx=0 tx=0).stop 2024-09-10T23:59:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.700+0000 7f4ab5289640 1 -- 172.21.15.19:0/1678949176 shutdown_connections 2024-09-10T23:59:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.700+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1678949176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ab010d120 0x7f4ab010f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.700+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1678949176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab0104570 0x7f4ab010cb50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.700+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1678949176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 0x7f4ab0103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.700+0000 7f4ab5289640 1 -- 172.21.15.19:0/1678949176 >> 172.21.15.19:0/1678949176 conn(0x7f4ab00fd700 msgr2=0x7f4ab00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.701+0000 7f4ab5289640 1 -- 172.21.15.19:0/1678949176 shutdown_connections 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.701+0000 7f4ab5289640 1 -- 172.21.15.19:0/1678949176 wait complete. 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.701+0000 7f4ab5289640 1 Processor -- start 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.701+0000 7f4ab5289640 1 -- start start 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4ab5289640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 0x7f4ab01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4ab5289640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ab0104570 0x7f4ab01997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4ab5289640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab010d120 0x7f4ab019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4ab5289640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0112de0 con 0x7f4ab010d120 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4ab5289640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0112c60 con 0x7f4ab0103b70 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4ab5289640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0112f60 con 0x7f4ab0104570 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 0x7f4ab01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 0x7f4ab01992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:55370/0 (socket says 172.21.15.19:55370) 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 -- 172.21.15.19:0/1747513922 learned_addr learned my addr 172.21.15.19:0/1747513922 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaf7fe640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab010d120 0x7f4ab019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aae7fc640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ab0104570 0x7f4ab01997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 -- 172.21.15.19:0/1747513922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ab0104570 msgr2=0x7f4ab01997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ab0104570 0x7f4ab01997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 -- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab010d120 msgr2=0x7f4ab019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab010d120 0x7f4ab019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 -- 172.21.15.19:0/1747513922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab019f360 con 0x7f4ab0103b70 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaf7fe640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab010d120 0x7f4ab019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4aaeffd640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 0x7f4ab01992b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000e9f0 tx=0x7f4aa000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4a97fff640 1 -- 172.21.15.19:0/1747513922 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000cd80 con 0x7f4ab0103b70 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4a97fff640 1 -- 172.21.15.19:0/1747513922 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa00108e0 con 0x7f4ab0103b70 2024-09-10T23:59:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab019f650 con 0x7f4ab0103b70 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.702+0000 7f4a97fff640 1 -- 172.21.15.19:0/1747513922 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0018980 con 0x7f4ab0103b70 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.703+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab01a5d90 con 0x7f4ab0103b70 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.704+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab0103f50 con 0x7f4ab0103b70 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.705+0000 7f4a97fff640 1 -- 172.21.15.19:0/1747513922 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f4aa0010430 con 0x7f4ab0103b70 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.706+0000 7f4a97fff640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4a980b53b0 0x7f4a980b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.706+0000 7f4aae7fc640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4a980b53b0 0x7f4a980b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.706+0000 7f4a97fff640 1 -- 172.21.15.19:0/1747513922 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f4aa00e5e90 con 0x7f4ab0103b70 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.706+0000 7f4aae7fc640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4a980b53b0 0x7f4a980b7870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4031440 tx=0x7f4aa4005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.709+0000 7f4a97fff640 1 -- 172.21.15.19:0/1747513922 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4aa00aca30 con 0x7f4ab0103b70 2024-09-10T23:59:49.779 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 podman[65490]: 2024-09-10 23:59:49.426563255 +0000 UTC m=+0.015636591 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:59:49.779 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 podman[65490]: 2024-09-10 23:59:49.542466206 +0000 UTC m=+0.131539541 container create 02c23f50332ecd1ae7f227c13a649a6fc1a239897a402eb3ae0501a9c7f38c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T23:59:49.780 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 podman[65490]: 2024-09-10 23:59:49.779051576 +0000 UTC m=+0.368124908 container init 02c23f50332ecd1ae7f227c13a649a6fc1a239897a402eb3ae0501a9c7f38c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T23:59:49.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.931+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ab002e5c0 con 0x7f4ab0103b70 2024-09-10T23:59:49.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.940+0000 7f4a97fff640 1 -- 172.21.15.19:0/1747513922 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f4aa00b1460 con 0x7f4ab0103b70 2024-09-10T23:59:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:49.942 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"btime":"2024-09-10T23:59:47:178590+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:59:49.942 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4a980b53b0 msgr2=0x7f4a980b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4a980b53b0 0x7f4a980b7870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4031440 tx=0x7f4aa4005b50 comp rx=0 tx=0).stop 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 msgr2=0x7f4ab01992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 0x7f4ab01992b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000e9f0 tx=0x7f4aa000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 shutdown_connections 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4a980b53b0 0x7f4a980b7870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ab010d120 0x7f4ab019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ab0104570 0x7f4ab01997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 --2- 172.21.15.19:0/1747513922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ab0103b70 0x7f4ab01992b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.942+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 >> 172.21.15.19:0/1747513922 conn(0x7f4ab00fd700 msgr2=0x7f4ab00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:49.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.943+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 shutdown_connections 2024-09-10T23:59:49.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:49.943+0000 7f4ab5289640 1 -- 172.21.15.19:0/1747513922 wait complete. 2024-09-10T23:59:50.050 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 podman[65490]: 2024-09-10 23:59:49.782045146 +0000 UTC m=+0.371118485 container start 02c23f50332ecd1ae7f227c13a649a6fc1a239897a402eb3ae0501a9c7f38c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T23:59:50.050 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 ceph-mds[65509]: -- 172.21.15.131:0/4022811592 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561de06cdc20 con 0x561de06ab400 2024-09-10T23:59:50.050 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k[65505]: starting mds.k at 2024-09-10T23:59:50.050 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 bash[65490]: 02c23f50332ecd1ae7f227c13a649a6fc1a239897a402eb3ae0501a9c7f38c72 2024-09-10T23:59:50.050 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 10 23:59:49 smithi131 systemd[1]: Started Ceph mds.k for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:59:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1747513922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1747513922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1747513922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:51.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:51 smithi019 ceph-mon[30859]: Deploying daemon mds.j on smithi019 2024-09-10T23:59:51.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:51 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.131:6832/173201568,v1:172.21.15.131:6833/173201568] up:boot 2024-09-10T23:59:51.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:51 smithi019 ceph-mon[30859]: fsmap 2 up:standby 2024-09-10T23:59:51.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:51 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:59:51.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:51 smithi131 ceph-mon[35491]: Deploying daemon mds.j on smithi019 2024-09-10T23:59:51.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:51 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.131:6832/173201568,v1:172.21.15.131:6833/173201568] up:boot 2024-09-10T23:59:51.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:51 smithi131 ceph-mon[35491]: fsmap 2 up:standby 2024-09-10T23:59:51.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:51 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:59:51.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:51 smithi135 ceph-mon[35432]: Deploying daemon mds.j on smithi019 2024-09-10T23:59:51.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:51 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.131:6832/173201568,v1:172.21.15.131:6833/173201568] up:boot 2024-09-10T23:59:51.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:51 smithi135 ceph-mon[35432]: fsmap 2 up:standby 2024-09-10T23:59:51.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:51 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:59:52.265 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:52 smithi019 ceph-mon[30859]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:52.522 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:52 smithi019 systemd[1]: Starting Ceph mds.j for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:59:52.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:52 smithi131 ceph-mon[35491]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:52.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:52 smithi135 ceph-mon[35432]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:52.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:59:52.929 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:52 smithi019 podman[74255]: 2024-09-10 23:59:52.564379819 +0000 UTC m=+0.016444266 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:59:52.972 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:52 smithi019 podman[74255]: 2024-09-10 23:59:52.691713893 +0000 UTC m=+0.143778327 container create 6eb732705ca958007d2045f65aa03555cae6a6c6911ea5b56ee541269a77fadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:59:52.972 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:52 smithi019 podman[74255]: 2024-09-10 23:59:52.928295934 +0000 UTC m=+0.380360366 container init 6eb732705ca958007d2045f65aa03555cae6a6c6911ea5b56ee541269a77fadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T23:59:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:53.232 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:52 smithi019 podman[74255]: 2024-09-10 23:59:52.933253724 +0000 UTC m=+0.385318163 container start 6eb732705ca958007d2045f65aa03555cae6a6c6911ea5b56ee541269a77fadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:59:53.232 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:52 smithi019 ceph-mds[74305]: -- 172.21.15.19:0/3653229266 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649a0cf5860 con 0x5649a0cd3000 2024-09-10T23:59:53.232 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:52 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j[74289]: starting mds.j at 2024-09-10T23:59:53.232 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:53 smithi019 bash[74255]: 6eb732705ca958007d2045f65aa03555cae6a6c6911ea5b56ee541269a77fadb 2024-09-10T23:59:53.232 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 23:59:53 smithi019 systemd[1]: Started Ceph mds.j for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:59:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 -- 172.21.15.19:0/3034508972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d41076e0 msgr2=0x7f80d4107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 --2- 172.21.15.19:0/3034508972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d41076e0 0x7f80d4107b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009900 tx=0x7f80bc02a410 comp rx=0 tx=0).stop 2024-09-10T23:59:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 -- 172.21.15.19:0/3034508972 shutdown_connections 2024-09-10T23:59:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 --2- 172.21.15.19:0/3034508972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d4108060 0x7f80d410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 --2- 172.21.15.19:0/3034508972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d41076e0 0x7f80d4107b20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 --2- 172.21.15.19:0/3034508972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d4101cd0 0x7f80d41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 -- 172.21.15.19:0/3034508972 >> 172.21.15.19:0/3034508972 conn(0x7f80d40fd700 msgr2=0x7f80d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 -- 172.21.15.19:0/3034508972 shutdown_connections 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.589+0000 7f80da94c640 1 -- 172.21.15.19:0/3034508972 wait complete. 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 Processor -- start 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 -- start start 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d4101cd0 0x7f80d4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d41076e0 0x7f80d41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d4108060 0x7f80d419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4111d20 con 0x7f80d4101cd0 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4111ba0 con 0x7f80d4108060 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80da94c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4111ea0 con 0x7f80d41076e0 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d4101cd0 0x7f80d4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d4101cd0 0x7f80d4199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42268/0 (socket says 172.21.15.19:42268) 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 -- 172.21.15.19:0/1917843758 learned_addr learned my addr 172.21.15.19:0/1917843758 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d8ee9640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d4108060 0x7f80d419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80cbfff640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d41076e0 0x7f80d41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 -- 172.21.15.19:0/1917843758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d41076e0 msgr2=0x7f80d41997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d41076e0 0x7f80d41997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 -- 172.21.15.19:0/1917843758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d4108060 msgr2=0x7f80d419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d4108060 0x7f80d419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.590+0000 7f80d3fff640 1 -- 172.21.15.19:0/1917843758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d419f310 con 0x7f80d4101cd0 2024-09-10T23:59:53.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.591+0000 7f80d3fff640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d4101cd0 0x7f80d4199260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f80c400d770 tx=0x7f80c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:53.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.591+0000 7f80d1ffb640 1 -- 172.21.15.19:0/1917843758 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4017070 con 0x7f80d4101cd0 2024-09-10T23:59:53.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.591+0000 7f80d1ffb640 1 -- 172.21.15.19:0/1917843758 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80c40054d0 con 0x7f80d4101cd0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.591+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d419f600 con 0x7f80d4101cd0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.591+0000 7f80d1ffb640 1 -- 172.21.15.19:0/1917843758 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4004c30 con 0x7f80d4101cd0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.591+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d41a5cc0 con 0x7f80d4101cd0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.592+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d41020b0 con 0x7f80d4101cd0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.593+0000 7f80d1ffb640 1 -- 172.21.15.19:0/1917843758 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f80c4004e10 con 0x7f80d4101cd0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.594+0000 7f80d1ffb640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c00b5330 0x7f80c00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.594+0000 7f80cbfff640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c00b5330 0x7f80c00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.595+0000 7f80d1ffb640 1 -- 172.21.15.19:0/1917843758 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f80c40e5360 con 0x7f80d4101cd0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.595+0000 7f80cbfff640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c00b5330 0x7f80c00b77f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f80bc031440 tx=0x7f80bc0095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:53.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.599+0000 7f80d1ffb640 1 -- 172.21.15.19:0/1917843758 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80c40ac5f0 con 0x7f80d4101cd0 2024-09-10T23:59:53.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.830+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80d41a5f60 con 0x7f80d4101cd0 2024-09-10T23:59:53.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.831+0000 7f80d1ffb640 1 -- 172.21.15.19:0/1917843758 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f80c40abef0 con 0x7f80d4101cd0 2024-09-10T23:59:53.833 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:53.833 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":4,"btime":"2024-09-10T23:59:53:202578+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:59:53.833 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 4 2024-09-10T23:59:53.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c00b5330 msgr2=0x7f80c00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:53.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c00b5330 0x7f80c00b77f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f80bc031440 tx=0x7f80bc0095f0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d4101cd0 msgr2=0x7f80d4199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:53.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d4101cd0 0x7f80d4199260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f80c400d770 tx=0x7f80c400dc30 comp rx=0 tx=0).stop 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 shutdown_connections 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d4108060 0x7f80d419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d41076e0 0x7f80d41997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c00b5330 0x7f80c00b77f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 --2- 172.21.15.19:0/1917843758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d4101cd0 0x7f80d4199260 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 >> 172.21.15.19:0/1917843758 conn(0x7f80d40fd700 msgr2=0x7f80d406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 shutdown_connections 2024-09-10T23:59:53.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:53.833+0000 7f80da94c640 1 -- 172.21.15.19:0/1917843758 wait complete. 2024-09-10T23:59:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: Deploying daemon mds.d on smithi019 2024-09-10T23:59:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.19:6834/2693320130,v1:172.21.15.19:6835/2693320130] up:boot 2024-09-10T23:59:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: fsmap 3 up:standby 2024-09-10T23:59:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:59:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:54 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1917843758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:54.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:54.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: Deploying daemon mds.d on smithi019 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.19:6834/2693320130,v1:172.21.15.19:6835/2693320130] up:boot 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: fsmap 3 up:standby 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:59:54.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:54 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1917843758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: Deploying daemon mds.d on smithi019 2024-09-10T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.19:6834/2693320130,v1:172.21.15.19:6835/2693320130] up:boot 2024-09-10T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: fsmap 3 up:standby 2024-09-10T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:54 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1917843758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:56.084 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:55 smithi019 systemd[1]: Starting Ceph mds.d for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:59:56.347 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:56 smithi019 ceph-mon[30859]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:56.348 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 podman[74672]: 2024-09-10 23:59:56.104450758 +0000 UTC m=+0.016598689 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:59:56.348 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 podman[74672]: 2024-09-10 23:59:56.223710079 +0000 UTC m=+0.135858026 container create df7d129f4f45465c3fcdbb91ffd2102bde49e57a688e78a58f24318be333c480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T23:59:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:56 smithi135 ceph-mon[35432]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:56 smithi131 ceph-mon[35491]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:56.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:59:56.731 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 podman[74672]: 2024-09-10 23:59:56.442889368 +0000 UTC m=+0.355037286 container init df7d129f4f45465c3fcdbb91ffd2102bde49e57a688e78a58f24318be333c480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T23:59:56.731 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 podman[74672]: 2024-09-10 23:59:56.445788978 +0000 UTC m=+0.357936899 container start df7d129f4f45465c3fcdbb91ffd2102bde49e57a688e78a58f24318be333c480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:59:56.731 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 ceph-mds[74692]: -- 172.21.15.19:0/2259718257 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557edb07dc20 con 0x557edb05b400 2024-09-10T23:59:56.732 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d[74688]: starting mds.d at 2024-09-10T23:59:56.732 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 bash[74672]: df7d129f4f45465c3fcdbb91ffd2102bde49e57a688e78a58f24318be333c480 2024-09-10T23:59:56.732 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 23:59:56 smithi019 systemd[1]: Started Ceph mds.d for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:59:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.463+0000 7fb4849b8640 1 -- 172.21.15.19:0/543824121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480104530 msgr2=0x7fb48010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.463+0000 7fb4849b8640 1 --2- 172.21.15.19:0/543824121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480104530 0x7fb48010cb10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb468009900 tx=0x7fb46802a410 comp rx=0 tx=0).stop 2024-09-10T23:59:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 -- 172.21.15.19:0/543824121 shutdown_connections 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 --2- 172.21.15.19:0/543824121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb48010d0e0 0x7fb48010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 --2- 172.21.15.19:0/543824121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480104530 0x7fb48010cb10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 --2- 172.21.15.19:0/543824121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480103b30 0x7fb480103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 -- 172.21.15.19:0/543824121 >> 172.21.15.19:0/543824121 conn(0x7fb4800fd700 msgr2=0x7fb4800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 -- 172.21.15.19:0/543824121 shutdown_connections 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 -- 172.21.15.19:0/543824121 wait complete. 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 Processor -- start 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.464+0000 7fb4849b8640 1 -- start start 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb4849b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480103b30 0x7fb480199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb4849b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480104530 0x7fb4801997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb4849b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb48010d0e0 0x7fb48019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb4849b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb480112d60 con 0x7fb480103b30 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb4849b8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb480112be0 con 0x7fb48010d0e0 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb4849b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb480112ee0 con 0x7fb480104530 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480103b30 0x7fb480199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480103b30 0x7fb480199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42300/0 (socket says 172.21.15.19:42300) 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 -- 172.21.15.19:0/880533620 learned_addr learned my addr 172.21.15.19:0/880533620 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47dd9b640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480104530 0x7fb4801997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47ed9d640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb48010d0e0 0x7fb48019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 -- 172.21.15.19:0/880533620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480104530 msgr2=0x7fb4801997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480104530 0x7fb4801997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 -- 172.21.15.19:0/880533620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb48010d0e0 msgr2=0x7fb48019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb48010d0e0 0x7fb48019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 -- 172.21.15.19:0/880533620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48019f320 con 0x7fb480103b30 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47ed9d640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb48010d0e0 0x7fb48019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb47e59c640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480103b30 0x7fb480199270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb47000e9f0 tx=0x7fb47000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.465+0000 7fb4777fe640 1 -- 172.21.15.19:0/880533620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47000cd80 con 0x7fb480103b30 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.466+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48019f610 con 0x7fb480103b30 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.466+0000 7fb4777fe640 1 -- 172.21.15.19:0/880533620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4700108e0 con 0x7fb480103b30 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.466+0000 7fb4777fe640 1 -- 172.21.15.19:0/880533620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470018980 con 0x7fb480103b30 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.466+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4801a5ea0 con 0x7fb480103b30 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.467+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48006b150 con 0x7fb480103b30 2024-09-10T23:59:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.469+0000 7fb4777fe640 1 -- 172.21.15.19:0/880533620 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fb470010430 con 0x7fb480103b30 2024-09-10T23:59:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.471+0000 7fb4777fe640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb46c0b5330 0x7fb46c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.471+0000 7fb47dd9b640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb46c0b5330 0x7fb46c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.471+0000 7fb4777fe640 1 -- 172.21.15.19:0/880533620 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fb4700e60a0 con 0x7fb480103b30 2024-09-10T23:59:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.471+0000 7fb47dd9b640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb46c0b5330 0x7fb46c0b77f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb468031440 tx=0x7fb468005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.473+0000 7fb4777fe640 1 -- 172.21.15.19:0/880533620 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb4700ad330 con 0x7fb480103b30 2024-09-10T23:59:57.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.701+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb480103f10 con 0x7fb480103b30 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: Deploying daemon mds.e on smithi131 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.19:6836/2350271990,v1:172.21.15.19:6837/2350271990] up:boot 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: fsmap 4 up:standby 2024-09-10T23:59:57.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:59:57.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.701+0000 7fb4777fe640 1 -- 172.21.15.19:0/880533620 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fb480103f10 con 0x7fb480103b30 2024-09-10T23:59:57.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T23:59:57.704 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-10T23:59:57:083179+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:59:57.704 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-10T23:59:57.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb46c0b5330 msgr2=0x7fb46c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:57.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb46c0b5330 0x7fb46c0b77f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb468031440 tx=0x7fb468005b50 comp rx=0 tx=0).stop 2024-09-10T23:59:57.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480103b30 msgr2=0x7fb480199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:57.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480103b30 0x7fb480199270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb47000e9f0 tx=0x7fb47000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 shutdown_connections 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb48010d0e0 0x7fb48019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480104530 0x7fb4801997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb46c0b5330 0x7fb46c0b77f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 --2- 172.21.15.19:0/880533620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb480103b30 0x7fb480199270 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 >> 172.21.15.19:0/880533620 conn(0x7fb4800fd700 msgr2=0x7fb4800fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 shutdown_connections 2024-09-10T23:59:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T23:59:57.704+0000 7fb4849b8640 1 -- 172.21.15.19:0/880533620 wait complete. 2024-09-10T23:59:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:57.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:57.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:57.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: Deploying daemon mds.e on smithi131 2024-09-10T23:59:57.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.19:6836/2350271990,v1:172.21.15.19:6837/2350271990] up:boot 2024-09-10T23:59:57.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: fsmap 4 up:standby 2024-09-10T23:59:57.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:59:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: Deploying daemon mds.e on smithi131 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.19:6836/2350271990,v1:172.21.15.19:6837/2350271990] up:boot 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: fsmap 4 up:standby 2024-09-10T23:59:57.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:59:58.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:58 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/880533620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:58.890 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:58 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/880533620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:58.891 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:58 smithi131 systemd[1]: Starting Ceph mds.e for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-10T23:59:58.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:58 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/880533620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:59.224 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 podman[65800]: 2024-09-10 23:59:59.002100221 +0000 UTC m=+0.015906696 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:59:59.224 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 podman[65800]: 2024-09-10 23:59:59.108498555 +0000 UTC m=+0.122305021 container create 9b41a39e69e901d4144e2c9ad38e90ee95c769de8000aa1a0a0d89b70a869d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T23:59:59.609 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 podman[65800]: 2024-09-10 23:59:59.345009752 +0000 UTC m=+0.358816218 container init 9b41a39e69e901d4144e2c9ad38e90ee95c769de8000aa1a0a0d89b70a869d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T23:59:59.610 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 podman[65800]: 2024-09-10 23:59:59.347977278 +0000 UTC m=+0.361783752 container start 9b41a39e69e901d4144e2c9ad38e90ee95c769de8000aa1a0a0d89b70a869d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T23:59:59.610 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mds[65818]: -- 172.21.15.131:0/3775666816 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cba6eff860 con 0x55cba6edc800 2024-09-10T23:59:59.610 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e[65814]: starting mds.e at 2024-09-10T23:59:59.610 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 bash[65800]: 9b41a39e69e901d4144e2c9ad38e90ee95c769de8000aa1a0a0d89b70a869d48 2024-09-10T23:59:59.610 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 10 23:59:59 smithi131 systemd[1]: Started Ceph mds.e for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-10T23:59:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:59 smithi135 ceph-mon[35432]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:59:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:59 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:59 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:59 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-10T23:59:59.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:59 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:59:59.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:59 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:59:59.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 10 23:59:59 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:00.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:59 smithi019 ceph-mon[30859]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:00.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:59 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:59 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:59 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:59 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:59 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 23:59:59 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mon[35491]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 10 23:59:59 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:00.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:00.668 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:00.670 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:00 smithi019 ceph-mon[30859]: Deploying daemon mds.f on smithi135 2024-09-11T00:00:00.670 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:00 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.131:6834/1584755478,v1:172.21.15.131:6835/1584755478] up:boot 2024-09-11T00:00:00.670 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:00 smithi019 ceph-mon[30859]: fsmap 5 up:standby 2024-09-11T00:00:00.670 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:00 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:00:00.670 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:00 smithi019 ceph-mon[30859]: overall HEALTH_OK 2024-09-11T00:00:00.868 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:00 smithi135 ceph-mon[35432]: Deploying daemon mds.f on smithi135 2024-09-11T00:00:00.868 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:00 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.131:6834/1584755478,v1:172.21.15.131:6835/1584755478] up:boot 2024-09-11T00:00:00.869 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:00 smithi135 ceph-mon[35432]: fsmap 5 up:standby 2024-09-11T00:00:00.869 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:00 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:00:00.869 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:00 smithi135 ceph-mon[35432]: overall HEALTH_OK 2024-09-11T00:00:01.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:00 smithi131 ceph-mon[35491]: Deploying daemon mds.f on smithi135 2024-09-11T00:00:01.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:00 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.131:6834/1584755478,v1:172.21.15.131:6835/1584755478] up:boot 2024-09-11T00:00:01.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:00 smithi131 ceph-mon[35491]: fsmap 5 up:standby 2024-09-11T00:00:01.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:00 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:00:01.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:00 smithi131 ceph-mon[35491]: overall HEALTH_OK 2024-09-11T00:00:01.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 -- 172.21.15.19:0/1996682041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 msgr2=0x7f55ac1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 --2- 172.21.15.19:0/1996682041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac1031a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f559c009900 tx=0x7f559c02a410 comp rx=0 tx=0).stop 2024-09-11T00:00:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 -- 172.21.15.19:0/1996682041 shutdown_connections 2024-09-11T00:00:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 --2- 172.21.15.19:0/1996682041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55ac109150 0x7f55ac10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 --2- 172.21.15.19:0/1996682041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac1087d0 0x7f55ac108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 --2- 172.21.15.19:0/1996682041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac1031a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 -- 172.21.15.19:0/1996682041 >> 172.21.15.19:0/1996682041 conn(0x7f55ac0fe830 msgr2=0x7f55ac100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 -- 172.21.15.19:0/1996682041 shutdown_connections 2024-09-11T00:00:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.172+0000 7f55b2304640 1 -- 172.21.15.19:0/1996682041 wait complete. 2024-09-11T00:00:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 Processor -- start 2024-09-11T00:00:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 -- start start 2024-09-11T00:00:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:01.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55ac1087d0 0x7f55ac1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:01.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac109150 0x7f55ac19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:01.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac112e60 con 0x7f55ac102dc0 2024-09-11T00:00:01.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac112ce0 con 0x7f55ac1087d0 2024-09-11T00:00:01.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55b2304640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac112fe0 con 0x7f55ac109150 2024-09-11T00:00:01.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55abfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:01.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55abfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42320/0 (socket says 172.21.15.19:42320) 2024-09-11T00:00:01.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.173+0000 7f55abfff640 1 -- 172.21.15.19:0/2384552208 learned_addr learned my addr 172.21.15.19:0/2384552208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:01.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55b08a1640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac109150 0x7f55ac19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:01.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55ab7fe640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55ac1087d0 0x7f55ac1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:01.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55abfff640 1 -- 172.21.15.19:0/2384552208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac109150 msgr2=0x7f55ac19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:01.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55abfff640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac109150 0x7f55ac19eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55abfff640 1 -- 172.21.15.19:0/2384552208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55ac1087d0 msgr2=0x7f55ac1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55abfff640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55ac1087d0 0x7f55ac1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55abfff640 1 -- 172.21.15.19:0/2384552208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac19f320 con 0x7f55ac102dc0 2024-09-11T00:00:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55abfff640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac199270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f559c005ab0 tx=0x7f559c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55a97fa640 1 -- 172.21.15.19:0/2384552208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c03f070 con 0x7f55ac102dc0 2024-09-11T00:00:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac19f5b0 con 0x7f55ac102dc0 2024-09-11T00:00:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55a97fa640 1 -- 172.21.15.19:0/2384552208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f559c031d60 con 0x7f55ac102dc0 2024-09-11T00:00:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55a97fa640 1 -- 172.21.15.19:0/2384552208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c035030 con 0x7f55ac102dc0 2024-09-11T00:00:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.174+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac1a5cd0 con 0x7f55ac102dc0 2024-09-11T00:00:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.175+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac1031a0 con 0x7f55ac102dc0 2024-09-11T00:00:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.177+0000 7f55a97fa640 1 -- 172.21.15.19:0/2384552208 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f559c03b580 con 0x7f55ac102dc0 2024-09-11T00:00:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.177+0000 7f55a97fa640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f55940b5330 0x7f55940b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.177+0000 7f55ab7fe640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f55940b5330 0x7f55940b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:01.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.178+0000 7f55a97fa640 1 -- 172.21.15.19:0/2384552208 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f559c1063f0 con 0x7f55ac102dc0 2024-09-11T00:00:01.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.178+0000 7f55ab7fe640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f55940b5330 0x7f55940b77f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55ac108340 tx=0x7f55a000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:01.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.182+0000 7f55a97fa640 1 -- 172.21.15.19:0/2384552208 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f559c0cd030 con 0x7f55ac102dc0 2024-09-11T00:00:01.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.406+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55ac1a5f30 con 0x7f55ac102dc0 2024-09-11T00:00:01.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.406+0000 7f55a97fa640 1 -- 172.21.15.19:0/2384552208 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f559c0d1a60 con 0x7f55ac102dc0 2024-09-11T00:00:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:01.409 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"btime":"2024-09-10T23:59:59:601449+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T00:00:01.410 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.408+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f55940b5330 msgr2=0x7f55940b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.408+0000 7f55b2304640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f55940b5330 0x7f55940b77f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55ac108340 tx=0x7f55a000b390 comp rx=0 tx=0).stop 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.408+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 msgr2=0x7f55ac199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.408+0000 7f55b2304640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac199270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f559c005ab0 tx=0x7f559c003cd0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 shutdown_connections 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac109150 0x7f55ac19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55ac1087d0 0x7f55ac1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f55940b5330 0x7f55940b77f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 --2- 172.21.15.19:0/2384552208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55ac102dc0 0x7f55ac199270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 >> 172.21.15.19:0/2384552208 conn(0x7f55ac0fe830 msgr2=0x7f55ac1000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 shutdown_connections 2024-09-11T00:00:01.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:01.409+0000 7f55b2304640 1 -- 172.21.15.19:0/2384552208 wait complete. 2024-09-11T00:00:01.853 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:01 smithi135 ceph-mon[35432]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:01.853 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:01 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2384552208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:01.853 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:01 smithi135 systemd[1]: Starting Ceph mds.f for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:00:02.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:01 smithi019 ceph-mon[30859]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:02.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:01 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2384552208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:02.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:01 smithi131 ceph-mon[35491]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:02.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:01 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2384552208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:02.119 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:01 smithi135 podman[66565]: 2024-09-11 00:00:01.754415461 +0000 UTC m=+0.015922542 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:00:02.119 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:01 smithi135 podman[66565]: 2024-09-11 00:00:01.874404122 +0000 UTC m=+0.135911197 container create 835edba0c49bd27c7978875e22d402b6826661f6159f77d23517bfdc400b571b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T00:00:02.120 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:02 smithi135 podman[66565]: 2024-09-11 00:00:02.118594438 +0000 UTC m=+0.380101520 container init 835edba0c49bd27c7978875e22d402b6826661f6159f77d23517bfdc400b571b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:00:02.425 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:02 smithi135 podman[66565]: 2024-09-11 00:00:02.121438798 +0000 UTC m=+0.382945873 container start 835edba0c49bd27c7978875e22d402b6826661f6159f77d23517bfdc400b571b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:00:02.425 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:02 smithi135 ceph-mds[66586]: -- 172.21.15.135:0/870109859 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd135fb860 con 0x55bd135d8800 2024-09-11T00:00:02.425 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f[66582]: starting mds.f at 2024-09-11T00:00:02.425 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:02 smithi135 bash[66565]: 835edba0c49bd27c7978875e22d402b6826661f6159f77d23517bfdc400b571b 2024-09-11T00:00:02.425 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:00:02 smithi135 systemd[1]: Started Ceph mds.f for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:00:03.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:03.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:03.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:03.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6834/3910864085,v1:172.21.15.135:6835/3910864085] up:boot 2024-09-11T00:00:03.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: fsmap 6 up:standby 2024-09-11T00:00:03.524 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:03 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:00:03.559 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6834/3910864085,v1:172.21.15.135:6835/3910864085] up:boot 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: fsmap 6 up:standby 2024-09-11T00:00:03.560 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:03 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6834/3910864085,v1:172.21.15.135:6835/3910864085] up:boot 2024-09-11T00:00:03.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: fsmap 6 up:standby 2024-09-11T00:00:03.652 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:03 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:00:04.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:04.270 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 systemd[1]: Starting Ceph mds.c for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:00:04.391 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:04.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:04 smithi019 ceph-mon[30859]: Deploying daemon mds.c on smithi135 2024-09-11T00:00:04.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:04 smithi019 ceph-mon[30859]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:04 smithi131 ceph-mon[35491]: Deploying daemon mds.c on smithi135 2024-09-11T00:00:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:04 smithi131 ceph-mon[35491]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:04.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:04 smithi135 ceph-mon[35432]: Deploying daemon mds.c on smithi135 2024-09-11T00:00:04.608 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:04 smithi135 ceph-mon[35432]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:04.608 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 podman[66863]: 2024-09-11 00:00:04.235326328 +0000 UTC m=+0.015798030 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:00:04.608 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 podman[66863]: 2024-09-11 00:00:04.346389686 +0000 UTC m=+0.126861420 container create 7ea8e1614f6efb590164ff30a3cb6d68703a5a8b1f767da94fde5464ffb5a5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:00:04.608 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 podman[66863]: 2024-09-11 00:00:04.607151359 +0000 UTC m=+0.387623049 container init 7ea8e1614f6efb590164ff30a3cb6d68703a5a8b1f767da94fde5464ffb5a5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T00:00:04.925 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 podman[66863]: 2024-09-11 00:00:04.610733648 +0000 UTC m=+0.391205337 container start 7ea8e1614f6efb590164ff30a3cb6d68703a5a8b1f767da94fde5464ffb5a5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T00:00:04.925 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 ceph-mds[66882]: -- 172.21.15.135:0/259704619 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2bcb55860 con 0x55f2bcb32800 2024-09-11T00:00:04.925 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c[66878]: starting mds.c at 2024-09-11T00:00:04.926 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 bash[66863]: 7ea8e1614f6efb590164ff30a3cb6d68703a5a8b1f767da94fde5464ffb5a5a1 2024-09-11T00:00:04.926 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:00:04 smithi135 systemd[1]: Started Ceph mds.c for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:00:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 -- 172.21.15.19:0/2537662126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 msgr2=0x7f8a8c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2537662126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1031a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009900 tx=0x7f8a7402a410 comp rx=0 tx=0).stop 2024-09-11T00:00:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 -- 172.21.15.19:0/2537662126 shutdown_connections 2024-09-11T00:00:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2537662126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c109150 0x7f8a8c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2537662126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a8c1087d0 0x7f8a8c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2537662126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1031a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 -- 172.21.15.19:0/2537662126 >> 172.21.15.19:0/2537662126 conn(0x7f8a8c0fe830 msgr2=0x7f8a8c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 -- 172.21.15.19:0/2537662126 shutdown_connections 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.930+0000 7f8a92efd640 1 -- 172.21.15.19:0/2537662126 wait complete. 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 Processor -- start 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 -- start start 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c1087d0 0x7f8a8c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a8c109150 0x7f8a8c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c112e60 con 0x7f8a8c102dc0 2024-09-11T00:00:04.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c112ce0 con 0x7f8a8c1087d0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a92efd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c112fe0 con 0x7f8a8c109150 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a90c99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a90c99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49112/0 (socket says 172.21.15.19:49112) 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a90c99640 1 -- 172.21.15.19:0/2205121484 learned_addr learned my addr 172.21.15.19:0/2205121484 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.931+0000 7f8a8bfff640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c1087d0 0x7f8a8c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a9149a640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a8c109150 0x7f8a8c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a90c99640 1 -- 172.21.15.19:0/2205121484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a8c109150 msgr2=0x7f8a8c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a90c99640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a8c109150 0x7f8a8c19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a90c99640 1 -- 172.21.15.19:0/2205121484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c1087d0 msgr2=0x7f8a8c199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a90c99640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c1087d0 0x7f8a8c199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a90c99640 1 -- 172.21.15.19:0/2205121484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8c19f3a0 con 0x7f8a8c102dc0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a90c99640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1992f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005ab0 tx=0x7f8a74003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a89ffb640 1 -- 172.21.15.19:0/2205121484 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7403f070 con 0x7f8a8c102dc0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a89ffb640 1 -- 172.21.15.19:0/2205121484 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a74031d60 con 0x7f8a8c102dc0 2024-09-11T00:00:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8c19f630 con 0x7f8a8c102dc0 2024-09-11T00:00:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a89ffb640 1 -- 172.21.15.19:0/2205121484 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74035030 con 0x7f8a8c102dc0 2024-09-11T00:00:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.932+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8c1a5d50 con 0x7f8a8c102dc0 2024-09-11T00:00:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.933+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8c1031a0 con 0x7f8a8c102dc0 2024-09-11T00:00:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.935+0000 7f8a89ffb640 1 -- 172.21.15.19:0/2205121484 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f8a7403b560 con 0x7f8a8c102dc0 2024-09-11T00:00:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.935+0000 7f8a89ffb640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a780b5330 0x7f8a780b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.936+0000 7f8a8bfff640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a780b5330 0x7f8a780b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.936+0000 7f8a89ffb640 1 -- 172.21.15.19:0/2205121484 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f8a74106a00 con 0x7f8a8c102dc0 2024-09-11T00:00:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.936+0000 7f8a8bfff640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a780b5330 0x7f8a780b77f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c101d90 tx=0x7f8a7c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:04.938+0000 7f8a89ffb640 1 -- 172.21.15.19:0/2205121484 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8a740cdc90 con 0x7f8a8c102dc0 2024-09-11T00:00:05.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.162+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a8c10af30 con 0x7f8a8c102dc0 2024-09-11T00:00:05.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.163+0000 7f8a89ffb640 1 -- 172.21.15.19:0/2205121484 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f8a740cd590 con 0x7f8a8c102dc0 2024-09-11T00:00:05.165 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:05.166 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":7,"btime":"2024-09-11T00:00:02:615031+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-11T00:00:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 7 2024-09-11T00:00:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a780b5330 msgr2=0x7f8a780b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a780b5330 0x7f8a780b77f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c101d90 tx=0x7f8a7c00b390 comp rx=0 tx=0).stop 2024-09-11T00:00:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 msgr2=0x7f8a8c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1992f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005ab0 tx=0x7f8a74003cd0 comp rx=0 tx=0).stop 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 shutdown_connections 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a8c109150 0x7f8a8c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8c1087d0 0x7f8a8c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a780b5330 0x7f8a780b77f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 --2- 172.21.15.19:0/2205121484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a8c102dc0 0x7f8a8c1992f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 >> 172.21.15.19:0/2205121484 conn(0x7f8a8c0fe830 msgr2=0x7f8a8c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 shutdown_connections 2024-09-11T00:00:05.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:05.165+0000 7f8a92efd640 1 -- 172.21.15.19:0/2205121484 wait complete. 2024-09-11T00:00:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: Deploying daemon mds.h on smithi131 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2205121484' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] up:boot 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: fsmap 7 up:standby 2024-09-11T00:00:06.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:00:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: Deploying daemon mds.h on smithi131 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2205121484' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] up:boot 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: fsmap 7 up:standby 2024-09-11T00:00:06.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:00:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: Deploying daemon mds.h on smithi131 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2205121484' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] up:boot 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: fsmap 7 up:standby 2024-09-11T00:00:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:00:06.988 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:06 smithi131 systemd[1]: Starting Ceph mds.h for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:00:07.274 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:06 smithi131 podman[66108]: 2024-09-11 00:00:06.889240462 +0000 UTC m=+0.016164801 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:00:07.274 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:07 smithi131 podman[66108]: 2024-09-11 00:00:07.009860198 +0000 UTC m=+0.136784526 container create a994c3e521087cc71c0bfe21d1fd39917939d99d0013d9ebc14c2bcd5ddfac86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T00:00:07.274 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:07 smithi131 podman[66108]: 2024-09-11 00:00:07.273237843 +0000 UTC m=+0.400162172 container init a994c3e521087cc71c0bfe21d1fd39917939d99d0013d9ebc14c2bcd5ddfac86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T00:00:07.550 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:07 smithi131 podman[66108]: 2024-09-11 00:00:07.276160145 +0000 UTC m=+0.403084475 container start a994c3e521087cc71c0bfe21d1fd39917939d99d0013d9ebc14c2bcd5ddfac86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-11T00:00:07.550 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mds[66127]: -- 172.21.15.131:0/115037458 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5575d252f860 con 0x5575d250c800 2024-09-11T00:00:07.550 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h[66123]: starting mds.h at 2024-09-11T00:00:07.551 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:07 smithi131 bash[66108]: a994c3e521087cc71c0bfe21d1fd39917939d99d0013d9ebc14c2bcd5ddfac86 2024-09-11T00:00:07.551 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:00:07 smithi131 systemd[1]: Started Ceph mds.h for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:00:07.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:08.019 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:07 smithi135 ceph-mon[35432]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:08.019 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.019 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.019 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.019 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:08.019 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:08.019 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:07 smithi019 ceph-mon[30859]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mon[35491]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:08.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:08.148 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:08.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 -- 172.21.15.19:0/2810224251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 msgr2=0x7f374c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:08.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 --2- 172.21.15.19:0/2810224251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c107ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3734009900 tx=0x7f373402a410 comp rx=0 tx=0).stop 2024-09-11T00:00:08.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 -- 172.21.15.19:0/2810224251 shutdown_connections 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 --2- 172.21.15.19:0/2810224251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f374c108020 0x7f374c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 --2- 172.21.15.19:0/2810224251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c107ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 --2- 172.21.15.19:0/2810224251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f374c101c90 0x7f374c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 -- 172.21.15.19:0/2810224251 >> 172.21.15.19:0/2810224251 conn(0x7f374c0fd700 msgr2=0x7f374c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 -- 172.21.15.19:0/2810224251 shutdown_connections 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.638+0000 7f37510ba640 1 -- 172.21.15.19:0/2810224251 wait complete. 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 Processor -- start 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 -- start start 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f374c101c90 0x7f374c198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f374c108020 0x7f374c19db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f374c111c70 con 0x7f374c1076a0 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f374c111af0 con 0x7f374c101c90 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f37510ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f374c111df0 con 0x7f374c108020 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f3743fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f3743fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49124/0 (socket says 172.21.15.19:49124) 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f3743fff640 1 -- 172.21.15.19:0/2374988681 learned_addr learned my addr 172.21.15.19:0/2374988681 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.639+0000 7f374b59e640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f374c108020 0x7f374c19db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f374ad9d640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f374c101c90 0x7f374c198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3743fff640 1 -- 172.21.15.19:0/2374988681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f374c108020 msgr2=0x7f374c19db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3743fff640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f374c108020 0x7f374c19db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3743fff640 1 -- 172.21.15.19:0/2374988681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f374c101c90 msgr2=0x7f374c198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3743fff640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f374c101c90 0x7f374c198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3743fff640 1 -- 172.21.15.19:0/2374988681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c19e2f0 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f374ad9d640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f374c101c90 0x7f374c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3743fff640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c198780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3734005940 tx=0x7f37340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3748d99640 1 -- 172.21.15.19:0/2374988681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373403f030 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c19e580 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3748d99640 1 -- 172.21.15.19:0/2374988681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3734003cb0 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f3748d99640 1 -- 172.21.15.19:0/2374988681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734035070 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.640+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c1a4ca0 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.641+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c102070 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.643+0000 7f3748d99640 1 -- 172.21.15.19:0/2374988681 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f373403bbf0 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.643+0000 7f3748d99640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37380b5330 0x7f37380b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.643+0000 7f374ad9d640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37380b5330 0x7f37380b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.643+0000 7f3748d99640 1 -- 172.21.15.19:0/2374988681 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f3734106660 con 0x7f374c1076a0 2024-09-11T00:00:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.644+0000 7f374ad9d640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37380b5330 0x7f37380b77f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f373c005d00 tx=0x7f373c009550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:08.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.646+0000 7f3748d99640 1 -- 172.21.15.19:0/2374988681 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f37340cd8f0 con 0x7f374c1076a0 2024-09-11T00:00:08.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.868+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f374c199370 con 0x7f374c1076a0 2024-09-11T00:00:08.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:08 smithi019 ceph-mon[30859]: Deploying daemon mds.i on smithi135 2024-09-11T00:00:08.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:08 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.131:6836/3685381952,v1:172.21.15.131:6837/3685381952] up:boot 2024-09-11T00:00:08.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:08 smithi019 ceph-mon[30859]: fsmap 8 up:standby 2024-09-11T00:00:08.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:00:08.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.869+0000 7f3748d99640 1 -- 172.21.15.19:0/2374988681 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f37340cd1f0 con 0x7f374c1076a0 2024-09-11T00:00:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:08.872 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"btime":"2024-09-11T00:00:07:761562+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24604,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T00:00:08.872 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37380b5330 msgr2=0x7f37380b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37380b5330 0x7f37380b77f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f373c005d00 tx=0x7f373c009550 comp rx=0 tx=0).stop 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 msgr2=0x7f374c198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c198780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3734005940 tx=0x7f37340042f0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 shutdown_connections 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f374c108020 0x7f374c19db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37380b5330 0x7f37380b77f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f374c1076a0 0x7f374c198780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 --2- 172.21.15.19:0/2374988681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f374c101c90 0x7f374c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:08.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 >> 172.21.15.19:0/2374988681 conn(0x7f374c0fd700 msgr2=0x7f374c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:08.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.871+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 shutdown_connections 2024-09-11T00:00:08.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:08.872+0000 7f37510ba640 1 -- 172.21.15.19:0/2374988681 wait complete. 2024-09-11T00:00:08.899 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:08 smithi135 ceph-mon[35432]: Deploying daemon mds.i on smithi135 2024-09-11T00:00:08.899 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:08 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.131:6836/3685381952,v1:172.21.15.131:6837/3685381952] up:boot 2024-09-11T00:00:08.899 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:08 smithi135 ceph-mon[35432]: fsmap 8 up:standby 2024-09-11T00:00:08.899 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:00:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:08 smithi131 ceph-mon[35491]: Deploying daemon mds.i on smithi135 2024-09-11T00:00:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:08 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.131:6836/3685381952,v1:172.21.15.131:6837/3685381952] up:boot 2024-09-11T00:00:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:08 smithi131 ceph-mon[35491]: fsmap 8 up:standby 2024-09-11T00:00:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:00:09.585 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 systemd[1]: Starting Ceph mds.i for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:00:09.871 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:09 smithi135 ceph-mon[35432]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:09.871 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:09 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2374988681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:09.871 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 podman[67179]: 2024-09-11 00:00:09.486356205 +0000 UTC m=+0.015721813 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:00:09.871 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 podman[67179]: 2024-09-11 00:00:09.609555659 +0000 UTC m=+0.138921310 container create d9bc917b5ce6d484283d6fbe82fd8faeafc490499f2c0e517e23a8e231aa18c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T00:00:09.871 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 podman[67179]: 2024-09-11 00:00:09.870556452 +0000 UTC m=+0.399922050 container init d9bc917b5ce6d484283d6fbe82fd8faeafc490499f2c0e517e23a8e231aa18c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:00:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:09 smithi019 ceph-mon[30859]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:09 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2374988681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:09 smithi131 ceph-mon[35491]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:09 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2374988681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:10.175 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 podman[67179]: 2024-09-11 00:00:09.873601592 +0000 UTC m=+0.402967199 container start d9bc917b5ce6d484283d6fbe82fd8faeafc490499f2c0e517e23a8e231aa18c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T00:00:10.175 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 ceph-mds[67198]: -- 172.21.15.135:0/1553706302 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b77fb89860 con 0x55b77fb67400 2024-09-11T00:00:10.175 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i[67194]: starting mds.i at 2024-09-11T00:00:10.175 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 bash[67179]: d9bc917b5ce6d484283d6fbe82fd8faeafc490499f2c0e517e23a8e231aa18c0 2024-09-11T00:00:10.175 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:09 smithi135 systemd[1]: Started Ceph mds.i for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:00:11.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:11.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:11.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:11.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: Deploying daemon mds.g on smithi019 2024-09-11T00:00:11.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] up:boot 2024-09-11T00:00:11.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: fsmap 9 up:standby 2024-09-11T00:00:11.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:11 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:00:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:11.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:11.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:11.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: Deploying daemon mds.g on smithi019 2024-09-11T00:00:11.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] up:boot 2024-09-11T00:00:11.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: fsmap 9 up:standby 2024-09-11T00:00:11.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:11 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:00:11.516 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.516 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.516 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:11.516 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:11.516 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:11.516 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:11.517 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: Deploying daemon mds.g on smithi019 2024-09-11T00:00:11.517 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] up:boot 2024-09-11T00:00:11.517 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: fsmap 9 up:standby 2024-09-11T00:00:11.517 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:11 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:00:11.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:12.048 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:12.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:12 smithi019 ceph-mon[30859]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:12 smithi131 ceph-mon[35491]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:12.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:12 smithi135 ceph-mon[35432]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 -- 172.21.15.19:0/1388997521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 msgr2=0x7fd53810f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 --2- 172.21.15.19:0/1388997521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53810f590 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd530009ca0 tx=0x7fd53002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 -- 172.21.15.19:0/1388997521 shutdown_connections 2024-09-11T00:00:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 --2- 172.21.15.19:0/1388997521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53810f590 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 --2- 172.21.15.19:0/1388997521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5381045b0 0x7fd53810cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 --2- 172.21.15.19:0/1388997521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538103bb0 0x7fd538103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 -- 172.21.15.19:0/1388997521 >> 172.21.15.19:0/1388997521 conn(0x7fd5380fd700 msgr2=0x7fd5380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 -- 172.21.15.19:0/1388997521 shutdown_connections 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 -- 172.21.15.19:0/1388997521 wait complete. 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 Processor -- start 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.581+0000 7fd53e630640 1 -- start start 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53e630640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538103bb0 0x7fd538199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53e630640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5381045b0 0x7fd538199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53e630640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53e630640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd538112da0 con 0x7fd53810d160 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53e630640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd538112c20 con 0x7fd5381045b0 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53e630640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd538112f20 con 0x7fd538103bb0 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50454/0 (socket says 172.21.15.19:50454) 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 -- 172.21.15.19:0/3495463677 learned_addr learned my addr 172.21.15.19:0/3495463677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd537fff640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538103bb0 0x7fd538199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd52ffff640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5381045b0 0x7fd538199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 -- 172.21.15.19:0/3495463677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538103bb0 msgr2=0x7fd538199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538103bb0 0x7fd538199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 -- 172.21.15.19:0/3495463677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5381045b0 msgr2=0x7fd538199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5381045b0 0x7fd538199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 -- 172.21.15.19:0/3495463677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53819f2e0 con 0x7fd53810d160 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd53cbcd640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53819eb10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd530005cc0 tx=0x7fd53002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.582+0000 7fd535ffb640 1 -- 172.21.15.19:0/3495463677 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd530003bf0 con 0x7fd53810d160 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.583+0000 7fd535ffb640 1 -- 172.21.15.19:0/3495463677 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd530003d90 con 0x7fd53810d160 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.583+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53819f570 con 0x7fd53810d160 2024-09-11T00:00:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.583+0000 7fd535ffb640 1 -- 172.21.15.19:0/3495463677 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53002fbc0 con 0x7fd53810d160 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.583+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5381a5c90 con 0x7fd53810d160 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.584+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd538103f90 con 0x7fd53810d160 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.585+0000 7fd535ffb640 1 -- 172.21.15.19:0/3495463677 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fd530004610 con 0x7fd53810d160 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.586+0000 7fd535ffb640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5240b53b0 0x7fd5240b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.586+0000 7fd537fff640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5240b53b0 0x7fd5240b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.586+0000 7fd535ffb640 1 -- 172.21.15.19:0/3495463677 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fd530106da0 con 0x7fd53810d160 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.586+0000 7fd537fff640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5240b53b0 0x7fd5240b7870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5280058c0 tx=0x7fd52800a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.589+0000 7fd535ffb640 1 -- 172.21.15.19:0/3495463677 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd5300ce030 con 0x7fd53810d160 2024-09-11T00:00:12.772 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:00:12 smithi019 podman[75526]: 2024-09-11 00:00:12.716584555 +0000 UTC m=+0.346037432 container create eafe4497e369b899191fe752d515657b69a2693a8ac6246d7729befcd14038ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T00:00:12.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.813+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd53819a360 con 0x7fd53810d160 2024-09-11T00:00:12.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.814+0000 7fd535ffb640 1 -- 172.21.15.19:0/3495463677 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7fd53819a360 con 0x7fd53810d160 2024-09-11T00:00:12.817 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:12.817 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"btime":"2024-09-11T00:00:10:773940+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24604,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24625,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T00:00:12.817 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 10 2024-09-11T00:00:12.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5240b53b0 msgr2=0x7fd5240b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5240b53b0 0x7fd5240b7870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5280058c0 tx=0x7fd52800a250 comp rx=0 tx=0).stop 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 msgr2=0x7fd53819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53819eb10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd530005cc0 tx=0x7fd53002f380 comp rx=0 tx=0).stop 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 shutdown_connections 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5240b53b0 0x7fd5240b7870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd53810d160 0x7fd53819eb10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5381045b0 0x7fd538199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 --2- 172.21.15.19:0/3495463677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538103bb0 0x7fd538199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 >> 172.21.15.19:0/3495463677 conn(0x7fd5380fd700 msgr2=0x7fd53810f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 shutdown_connections 2024-09-11T00:00:12.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:12.817+0000 7fd53e630640 1 -- 172.21.15.19:0/3495463677 wait complete. 2024-09-11T00:00:13.189 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:13 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3495463677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:13.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:13 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3495463677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:13.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:13 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3495463677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:13.772 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:00:13 smithi019 podman[75526]: 2024-09-11 00:00:13.707250941 +0000 UTC m=+1.336703831 container init eafe4497e369b899191fe752d515657b69a2693a8ac6246d7729befcd14038ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:00:13.772 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:00:13 smithi019 podman[75526]: 2024-09-11 00:00:13.710720102 +0000 UTC m=+1.340172981 container start eafe4497e369b899191fe752d515657b69a2693a8ac6246d7729befcd14038ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T00:00:13.772 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:00:13 smithi019 ceph-mds[75583]: -- 172.21.15.19:0/1857123203 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5651a905b860 con 0x5651a9038800 2024-09-11T00:00:13.773 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:00:13 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g[75571]: starting mds.g at 2024-09-11T00:00:14.059 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:00:13 smithi019 bash[75526]: eafe4497e369b899191fe752d515657b69a2693a8ac6246d7729befcd14038ee 2024-09-11T00:00:14.059 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:00:13 smithi019 systemd[1]: Started Ceph mds.g for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:00:14.351 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:14 smithi019 ceph-mon[30859]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:14.351 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.351 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.351 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.351 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:14.351 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:14.351 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:14 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:14 smithi135 ceph-mon[35432]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:14 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:14 smithi131 ceph-mon[35491]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:14.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:14.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:14.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:14 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:15 smithi135 ceph-mon[35432]: Deploying daemon mds.a on smithi019 2024-09-11T00:00:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:15 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.19:6838/1245997055,v1:172.21.15.19:6839/1245997055] up:boot 2024-09-11T00:00:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:15 smithi135 ceph-mon[35432]: fsmap 10 up:standby 2024-09-11T00:00:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:15 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T00:00:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:15 smithi019 ceph-mon[30859]: Deploying daemon mds.a on smithi019 2024-09-11T00:00:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:15 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.19:6838/1245997055,v1:172.21.15.19:6839/1245997055] up:boot 2024-09-11T00:00:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:15 smithi019 ceph-mon[30859]: fsmap 10 up:standby 2024-09-11T00:00:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:15 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T00:00:15.529 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:15 smithi131 ceph-mon[35491]: Deploying daemon mds.a on smithi019 2024-09-11T00:00:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:15 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.19:6838/1245997055,v1:172.21.15.19:6839/1245997055] up:boot 2024-09-11T00:00:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:15 smithi131 ceph-mon[35491]: fsmap 10 up:standby 2024-09-11T00:00:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:15 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T00:00:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:16.140 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:16 smithi019 ceph-mon[30859]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.337+0000 7fc4d71fc640 1 -- 172.21.15.19:0/3264821805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d0109150 msgr2=0x7fc4d010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.337+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/3264821805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d0109150 0x7fc4d010f950 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009ca0 tx=0x7fc4c802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.337+0000 7fc4d71fc640 1 -- 172.21.15.19:0/3264821805 shutdown_connections 2024-09-11T00:00:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.337+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/3264821805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d0109150 0x7fc4d010f950 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.337+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/3264821805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4d01087d0 0x7fc4d0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.337+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/3264821805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d0102dc0 0x7fc4d01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.337+0000 7fc4d71fc640 1 -- 172.21.15.19:0/3264821805 >> 172.21.15.19:0/3264821805 conn(0x7fc4d00fe830 msgr2=0x7fc4d0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 -- 172.21.15.19:0/3264821805 shutdown_connections 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 -- 172.21.15.19:0/3264821805 wait complete. 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 Processor -- start 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 -- start start 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4d0102dc0 0x7fc4d019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d01087d0 0x7fc4d019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d0109150 0x7fc4d01a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d0112e10 con 0x7fc4d01087d0 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d0112c90 con 0x7fc4d0102dc0 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4d71fc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d0112f90 con 0x7fc4d0109150 2024-09-11T00:00:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.338+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d01087d0 0x7fc4d019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d01087d0 0x7fc4d019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50478/0 (socket says 172.21.15.19:50478) 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 -- 172.21.15.19:0/784227322 learned_addr learned my addr 172.21.15.19:0/784227322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4d4f98640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4d0102dc0 0x7fc4d019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4d5799640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d0109150 0x7fc4d01a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 -- 172.21.15.19:0/784227322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d0109150 msgr2=0x7fc4d01a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d0109150 0x7fc4d01a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 -- 172.21.15.19:0/784227322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4d0102dc0 msgr2=0x7fc4d019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4d0102dc0 0x7fc4d019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 -- 172.21.15.19:0/784227322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d01a14e0 con 0x7fc4d01087d0 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cffff640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d01087d0 0x7fc4d019b970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00c890 tx=0x7fc4bc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cdffb640 1 -- 172.21.15.19:0/784227322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc004220 con 0x7fc4d01087d0 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d01a17d0 con 0x7fc4d01087d0 2024-09-11T00:00:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cdffb640 1 -- 172.21.15.19:0/784227322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4bc0043c0 con 0x7fc4d01087d0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.339+0000 7fc4cdffb640 1 -- 172.21.15.19:0/784227322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc004a00 con 0x7fc4d01087d0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.340+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d01a7e90 con 0x7fc4d01087d0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.340+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d01031a0 con 0x7fc4d01087d0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.342+0000 7fc4cdffb640 1 -- 172.21.15.19:0/784227322 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc4bc0079b0 con 0x7fc4d01087d0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.342+0000 7fc4cdffb640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4c00b5330 0x7fc4c00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.343+0000 7fc4d4f98640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4c00b5330 0x7fc4c00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.343+0000 7fc4cdffb640 1 -- 172.21.15.19:0/784227322 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fc4bc0e5550 con 0x7fc4d01087d0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.343+0000 7fc4d4f98640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4c00b5330 0x7fc4c00b77f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400bbe0 tx=0x7fc4c400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.346+0000 7fc4cdffb640 1 -- 172.21.15.19:0/784227322 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc4bc014030 con 0x7fc4d01087d0 2024-09-11T00:00:16.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:16 smithi135 ceph-mon[35432]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:16 smithi131 ceph-mon[35491]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:16.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.575+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4d019c560 con 0x7fc4d01087d0 2024-09-11T00:00:16.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.575+0000 7fc4cdffb640 1 -- 172.21.15.19:0/784227322 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7fc4bc0ac190 con 0x7fc4d01087d0 2024-09-11T00:00:16.577 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:16.577 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":11,"btime":"2024-09-11T00:00:14:052693+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24604,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24625,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T00:00:16.577 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 11 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.577+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4c00b5330 msgr2=0x7fc4c00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.577+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4c00b5330 0x7fc4c00b77f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400bbe0 tx=0x7fc4c400b390 comp rx=0 tx=0).stop 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.577+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d01087d0 msgr2=0x7fc4d019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.577+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d01087d0 0x7fc4d019b970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00c890 tx=0x7fc4bc00cd50 comp rx=0 tx=0).stop 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 shutdown_connections 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d0109150 0x7fc4d01a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4c00b5330 0x7fc4c00b77f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4d01087d0 0x7fc4d019b970 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 --2- 172.21.15.19:0/784227322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4d0102dc0 0x7fc4d019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:16.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 >> 172.21.15.19:0/784227322 conn(0x7fc4d00fe830 msgr2=0x7fc4d0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:16.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 shutdown_connections 2024-09-11T00:00:16.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:16.578+0000 7fc4d71fc640 1 -- 172.21.15.19:0/784227322 wait complete. 2024-09-11T00:00:17.075 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:00:17 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-a[75990]: starting mds.a at 2024-09-11T00:00:17.396 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:17 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/784227322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:17.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:17 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/784227322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:17 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/784227322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:17.772 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:00:17 smithi019 bash[75961]: 448943214c3900833c389d337bbdd82379f60189a395b9302faaa98101258a42 2024-09-11T00:00:17.772 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:00:17 smithi019 systemd[1]: Started Ceph mds.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:00:18.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:18.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.19:6840/84271943,v1:172.21.15.19:6841/84271943] up:boot 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: fsmap 11 up:standby 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:18 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.19:6840/84271943,v1:172.21.15.19:6841/84271943] up:boot 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: fsmap 11 up:standby 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:18.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:18 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.19:6840/84271943,v1:172.21.15.19:6841/84271943] up:boot 2024-09-11T00:00:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: fsmap 11 up:standby 2024-09-11T00:00:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T00:00:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:00:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:00:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:18 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:19.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:19 smithi019 ceph-mon[30859]: Deploying daemon mds.b on smithi131 2024-09-11T00:00:19.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:19 smithi131 ceph-mon[35491]: Deploying daemon mds.b on smithi131 2024-09-11T00:00:19.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:19 smithi135 ceph-mon[35432]: Deploying daemon mds.b on smithi131 2024-09-11T00:00:19.427 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:19.688 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:19.761 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:19 smithi131 systemd[1]: Starting Ceph mds.b for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:00:20.012 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:19 smithi131 podman[66420]: 2024-09-11 00:00:19.663350019 +0000 UTC m=+0.015815537 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:00:20.012 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:19 smithi131 podman[66420]: 2024-09-11 00:00:19.76707836 +0000 UTC m=+0.119543859 container create 63217acb0f42df8c1c0bba1276ee34c2c6ad3e92a67db65a6178ad709f24f9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:00:20.012 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:20 smithi131 podman[66420]: 2024-09-11 00:00:20.011568559 +0000 UTC m=+0.364034058 container init 63217acb0f42df8c1c0bba1276ee34c2c6ad3e92a67db65a6178ad709f24f9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T00:00:20.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 -- 172.21.15.19:0/2599939495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18103b90 msgr2=0x7fbb18103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:20.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 --2- 172.21.15.19:0/2599939495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18103b90 0x7fbb18103f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009900 tx=0x7fbb1402a410 comp rx=0 tx=0).stop 2024-09-11T00:00:20.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 -- 172.21.15.19:0/2599939495 shutdown_connections 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 --2- 172.21.15.19:0/2599939495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb1810d140 0x7fbb1810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 --2- 172.21.15.19:0/2599939495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb18104590 0x7fbb1810cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 --2- 172.21.15.19:0/2599939495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18103b90 0x7fbb18103f70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 -- 172.21.15.19:0/2599939495 >> 172.21.15.19:0/2599939495 conn(0x7fbb180fd700 msgr2=0x7fbb180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 -- 172.21.15.19:0/2599939495 shutdown_connections 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.202+0000 7fbb20259640 1 -- 172.21.15.19:0/2599939495 wait complete. 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 Processor -- start 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 -- start start 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb18103b90 0x7fbb18199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18104590 0x7fbb181998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1810d140 0x7fbb1819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:20.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18112dc0 con 0x7fbb18104590 2024-09-11T00:00:20.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18112c40 con 0x7fbb18103b90 2024-09-11T00:00:20.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb20259640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18112f40 con 0x7fbb1810d140 2024-09-11T00:00:20.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18104590 0x7fbb181998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:20.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18104590 0x7fbb181998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50514/0 (socket says 172.21.15.19:50514) 2024-09-11T00:00:20.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 -- 172.21.15.19:0/707597455 learned_addr learned my addr 172.21.15.19:0/707597455 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:20.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1dff5640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb18103b90 0x7fbb18199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:20.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1e7f6640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1810d140 0x7fbb1819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 -- 172.21.15.19:0/707597455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1810d140 msgr2=0x7fbb1819ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1810d140 0x7fbb1819ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 -- 172.21.15.19:0/707597455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb18103b90 msgr2=0x7fbb18199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb18103b90 0x7fbb18199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.203+0000 7fbb1d7f4640 1 -- 172.21.15.19:0/707597455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1819f440 con 0x7fbb18104590 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.204+0000 7fbb1d7f4640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18104590 0x7fbb181998d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b4a0 tx=0x7fbb0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.204+0000 7fbb0effd640 1 -- 172.21.15.19:0/707597455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08014070 con 0x7fbb18104590 2024-09-11T00:00:20.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.204+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1819f730 con 0x7fbb18104590 2024-09-11T00:00:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.204+0000 7fbb0effd640 1 -- 172.21.15.19:0/707597455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb08010ac0 con 0x7fbb18104590 2024-09-11T00:00:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.204+0000 7fbb0effd640 1 -- 172.21.15.19:0/707597455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08017c30 con 0x7fbb18104590 2024-09-11T00:00:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.204+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb181a5fc0 con 0x7fbb18104590 2024-09-11T00:00:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.205+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb18103f70 con 0x7fbb18104590 2024-09-11T00:00:20.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.207+0000 7fbb0effd640 1 -- 172.21.15.19:0/707597455 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fbb08010610 con 0x7fbb18104590 2024-09-11T00:00:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.208+0000 7fbb0effd640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbb040b53b0 0x7fbb040b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.208+0000 7fbb1dff5640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbb040b53b0 0x7fbb040b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:20.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.208+0000 7fbb0effd640 1 -- 172.21.15.19:0/707597455 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fbb080e4ff0 con 0x7fbb18104590 2024-09-11T00:00:20.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.208+0000 7fbb1dff5640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbb040b53b0 0x7fbb040b7870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb14031440 tx=0x7fbb14005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:20.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.212+0000 7fbb0effd640 1 -- 172.21.15.19:0/707597455 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbb080abc30 con 0x7fbb18104590 2024-09-11T00:00:20.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:20 smithi131 ceph-mon[35491]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:20.301 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:20 smithi131 podman[66420]: 2024-09-11 00:00:20.014707469 +0000 UTC m=+0.367172977 container start 63217acb0f42df8c1c0bba1276ee34c2c6ad3e92a67db65a6178ad709f24f9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T00:00:20.301 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:20 smithi131 ceph-mds[66439]: -- 172.21.15.131:0/2603341328 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d78243860 con 0x562d78220800 2024-09-11T00:00:20.301 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b[66435]: starting mds.b at 2024-09-11T00:00:20.301 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:20 smithi131 bash[66420]: 63217acb0f42df8c1c0bba1276ee34c2c6ad3e92a67db65a6178ad709f24f9c9 2024-09-11T00:00:20.301 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:00:20 smithi131 systemd[1]: Started Ceph mds.b for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:00:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:20 smithi135 ceph-mon[35432]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:20.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.442+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb18107c20 con 0x7fbb18104590 2024-09-11T00:00:20.443 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:20 smithi019 ceph-mon[30859]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:20.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.443+0000 7fbb0effd640 1 -- 172.21.15.19:0/707597455 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7fbb080b0660 con 0x7fbb18104590 2024-09-11T00:00:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:20.445 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"btime":"2024-09-11T00:00:20:080568+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24604,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24625,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T00:00:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 13 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbb040b53b0 msgr2=0x7fbb040b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbb040b53b0 0x7fbb040b7870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb14031440 tx=0x7fbb14005e80 comp rx=0 tx=0).stop 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18104590 msgr2=0x7fbb181998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18104590 0x7fbb181998d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b4a0 tx=0x7fbb0800b960 comp rx=0 tx=0).stop 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 shutdown_connections 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1810d140 0x7fbb1819ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbb040b53b0 0x7fbb040b7870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb18104590 0x7fbb181998d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 --2- 172.21.15.19:0/707597455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb18103b90 0x7fbb18199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 >> 172.21.15.19:0/707597455 conn(0x7fbb180fd700 msgr2=0x7fbb180fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:20.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 shutdown_connections 2024-09-11T00:00:20.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:20.446+0000 7fbb20259640 1 -- 172.21.15.19:0/707597455 wait complete. 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] up:boot 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: fsmap 12 up:standby 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:21.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:21 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/707597455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:21.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T00:00:21.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] up:boot 2024-09-11T00:00:21.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: fsmap 12 up:standby 2024-09-11T00:00:21.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:00:21.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:21.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:21 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/707597455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:21.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] up:boot 2024-09-11T00:00:21.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: fsmap 12 up:standby 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:21.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:21 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/707597455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:22.354 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:22 smithi019 ceph-mon[30859]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:22.354 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.354 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.354 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.354 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:22 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.434+0000 7f800a863640 1 -- 172.21.15.19:0/3452662916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 msgr2=0x7f800410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.434+0000 7f800a863640 1 --2- 172.21.15.19:0/3452662916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800410f950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009ca0 tx=0x7f7ffc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 -- 172.21.15.19:0/3452662916 shutdown_connections 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 --2- 172.21.15.19:0/3452662916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800410f950 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 --2- 172.21.15.19:0/3452662916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80041087d0 0x7f8004108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 --2- 172.21.15.19:0/3452662916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8004102dc0 0x7f80041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 -- 172.21.15.19:0/3452662916 >> 172.21.15.19:0/3452662916 conn(0x7f80040fe830 msgr2=0x7f8004100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 -- 172.21.15.19:0/3452662916 shutdown_connections 2024-09-11T00:00:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 -- 172.21.15.19:0/3452662916 wait complete. 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 Processor -- start 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.435+0000 7f800a863640 1 -- start start 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f800a863640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8004102dc0 0x7f80041993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f800a863640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80041087d0 0x7f8004199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f800a863640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f800a863640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8004112e10 con 0x7f8004109150 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f800a863640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8004112c90 con 0x7f80041087d0 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f800a863640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8004112f90 con 0x7f8004102dc0 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800419eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49682/0 (socket says 172.21.15.19:49682) 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 -- 172.21.15.19:0/1033489206 learned_addr learned my addr 172.21.15.19:0/1033489206 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:22.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8003fff640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8004102dc0 0x7f80041993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f80037fe640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80041087d0 0x7f8004199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 -- 172.21.15.19:0/1033489206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8004102dc0 msgr2=0x7f80041993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8004102dc0 0x7f80041993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 -- 172.21.15.19:0/1033489206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80041087d0 msgr2=0x7f8004199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80041087d0 0x7f8004199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 -- 172.21.15.19:0/1033489206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800419f470 con 0x7f8004109150 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f8008e00640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800419eca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc005cc0 tx=0x7f7ffc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.436+0000 7f80017fa640 1 -- 172.21.15.19:0/1033489206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc003bf0 con 0x7f8004109150 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.437+0000 7f80017fa640 1 -- 172.21.15.19:0/1033489206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ffc003d90 con 0x7f8004109150 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.437+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800419f700 con 0x7f8004109150 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.437+0000 7f80017fa640 1 -- 172.21.15.19:0/1033489206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc02fb20 con 0x7f8004109150 2024-09-11T00:00:22.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.437+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80041a5e20 con 0x7f8004109150 2024-09-11T00:00:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.438+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80041031a0 con 0x7f8004109150 2024-09-11T00:00:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.439+0000 7f80017fa640 1 -- 172.21.15.19:0/1033489206 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f7ffc004580 con 0x7f8004109150 2024-09-11T00:00:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.440+0000 7f80017fa640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7fec0b5330 0x7f7fec0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.440+0000 7f8003fff640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7fec0b5330 0x7f7fec0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.440+0000 7f80017fa640 1 -- 172.21.15.19:0/1033489206 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f7ffc106b70 con 0x7f8004109150 2024-09-11T00:00:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.440+0000 7f8003fff640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7fec0b5330 0x7f7fec0b77f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009990 tx=0x7f7ff4009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.444+0000 7f80017fa640 1 -- 172.21.15.19:0/1033489206 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7ffc0cde00 con 0x7f8004109150 2024-09-11T00:00:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:22 smithi131 ceph-mon[35491]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:22 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.651+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f800410a9a0 con 0x7f8004109150 2024-09-11T00:00:22.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.651+0000 7f80017fa640 1 -- 172.21.15.19:0/1033489206 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f7ffc0098b0 con 0x7f8004109150 2024-09-11T00:00:22.653 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:22.653 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-11T00:00:22.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:00:22.654 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-11T00:00:22.654 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-11T00:00:22.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:00:22.654 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7fec0b5330 msgr2=0x7f7fec0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7fec0b5330 0x7f7fec0b77f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009990 tx=0x7f7ff4009110 comp rx=0 tx=0).stop 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 msgr2=0x7f800419eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800419eca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc005cc0 tx=0x7f7ffc02f380 comp rx=0 tx=0).stop 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 shutdown_connections 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7fec0b5330 0x7f7fec0b77f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8004109150 0x7f800419eca0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80041087d0 0x7f8004199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 --2- 172.21.15.19:0/1033489206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8004102dc0 0x7f80041993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.654+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 >> 172.21.15.19:0/1033489206 conn(0x7f80040fe830 msgr2=0x7f8004100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.655+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 shutdown_connections 2024-09-11T00:00:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:22.655+0000 7f800a863640 1 -- 172.21.15.19:0/1033489206 wait complete. 2024-09-11T00:00:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:22 smithi135 ceph-mon[35432]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:22.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:22 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:23.322 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T00:00:23.322 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T00:00:23.346 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:23 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1033489206' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T00:00:23.346 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:23 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:23 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1033489206' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T00:00:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:23 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:23.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:23 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1033489206' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T00:00:23.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:23 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 -- 172.21.15.19:0/267600666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f010d140 msgr2=0x7f93f010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/267600666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f010d140 0x7f93f010f5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009900 tx=0x7f93e802a410 comp rx=0 tx=0).stop 2024-09-11T00:00:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 -- 172.21.15.19:0/267600666 shutdown_connections 2024-09-11T00:00:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/267600666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f010d140 0x7f93f010f5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/267600666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93f0104600 0x7f93f010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/267600666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93f0103ce0 0x7f93f01040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 -- 172.21.15.19:0/267600666 >> 172.21.15.19:0/267600666 conn(0x7f93f00fd700 msgr2=0x7f93f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 -- 172.21.15.19:0/267600666 shutdown_connections 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.100+0000 7f93f4ef6640 1 -- 172.21.15.19:0/267600666 wait complete. 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 Processor -- start 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 -- start start 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f0103ce0 0x7f93f0101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93f0104600 0x7f93f0101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93f010d140 0x7f93f0102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0112db0 con 0x7f93f0103ce0 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0112c30 con 0x7f93f0104600 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.101+0000 7f93f4ef6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0112f30 con 0x7f93f010d140 2024-09-11T00:00:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f0103ce0 0x7f93f0101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f0103ce0 0x7f93f0101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49700/0 (socket says 172.21.15.19:49700) 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 -- 172.21.15.19:0/3644129754 learned_addr learned my addr 172.21.15.19:0/3644129754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93edd9b640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93f0104600 0x7f93f0101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93eed9d640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93f010d140 0x7f93f0102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 -- 172.21.15.19:0/3644129754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93f010d140 msgr2=0x7f93f0102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93f010d140 0x7f93f0102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 -- 172.21.15.19:0/3644129754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93f0104600 msgr2=0x7f93f0101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93f0104600 0x7f93f0101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 -- 172.21.15.19:0/3644129754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f01a7680 con 0x7f93f0103ce0 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93eed9d640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93f010d140 0x7f93f0102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93ee59c640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f0103ce0 0x7f93f0101990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93e000db80 tx=0x7f93e000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93df7fe640 1 -- 172.21.15.19:0/3644129754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0017070 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93df7fe640 1 -- 172.21.15.19:0/3644129754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93e0003b70 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f01a7970 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93df7fe640 1 -- 172.21.15.19:0/3644129754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e00106c0 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.102+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f01a7eb0 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.103+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f01040c0 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.105+0000 7f93df7fe640 1 -- 172.21.15.19:0/3644129754 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f93e0023060 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.105+0000 7f93df7fe640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f93d80b5330 0x7f93d80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.106+0000 7f93edd9b640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f93d80b5330 0x7f93d80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.106+0000 7f93df7fe640 1 -- 172.21.15.19:0/3644129754 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f93e00e5980 con 0x7f93f0103ce0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.106+0000 7f93edd9b640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f93d80b5330 0x7f93d80b77f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93f0103480 tx=0x7f93e400b2e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.111+0000 7f93df7fe640 1 -- 172.21.15.19:0/3644129754 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f93e00acc10 con 0x7f93f0103ce0 2024-09-11T00:00:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:24 smithi019 ceph-mon[30859]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:24 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:24.302+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f93f01a82c0 con 0x7f93f0103ce0 2024-09-11T00:00:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:24 smithi131 ceph-mon[35491]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:24 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:24 smithi135 ceph-mon[35432]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:24 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:25.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.203+0000 7f93df7fe640 1 -- 172.21.15.19:0/3644129754 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f93e00ac510 con 0x7f93f0103ce0 2024-09-11T00:00:25.205 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-11T00:00:25.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f93d80b5330 msgr2=0x7f93d80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f93d80b5330 0x7f93d80b77f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93f0103480 tx=0x7f93e400b2e0 comp rx=0 tx=0).stop 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f0103ce0 msgr2=0x7f93f0101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f0103ce0 0x7f93f0101990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93e000db80 tx=0x7f93e000b630 comp rx=0 tx=0).stop 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 shutdown_connections 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93f010d140 0x7f93f0102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93f0104600 0x7f93f0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f93d80b5330 0x7f93d80b77f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 --2- 172.21.15.19:0/3644129754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93f0103ce0 0x7f93f0101990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.205+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 >> 172.21.15.19:0/3644129754 conn(0x7f93f00fd700 msgr2=0x7f93f00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:25.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.206+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 shutdown_connections 2024-09-11T00:00:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:25.207+0000 7f93f4ef6640 1 -- 172.21.15.19:0/3644129754 wait complete. 2024-09-11T00:00:25.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:25 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3644129754' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T00:00:25.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:25 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3644129754' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T00:00:25.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:25 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3644129754' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T00:00:25.934 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T00:00:26.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:26 smithi019 ceph-mon[30859]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:26.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:26 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3644129754' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T00:00:26.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:26 smithi019 ceph-mon[30859]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T00:00:26.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.216 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.273 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:26 smithi131 ceph-mon[35491]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:26 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3644129754' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T00:00:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:26 smithi131 ceph-mon[35491]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T00:00:26.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:26 smithi135 ceph-mon[35432]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:26 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3644129754' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T00:00:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:26 smithi135 ceph-mon[35432]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T00:00:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 -- 172.21.15.19:0/295579200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00109150 msgr2=0x7f7b0010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 --2- 172.21.15.19:0/295579200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00109150 0x7f7b0010f950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009ca0 tx=0x7f7af802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 -- 172.21.15.19:0/295579200 shutdown_connections 2024-09-11T00:00:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 --2- 172.21.15.19:0/295579200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00109150 0x7f7b0010f950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 --2- 172.21.15.19:0/295579200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b001087d0 0x7f7b00108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 --2- 172.21.15.19:0/295579200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b00102dc0 0x7f7b001031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 -- 172.21.15.19:0/295579200 >> 172.21.15.19:0/295579200 conn(0x7f7b000fe830 msgr2=0x7f7b00100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 -- 172.21.15.19:0/295579200 shutdown_connections 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.772+0000 7f7b0710c640 1 -- 172.21.15.19:0/295579200 wait complete. 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 Processor -- start 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 -- start start 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00102dc0 0x7f7b00199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b001087d0 0x7f7b001997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b00109150 0x7f7b0019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b00112dd0 con 0x7f7b00102dc0 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b00112c50 con 0x7f7b00109150 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b0710c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b00112f50 con 0x7f7b001087d0 2024-09-11T00:00:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00102dc0 0x7f7b00199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00102dc0 0x7f7b00199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49722/0 (socket says 172.21.15.19:49722) 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 -- 172.21.15.19:0/4020354725 learned_addr learned my addr 172.21.15.19:0/4020354725 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7afffff640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b001087d0 0x7f7b001997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 -- 172.21.15.19:0/4020354725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b001087d0 msgr2=0x7f7b001997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b001087d0 0x7f7b001997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 -- 172.21.15.19:0/4020354725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b00109150 msgr2=0x7f7b0019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b00109150 0x7f7b0019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7b04ea8640 1 -- 172.21.15.19:0/4020354725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0019f310 con 0x7f7b00102dc0 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.773+0000 7f7afffff640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b001087d0 0x7f7b001997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.774+0000 7f7b04ea8640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00102dc0 0x7f7b00199260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7af000d950 tx=0x7f7af000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.774+0000 7f7afdffb640 1 -- 172.21.15.19:0/4020354725 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0017030 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.774+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0019f600 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.774+0000 7f7afdffb640 1 -- 172.21.15.19:0/4020354725 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7af0004020 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.774+0000 7f7afdffb640 1 -- 172.21.15.19:0/4020354725 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af00047a0 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.774+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b001a5cc0 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.775+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b001031a0 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.777+0000 7f7afdffb640 1 -- 172.21.15.19:0/4020354725 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f7af0009a30 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.778+0000 7f7afdffb640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7ae80b5330 0x7f7ae80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.778+0000 7f7afffff640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7ae80b5330 0x7f7ae80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.778+0000 7f7afdffb640 1 -- 172.21.15.19:0/4020354725 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7712+0+0 (secure 0 0 0) 0x7f7af00e5c10 con 0x7f7b00102dc0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.779+0000 7f7afffff640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7ae80b5330 0x7f7ae80b77f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005d70 tx=0x7f7af4005d00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.781+0000 7f7afdffb640 1 -- 172.21.15.19:0/4020354725 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7af00accb0 con 0x7f7b00102dc0 2024-09-11T00:00:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:26.967+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7b0019a390 con 0x7f7b00102dc0 2024-09-11T00:00:27.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.219+0000 7f7afdffb640 1 -- 172.21.15.19:0/4020354725 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) ==== 170+0+0 (secure 0 0 0) 0x7f7af00ac5b0 con 0x7f7b00102dc0 2024-09-11T00:00:27.221 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-11T00:00:27.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:27 smithi019 ceph-mon[30859]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T00:00:27.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:27 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:27 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:27 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:27.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:27 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:27.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:27 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:27 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4020354725' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7ae80b5330 msgr2=0x7f7ae80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7ae80b5330 0x7f7ae80b77f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005d70 tx=0x7f7af4005d00 comp rx=0 tx=0).stop 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00102dc0 msgr2=0x7f7b00199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00102dc0 0x7f7b00199260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7af000d950 tx=0x7f7af000de10 comp rx=0 tx=0).stop 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 shutdown_connections 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b00109150 0x7f7b0019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b001087d0 0x7f7b001997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7ae80b5330 0x7f7ae80b77f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 --2- 172.21.15.19:0/4020354725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b00102dc0 0x7f7b00199260 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:27.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 >> 172.21.15.19:0/4020354725 conn(0x7f7b000fe830 msgr2=0x7f7b00100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:27.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.222+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 shutdown_connections 2024-09-11T00:00:27.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:27.223+0000 7f7b0710c640 1 -- 172.21.15.19:0/4020354725 wait complete. 2024-09-11T00:00:27.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:27 smithi131 ceph-mon[35491]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T00:00:27.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:27 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:27 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:27 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:27.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:27 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:27.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:27 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:27 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4020354725' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T00:00:27.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:27 smithi135 ceph-mon[35432]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T00:00:27.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:27 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:27 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:27 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:27.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:27 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:27.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:27 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:00:27.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:27 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4020354725' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T00:00:27.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T00:00:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:28 smithi019 ceph-mon[30859]: pgmap v258: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:28 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4020354725' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T00:00:28.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:28 smithi019 ceph-mon[30859]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T00:00:28.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:28 smithi019 ceph-mon[30859]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T00:00:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:28 smithi131 ceph-mon[35491]: pgmap v258: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:28 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4020354725' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T00:00:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:28 smithi131 ceph-mon[35491]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T00:00:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:28 smithi131 ceph-mon[35491]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T00:00:28.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:28 smithi135 ceph-mon[35432]: pgmap v258: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:28.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:28 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4020354725' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T00:00:28.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:28 smithi135 ceph-mon[35432]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T00:00:28.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:28 smithi135 ceph-mon[35432]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 -- 172.21.15.19:0/464814559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9181087d0 msgr2=0x7fd918108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 --2- 172.21.15.19:0/464814559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9181087d0 0x7fd918108c10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd900009900 tx=0x7fd90002a410 comp rx=0 tx=0).stop 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 -- 172.21.15.19:0/464814559 shutdown_connections 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 --2- 172.21.15.19:0/464814559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd918109150 0x7fd91810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 --2- 172.21.15.19:0/464814559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9181087d0 0x7fd918108c10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 --2- 172.21.15.19:0/464814559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd918102dc0 0x7fd9181031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 -- 172.21.15.19:0/464814559 >> 172.21.15.19:0/464814559 conn(0x7fd9180fe830 msgr2=0x7fd918100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 -- 172.21.15.19:0/464814559 shutdown_connections 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.683+0000 7fd91d28b640 1 -- 172.21.15.19:0/464814559 wait complete. 2024-09-11T00:00:28.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.684+0000 7fd91d28b640 1 Processor -- start 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.684+0000 7fd91d28b640 1 -- start start 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.684+0000 7fd91d28b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd918102dc0 0x7fd9181992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.684+0000 7fd91d28b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9181087d0 0x7fd918199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd91d28b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd918109150 0x7fd91819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd91d28b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd918112e10 con 0x7fd918109150 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd91d28b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd918112c90 con 0x7fd9181087d0 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd91d28b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd918112f90 con 0x7fd918102dc0 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd918109150 0x7fd91819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd918109150 0x7fd91819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49734/0 (socket says 172.21.15.19:49734) 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 -- 172.21.15.19:0/4240460942 learned_addr learned my addr 172.21.15.19:0/4240460942 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:28.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd916ffd640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd918102dc0 0x7fd9181992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd90ffff640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9181087d0 0x7fd918199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 -- 172.21.15.19:0/4240460942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd918102dc0 msgr2=0x7fd9181992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd918102dc0 0x7fd9181992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 -- 172.21.15.19:0/4240460942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9181087d0 msgr2=0x7fd918199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9181087d0 0x7fd918199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 -- 172.21.15.19:0/4240460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91819f370 con 0x7fd918109150 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd9177fe640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd918109150 0x7fd91819eba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd91000eaa0 tx=0x7fd91000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd914ff9640 1 -- 172.21.15.19:0/4240460942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91000cdb0 con 0x7fd918109150 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91819f660 con 0x7fd918109150 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd914ff9640 1 -- 172.21.15.19:0/4240460942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd910005020 con 0x7fd918109150 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd914ff9640 1 -- 172.21.15.19:0/4240460942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9100116d0 con 0x7fd918109150 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.685+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9181a5d20 con 0x7fd918109150 2024-09-11T00:00:28.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.686+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9181031a0 con 0x7fd918109150 2024-09-11T00:00:28.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.688+0000 7fd914ff9640 1 -- 172.21.15.19:0/4240460942 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fd91000f040 con 0x7fd918109150 2024-09-11T00:00:28.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.689+0000 7fd914ff9640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd9040b5330 0x7fd9040b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:28.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.689+0000 7fd916ffd640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd9040b5330 0x7fd9040b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:28.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.689+0000 7fd914ff9640 1 -- 172.21.15.19:0/4240460942 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8094+0+0 (secure 0 0 0) 0x7fd9100e5dc0 con 0x7fd918109150 2024-09-11T00:00:28.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.689+0000 7fd916ffd640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd9040b5330 0x7fd9040b77f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd90800bbe0 tx=0x7fd90800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:28.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.692+0000 7fd914ff9640 1 -- 172.21.15.19:0/4240460942 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd910016030 con 0x7fd918109150 2024-09-11T00:00:28.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:28.915+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd91802e5c0 con 0x7fd918109150 2024-09-11T00:00:29.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.241+0000 7fd914ff9640 1 -- 172.21.15.19:0/4240460942 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fd9100ac670 con 0x7fd918109150 2024-09-11T00:00:29.243 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T00:00:29.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd9040b5330 msgr2=0x7fd9040b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:29.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd9040b5330 0x7fd9040b77f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd90800bbe0 tx=0x7fd90800b390 comp rx=0 tx=0).stop 2024-09-11T00:00:29.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd918109150 msgr2=0x7fd91819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:29.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd918109150 0x7fd91819eba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd91000eaa0 tx=0x7fd91000ef60 comp rx=0 tx=0).stop 2024-09-11T00:00:29.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 shutdown_connections 2024-09-11T00:00:29.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd9040b5330 0x7fd9040b77f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:29.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd918109150 0x7fd91819eba0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:29.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9181087d0 0x7fd918199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:29.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 --2- 172.21.15.19:0/4240460942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd918102dc0 0x7fd9181992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:29.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 >> 172.21.15.19:0/4240460942 conn(0x7fd9180fe830 msgr2=0x7fd918100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:29.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 shutdown_connections 2024-09-11T00:00:29.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:29.244+0000 7fd91d28b640 1 -- 172.21.15.19:0/4240460942 wait complete. 2024-09-11T00:00:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:29 smithi019 ceph-mon[30859]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T00:00:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:29 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4240460942' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T00:00:29.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:29 smithi019 ceph-mon[30859]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T00:00:29.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:29 smithi131 ceph-mon[35491]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T00:00:29.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:29 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4240460942' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T00:00:29.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:29 smithi131 ceph-mon[35491]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T00:00:29.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:29 smithi135 ceph-mon[35432]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T00:00:29.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:29 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4240460942' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T00:00:29.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:29 smithi135 ceph-mon[35432]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T00:00:30.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:00:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:30.443 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:30 smithi019 ceph-mon[30859]: pgmap v261: 97 pgs: 20 active+clean, 8 creating+peering, 69 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:30.443 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:30 smithi019 ceph-mon[30859]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T00:00:30.443 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:30 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4240460942' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T00:00:30.443 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:30 smithi019 ceph-mon[30859]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T00:00:30.443 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:30 smithi019 ceph-mon[30859]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T00:00:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:30 smithi131 ceph-mon[35491]: pgmap v261: 97 pgs: 20 active+clean, 8 creating+peering, 69 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:30 smithi131 ceph-mon[35491]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T00:00:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:30 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4240460942' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T00:00:30.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:30 smithi131 ceph-mon[35491]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T00:00:30.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:30 smithi131 ceph-mon[35491]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T00:00:30.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:30 smithi135 ceph-mon[35432]: pgmap v261: 97 pgs: 20 active+clean, 8 creating+peering, 69 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:00:30.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:30 smithi135 ceph-mon[35432]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T00:00:30.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:30 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4240460942' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T00:00:30.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:30 smithi135 ceph-mon[35432]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T00:00:30.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:30 smithi135 ceph-mon[35432]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T00:00:30.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 -- 172.21.15.19:0/461713986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 msgr2=0x7fc9281040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:30.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 --2- 172.21.15.19:0/461713986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc9281040c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc924009900 tx=0x7fc92402a410 comp rx=0 tx=0).stop 2024-09-11T00:00:30.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 -- 172.21.15.19:0/461713986 shutdown_connections 2024-09-11T00:00:30.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 --2- 172.21.15.19:0/461713986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc92810d140 0x7fc92810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:30.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 --2- 172.21.15.19:0/461713986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc928104600 0x7fc92810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:30.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 --2- 172.21.15.19:0/461713986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc9281040c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:30.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 -- 172.21.15.19:0/461713986 >> 172.21.15.19:0/461713986 conn(0x7fc9280fd700 msgr2=0x7fc9280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 -- 172.21.15.19:0/461713986 shutdown_connections 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 -- 172.21.15.19:0/461713986 wait complete. 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.826+0000 7fc9305d6640 1 Processor -- start 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc9305d6640 1 -- start start 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc9305d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc928199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc9305d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc928104600 0x7fc928199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc9305d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc92810d140 0x7fc92819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc9305d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc928112db0 con 0x7fc928103ce0 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc9305d6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc928112c30 con 0x7fc928104600 2024-09-11T00:00:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc9305d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc928112f30 con 0x7fc92810d140 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc928199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc928199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49762/0 (socket says 172.21.15.19:49762) 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 -- 172.21.15.19:0/854435944 learned_addr learned my addr 172.21.15.19:0/854435944 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92eb73640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc92810d140 0x7fc92819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 -- 172.21.15.19:0/854435944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc92810d140 msgr2=0x7fc92819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc92810d140 0x7fc92819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92db71640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc928104600 0x7fc928199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 -- 172.21.15.19:0/854435944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc928104600 msgr2=0x7fc928199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc928104600 0x7fc928199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 -- 172.21.15.19:0/854435944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92819f3b0 con 0x7fc928103ce0 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92db71640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc928104600 0x7fc928199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:30.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc92e372640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc928199300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc924005940 tx=0x7fc924004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.827+0000 7fc91f7fe640 1 -- 172.21.15.19:0/854435944 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92403f030 con 0x7fc928103ce0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.828+0000 7fc91f7fe640 1 -- 172.21.15.19:0/854435944 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc924003aa0 con 0x7fc928103ce0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.828+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92819f640 con 0x7fc928103ce0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.828+0000 7fc91f7fe640 1 -- 172.21.15.19:0/854435944 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924035070 con 0x7fc928103ce0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.828+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9281a5d60 con 0x7fc928103ce0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.828+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9281040c0 con 0x7fc928103ce0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.830+0000 7fc91f7fe640 1 -- 172.21.15.19:0/854435944 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc92403bcc0 con 0x7fc928103ce0 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.831+0000 7fc91f7fe640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9140b53b0 0x7fc9140b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:30.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.831+0000 7fc92db71640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9140b53b0 0x7fc9140b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.831+0000 7fc91f7fe640 1 -- 172.21.15.19:0/854435944 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7fc9241068d0 con 0x7fc928103ce0 2024-09-11T00:00:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.831+0000 7fc92db71640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9140b53b0 0x7fc9140b7870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc92810f8b0 tx=0x7fc918005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:30.834+0000 7fc91f7fe640 1 -- 172.21.15.19:0/854435944 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9240cd7b0 con 0x7fc928103ce0 2024-09-11T00:00:31.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.020+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc92819a430 con 0x7fc928103ce0 2024-09-11T00:00:31.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.021+0000 7fc91f7fe640 1 -- 172.21.15.19:0/854435944 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22582 (secure 0 0 0) 0x7fc92819a430 con 0x7fc928103ce0 2024-09-11T00:00:31.023 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:31.023 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":76,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:28.916379+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:00:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9140b53b0 msgr2=0x7fc9140b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9140b53b0 0x7fc9140b7870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc92810f8b0 tx=0x7fc918005f90 comp rx=0 tx=0).stop 2024-09-11T00:00:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 msgr2=0x7fc928199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc928199300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc924005940 tx=0x7fc924004270 comp rx=0 tx=0).stop 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 shutdown_connections 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc92810d140 0x7fc92819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc928104600 0x7fc928199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9140b53b0 0x7fc9140b7870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 --2- 172.21.15.19:0/854435944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc928103ce0 0x7fc928199300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 >> 172.21.15.19:0/854435944 conn(0x7fc9280fd700 msgr2=0x7fc9280fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 shutdown_connections 2024-09-11T00:00:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:31.024+0000 7fc9305d6640 1 -- 172.21.15.19:0/854435944 wait complete. 2024-09-11T00:00:31.175 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:00:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i[67194]: 2024-09-11T00:00:30.783+0000 7fddbc65f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:00:31.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:31 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] up:active 2024-09-11T00:00:31.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:31 smithi019 ceph-mon[30859]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:31.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:31 smithi019 ceph-mon[30859]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:31.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:31 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/854435944' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:31.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:31 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] up:active 2024-09-11T00:00:31.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:31 smithi131 ceph-mon[35491]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:31.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:31 smithi131 ceph-mon[35491]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:31.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:31 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/854435944' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:31.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:31 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] up:active 2024-09-11T00:00:31.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:31 smithi135 ceph-mon[35432]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:31.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:31 smithi135 ceph-mon[35432]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:31.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:31 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/854435944' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:31.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:00:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:32.393 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:32 smithi019 ceph-mon[30859]: pgmap v263: 97 pgs: 56 active+clean, 8 creating+peering, 33 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T00:00:32.394 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:32 smithi019 ceph-mon[30859]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T00:00:32.394 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:32 smithi019 ceph-mon[30859]: Cluster is now healthy 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2745975269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 msgr2=0x7fc8b0102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2745975269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b0102090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009900 tx=0x7fc8a402a410 comp rx=0 tx=0).stop 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2745975269 shutdown_connections 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2745975269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b0108040 0x7fc8b010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2745975269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01076c0 0x7fc8b0107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2745975269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b0102090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2745975269 >> 172.21.15.19:0/2745975269 conn(0x7fc8b00fd700 msgr2=0x7fc8b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2745975269 shutdown_connections 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.474+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2745975269 wait complete. 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 Processor -- start 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 -- start start 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01076c0 0x7fc8b019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b0108040 0x7fc8b019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0111d40 con 0x7fc8b0101cb0 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0111bc0 con 0x7fc8b0108040 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b6eda640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0111ec0 con 0x7fc8b01076c0 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b4c76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b4c76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45792/0 (socket says 172.21.15.19:45792) 2024-09-11T00:00:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8b4c76640 1 -- 172.21.15.19:0/2873113171 learned_addr learned my addr 172.21.15.19:0/2873113171 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.475+0000 7fc8affff640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01076c0 0x7fc8b019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b4c76640 1 -- 172.21.15.19:0/2873113171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01076c0 msgr2=0x7fc8b019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b4c76640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01076c0 0x7fc8b019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b5477640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b0108040 0x7fc8b019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b4c76640 1 -- 172.21.15.19:0/2873113171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b0108040 msgr2=0x7fc8b019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b4c76640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b0108040 0x7fc8b019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b4c76640 1 -- 172.21.15.19:0/2873113171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b01a55f0 con 0x7fc8b0101cb0 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8affff640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01076c0 0x7fc8b019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b5477640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b0108040 0x7fc8b019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b4c76640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b019a1f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4006010 tx=0x7fc8a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8adffb640 1 -- 172.21.15.19:0/2873113171 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a403f030 con 0x7fc8b0101cb0 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8adffb640 1 -- 172.21.15.19:0/2873113171 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a4003800 con 0x7fc8b0101cb0 2024-09-11T00:00:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b01a5880 con 0x7fc8b0101cb0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8adffb640 1 -- 172.21.15.19:0/2873113171 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4035070 con 0x7fc8b0101cb0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.476+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b01a5e30 con 0x7fc8b0101cb0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.477+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b0102110 con 0x7fc8b0101cb0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.479+0000 7fc8adffb640 1 -- 172.21.15.19:0/2873113171 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc8a4031b10 con 0x7fc8b0101cb0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.479+0000 7fc8adffb640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8a00b53b0 0x7fc8a00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.480+0000 7fc8affff640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8a00b53b0 0x7fc8a00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.480+0000 7fc8adffb640 1 -- 172.21.15.19:0/2873113171 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7fc8a41067f0 con 0x7fc8b0101cb0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.480+0000 7fc8affff640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8a00b53b0 0x7fc8a00b7870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc89c006fd0 tx=0x7fc89c008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:32.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.482+0000 7fc8adffb640 1 -- 172.21.15.19:0/2873113171 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc8a40cd6d0 con 0x7fc8b0101cb0 2024-09-11T00:00:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:32 smithi131 ceph-mon[35491]: pgmap v263: 97 pgs: 56 active+clean, 8 creating+peering, 33 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T00:00:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:32 smithi131 ceph-mon[35491]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T00:00:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:32 smithi131 ceph-mon[35491]: Cluster is now healthy 2024-09-11T00:00:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.670+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8b002e5c0 con 0x7fc8b0101cb0 2024-09-11T00:00:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.672+0000 7fc8adffb640 1 -- 172.21.15.19:0/2873113171 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22582 (secure 0 0 0) 0x7fc8a40ccfd0 con 0x7fc8b0101cb0 2024-09-11T00:00:32.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:32.674 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":76,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:28.916379+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:00:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:32 smithi135 ceph-mon[35432]: pgmap v263: 97 pgs: 56 active+clean, 8 creating+peering, 33 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T00:00:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:32 smithi135 ceph-mon[35432]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T00:00:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:32 smithi135 ceph-mon[35432]: Cluster is now healthy 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.674+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8a00b53b0 msgr2=0x7fc8a00b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.674+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8a00b53b0 0x7fc8a00b7870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc89c006fd0 tx=0x7fc89c008040 comp rx=0 tx=0).stop 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.674+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 msgr2=0x7fc8b019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.674+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b019a1f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4006010 tx=0x7fc8a40042f0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 shutdown_connections 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b0108040 0x7fc8b019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01076c0 0x7fc8b019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8a00b53b0 0x7fc8a00b7870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 --2- 172.21.15.19:0/2873113171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b0101cb0 0x7fc8b019a1f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 >> 172.21.15.19:0/2873113171 conn(0x7fc8b00fd700 msgr2=0x7fc8b00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 shutdown_connections 2024-09-11T00:00:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:32.675+0000 7fc8b6eda640 1 -- 172.21.15.19:0/2873113171 wait complete. 2024-09-11T00:00:33.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T00:00:33.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:33 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2873113171' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:33.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:33 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2873113171' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:33.615 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:33.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:33 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2873113171' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 -- 172.21.15.19:0/3971613248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac109150 msgr2=0x7f99ac10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 --2- 172.21.15.19:0/3971613248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac109150 0x7f99ac10f950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009ca0 tx=0x7f99a402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 -- 172.21.15.19:0/3971613248 shutdown_connections 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 --2- 172.21.15.19:0/3971613248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac109150 0x7f99ac10f950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 --2- 172.21.15.19:0/3971613248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac1087d0 0x7f99ac108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 --2- 172.21.15.19:0/3971613248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ac102dc0 0x7f99ac1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 -- 172.21.15.19:0/3971613248 >> 172.21.15.19:0/3971613248 conn(0x7f99ac0fe870 msgr2=0x7f99ac100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 -- 172.21.15.19:0/3971613248 shutdown_connections 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.129+0000 7f99b4458640 1 -- 172.21.15.19:0/3971613248 wait complete. 2024-09-11T00:00:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 Processor -- start 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 -- start start 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ac102dc0 0x7f99ac0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac1087d0 0x7f99ac0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac109150 0x7f99ac075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac112dd0 con 0x7f99ac1087d0 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac112c50 con 0x7f99ac102dc0 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b4458640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac112f50 con 0x7f99ac109150 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac1087d0 0x7f99ac0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac1087d0 0x7f99ac0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45812/0 (socket says 172.21.15.19:45812) 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 -- 172.21.15.19:0/3912368476 learned_addr learned my addr 172.21.15.19:0/3912368476 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b21f4640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ac102dc0 0x7f99ac0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b29f5640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac109150 0x7f99ac075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 -- 172.21.15.19:0/3912368476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac109150 msgr2=0x7f99ac075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac109150 0x7f99ac075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 -- 172.21.15.19:0/3912368476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ac102dc0 msgr2=0x7f99ac0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ac102dc0 0x7f99ac0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b19f3640 1 -- 172.21.15.19:0/3912368476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac1a7640 con 0x7f99ac1087d0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.130+0000 7f99b21f4640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ac102dc0 0x7f99ac0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.131+0000 7f99b19f3640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac1087d0 0x7f99ac0759e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f999c00d950 tx=0x7f999c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.131+0000 7f99a37fe640 1 -- 172.21.15.19:0/3912368476 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c017070 con 0x7f99ac1087d0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.131+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac1a7930 con 0x7f99ac1087d0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.131+0000 7f99a37fe640 1 -- 172.21.15.19:0/3912368476 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c009c30 con 0x7f99ac1087d0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.131+0000 7f99a37fe640 1 -- 172.21.15.19:0/3912368476 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c00f620 con 0x7f99ac1087d0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.131+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac1a7ec0 con 0x7f99ac1087d0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.132+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ac1031a0 con 0x7f99ac1087d0 2024-09-11T00:00:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.133+0000 7f99a37fe640 1 -- 172.21.15.19:0/3912368476 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f999c010460 con 0x7f99ac1087d0 2024-09-11T00:00:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.134+0000 7f99a37fe640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99980b5330 0x7f99980b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.134+0000 7f99b21f4640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99980b5330 0x7f99980b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.134+0000 7f99a37fe640 1 -- 172.21.15.19:0/3912368476 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7f999c0e58d0 con 0x7f99ac1087d0 2024-09-11T00:00:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.135+0000 7f99b21f4640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99980b5330 0x7f99980b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99a800abe0 tx=0x7f99a800a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.142+0000 7f99a37fe640 1 -- 172.21.15.19:0/3912368476 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f999c0ac7b0 con 0x7f99ac1087d0 2024-09-11T00:00:34.308 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:34 smithi019 ceph-mon[30859]: pgmap v264: 97 pgs: 92 active+clean, 5 creating+peering; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-09-11T00:00:34.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:34.369+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f99ac1a8210 con 0x7f99ac1087d0 2024-09-11T00:00:34.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:34 smithi131 ceph-mon[35491]: pgmap v264: 97 pgs: 92 active+clean, 5 creating+peering; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-09-11T00:00:34.576 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:34 smithi135 ceph-mon[35432]: pgmap v264: 97 pgs: 92 active+clean, 5 creating+peering; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-09-11T00:00:35.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.271+0000 7f99a37fe640 1 -- 172.21.15.19:0/3912368476 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f999c009de0 con 0x7f99ac1087d0 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99980b5330 msgr2=0x7f99980b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99980b5330 0x7f99980b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99a800abe0 tx=0x7f99a800a5c0 comp rx=0 tx=0).stop 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac1087d0 msgr2=0x7f99ac0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac1087d0 0x7f99ac0759e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f999c00d950 tx=0x7f999c00de10 comp rx=0 tx=0).stop 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 shutdown_connections 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ac109150 0x7f99ac075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99980b5330 0x7f99980b77f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99ac1087d0 0x7f99ac0759e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:35.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 --2- 172.21.15.19:0/3912368476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ac102dc0 0x7f99ac0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:35.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 >> 172.21.15.19:0/3912368476 conn(0x7f99ac0fe870 msgr2=0x7f99ac0ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:35.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 shutdown_connections 2024-09-11T00:00:35.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:35.273+0000 7f99b4458640 1 -- 172.21.15.19:0/3912368476 wait complete. 2024-09-11T00:00:35.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:35 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3912368476' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T00:00:35.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:35 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3912368476' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T00:00:35.588 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:35 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3912368476' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T00:00:36.018 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T00:00:36.019 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-11T00:00:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:36.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:36 smithi019 ceph-mon[30859]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-11T00:00:36.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:36 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3912368476' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T00:00:36.527 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:36 smithi019 ceph-mon[30859]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:36 smithi131 ceph-mon[35491]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-11T00:00:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:36 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3912368476' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T00:00:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:36 smithi131 ceph-mon[35491]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:36.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:36 smithi135 ceph-mon[35432]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-11T00:00:36.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:36 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3912368476' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T00:00:36.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:36 smithi135 ceph-mon[35432]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:36.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 -- 172.21.15.19:0/3744874367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 msgr2=0x7fb2801117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:36.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 --2- 172.21.15.19:0/3744874367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801117d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb278009900 tx=0x7fb27802a480 comp rx=0 tx=0).stop 2024-09-11T00:00:36.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 -- 172.21.15.19:0/3744874367 shutdown_connections 2024-09-11T00:00:36.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 --2- 172.21.15.19:0/3744874367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801117d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:36.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 --2- 172.21.15.19:0/3744874367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb280102150 0x7fb28010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 --2- 172.21.15.19:0/3744874367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb280101830 0x7fb280101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 -- 172.21.15.19:0/3744874367 >> 172.21.15.19:0/3744874367 conn(0x7fb2800fd700 msgr2=0x7fb2800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 -- 172.21.15.19:0/3744874367 shutdown_connections 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.740+0000 7fb2879ce640 1 -- 172.21.15.19:0/3744874367 wait complete. 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 Processor -- start 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 -- start start 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb280101830 0x7fb28019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb280102150 0x7fb28019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb280114f40 con 0x7fb28010f3e0 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb280114dc0 con 0x7fb280102150 2024-09-11T00:00:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb2879ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2801150c0 con 0x7fb280101830 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45828/0 (socket says 172.21.15.19:45828) 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 -- 172.21.15.19:0/1218205095 learned_addr learned my addr 172.21.15.19:0/1218205095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb28576a640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb280101830 0x7fb28019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb284f69640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb280102150 0x7fb28019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 -- 172.21.15.19:0/1218205095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb280101830 msgr2=0x7fb28019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb280101830 0x7fb28019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 -- 172.21.15.19:0/1218205095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb280102150 msgr2=0x7fb28019b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb280102150 0x7fb28019b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 -- 172.21.15.19:0/1218205095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2801a14c0 con 0x7fb28010f3e0 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb284f69640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb280102150 0x7fb28019b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.741+0000 7fb285f6b640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801a0cf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb278004770 tx=0x7fb278004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.742+0000 7fb27e7fc640 1 -- 172.21.15.19:0/1218205095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27803f030 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.742+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2801a1750 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.742+0000 7fb27e7fc640 1 -- 172.21.15.19:0/1218205095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb278003aa0 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.742+0000 7fb27e7fc640 1 -- 172.21.15.19:0/1218205095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb278035070 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.742+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2801a7e70 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.743+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb280101c10 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.744+0000 7fb27e7fc640 1 -- 172.21.15.19:0/1218205095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fb27803bc90 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.745+0000 7fb27e7fc640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb2680b5330 0x7fb2680b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.746+0000 7fb28576a640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb2680b5330 0x7fb2680b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.746+0000 7fb27e7fc640 1 -- 172.21.15.19:0/1218205095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7fb278106810 con 0x7fb28010f3e0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.746+0000 7fb28576a640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb2680b5330 0x7fb2680b77f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb270007ec0 tx=0x7fb2700075b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.749+0000 7fb27e7fc640 1 -- 172.21.15.19:0/1218205095 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb2780cd690 con 0x7fb28010f3e0 2024-09-11T00:00:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:36.974+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fb2801a8110 con 0x7fb28010f3e0 2024-09-11T00:00:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.277+0000 7fb27e7fc640 1 -- 172.21.15.19:0/1218205095 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fb2780ccf90 con 0x7fb28010f3e0 2024-09-11T00:00:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb2680b5330 msgr2=0x7fb2680b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb2680b5330 0x7fb2680b77f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb270007ec0 tx=0x7fb2700075b0 comp rx=0 tx=0).stop 2024-09-11T00:00:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 msgr2=0x7fb2801a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801a0cf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb278004770 tx=0x7fb278004270 comp rx=0 tx=0).stop 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 shutdown_connections 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb2680b5330 0x7fb2680b77f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28010f3e0 0x7fb2801a0cf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb280102150 0x7fb28019b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 --2- 172.21.15.19:0/1218205095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb280101830 0x7fb28019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 >> 172.21.15.19:0/1218205095 conn(0x7fb2800fd700 msgr2=0x7fb280111570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 shutdown_connections 2024-09-11T00:00:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:37.280+0000 7fb2879ce640 1 -- 172.21.15.19:0/1218205095 wait complete. 2024-09-11T00:00:37.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:37 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1218205095' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-11T00:00:37.667 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:37 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1218205095' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-11T00:00:37.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:37 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1218205095' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-11T00:00:38.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T00:00:38.270 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:38.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:38 smithi019 ceph-mon[30859]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:00:38.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:38 smithi019 ceph-mon[30859]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T00:00:38.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:38 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1218205095' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T00:00:38.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:38 smithi019 ceph-mon[30859]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T00:00:38.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:38 smithi019 ceph-mon[30859]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:38.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:38 smithi019 ceph-mon[30859]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T00:00:38.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:38 smithi019 ceph-mon[30859]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T00:00:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:38 smithi131 ceph-mon[35491]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:00:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:38 smithi131 ceph-mon[35491]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T00:00:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:38 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1218205095' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T00:00:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:38 smithi131 ceph-mon[35491]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T00:00:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:38 smithi131 ceph-mon[35491]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:38 smithi131 ceph-mon[35491]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T00:00:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:38 smithi131 ceph-mon[35491]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T00:00:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:38 smithi135 ceph-mon[35432]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:00:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:38 smithi135 ceph-mon[35432]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T00:00:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:38 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1218205095' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T00:00:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:38 smithi135 ceph-mon[35432]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T00:00:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:38 smithi135 ceph-mon[35432]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T00:00:38.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:38 smithi135 ceph-mon[35432]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T00:00:38.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:38 smithi135 ceph-mon[35432]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.756+0000 7f6eacf0a640 1 -- 172.21.15.19:0/1811968733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea81077c0 msgr2=0x7f6ea810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.756+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/1811968733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea81077c0 0x7f6ea810dfc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009ca0 tx=0x7f6ea002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.756+0000 7f6eacf0a640 1 -- 172.21.15.19:0/1811968733 shutdown_connections 2024-09-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.756+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/1811968733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea81077c0 0x7f6ea810dfc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.756+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/1811968733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ea8106e40 0x7f6ea8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.756+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/1811968733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea8101810 0x7f6ea8101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.756+0000 7f6eacf0a640 1 -- 172.21.15.19:0/1811968733 >> 172.21.15.19:0/1811968733 conn(0x7f6ea8076f50 msgr2=0x7f6ea8077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.757+0000 7f6eacf0a640 1 -- 172.21.15.19:0/1811968733 shutdown_connections 2024-09-11T00:00:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.757+0000 7f6eacf0a640 1 -- 172.21.15.19:0/1811968733 wait complete. 2024-09-11T00:00:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.757+0000 7f6eacf0a640 1 Processor -- start 2024-09-11T00:00:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.757+0000 7f6eacf0a640 1 -- start start 2024-09-11T00:00:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6eacf0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea8101810 0x7f6ea8103d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6eacf0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea8106e40 0x7f6ea8104260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6eacf0a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ea81077c0 0x7f6ea81047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6eacf0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea8110bd0 con 0x7f6ea8106e40 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6eacf0a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea8110a50 con 0x7f6ea81077c0 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6eacf0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea8110d50 con 0x7f6ea8101810 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea8106e40 0x7f6ea8104260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea8106e40 0x7f6ea8104260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45850/0 (socket says 172.21.15.19:45850) 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 -- 172.21.15.19:0/3757533559 learned_addr learned my addr 172.21.15.19:0/3757533559 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea6d9d640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ea81077c0 0x7f6ea81047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea659c640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea8101810 0x7f6ea8103d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 -- 172.21.15.19:0/3757533559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea8101810 msgr2=0x7f6ea8103d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea8101810 0x7f6ea8103d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 -- 172.21.15.19:0/3757533559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ea81077c0 msgr2=0x7f6ea81047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ea81077c0 0x7f6ea81047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 -- 172.21.15.19:0/3757533559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea81a7680 con 0x7f6ea8106e40 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6ea5d9b640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea8106e40 0x7f6ea8104260 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00ea20 tx=0x7f6e9c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6e977fe640 1 -- 172.21.15.19:0/3757533559 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00cd40 con 0x7f6ea8106e40 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea81a7970 con 0x7f6ea8106e40 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6e977fe640 1 -- 172.21.15.19:0/3757533559 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e9c0168c0 con 0x7f6ea8106e40 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.758+0000 7f6e977fe640 1 -- 172.21.15.19:0/3757533559 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00b840 con 0x7f6ea8106e40 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.759+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea81a7f00 con 0x7f6ea8106e40 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.760+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea8101bf0 con 0x7f6ea8106e40 2024-09-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.761+0000 7f6e977fe640 1 -- 172.21.15.19:0/3757533559 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f6e9c00b040 con 0x7f6ea8106e40 2024-09-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.762+0000 7f6e977fe640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6e900b5330 0x7f6e900b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.762+0000 7f6ea659c640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6e900b5330 0x7f6e900b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.762+0000 7f6e977fe640 1 -- 172.21.15.19:0/3757533559 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7f6e9c0e5bf0 con 0x7f6ea8106e40 2024-09-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.762+0000 7f6ea659c640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6e900b5330 0x7f6e900b77f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800bbe0 tx=0x7f6e9800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:38.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.765+0000 7f6e977fe640 1 -- 172.21.15.19:0/3757533559 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6e9c0ac420 con 0x7f6ea8106e40 2024-09-11T00:00:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:38.989+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f6ea8105020 con 0x7f6ea8106e40 2024-09-11T00:00:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.295+0000 7f6e977fe640 1 -- 172.21.15.19:0/3757533559 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f6e9c0b0e50 con 0x7f6ea8106e40 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6e900b5330 msgr2=0x7f6e900b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6e900b5330 0x7f6e900b77f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800bbe0 tx=0x7f6e9800b390 comp rx=0 tx=0).stop 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea8106e40 msgr2=0x7f6ea8104260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea8106e40 0x7f6ea8104260 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00ea20 tx=0x7f6e9c00eee0 comp rx=0 tx=0).stop 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 shutdown_connections 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ea81077c0 0x7f6ea81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6e900b5330 0x7f6e900b77f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea8106e40 0x7f6ea8104260 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 --2- 172.21.15.19:0/3757533559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea8101810 0x7f6ea8103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 >> 172.21.15.19:0/3757533559 conn(0x7f6ea8076f50 msgr2=0x7f6ea8105f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 shutdown_connections 2024-09-11T00:00:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:39.297+0000 7f6eacf0a640 1 -- 172.21.15.19:0/3757533559 wait complete. 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] up:active 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: Cluster is now healthy 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: pgmap v267: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2024-09-11T00:00:39.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:39 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3757533559' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T00:00:39.651 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] up:active 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: Cluster is now healthy 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: pgmap v267: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2024-09-11T00:00:39.652 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:39 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3757533559' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T00:00:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] up:active 2024-09-11T00:00:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T00:00:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T00:00:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: Cluster is now healthy 2024-09-11T00:00:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T00:00:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T00:00:39.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T00:00:39.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: pgmap v267: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2024-09-11T00:00:39.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:39 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3757533559' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T00:00:40.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T00:00:40.260 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:40 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3757533559' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T00:00:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:40 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] up:active 2024-09-11T00:00:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:40 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T00:00:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:40 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:00:40.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:40 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3757533559' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T00:00:40.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:40 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] up:active 2024-09-11T00:00:40.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:40 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T00:00:40.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:40 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:00:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:40 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3757533559' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T00:00:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:40 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] up:active 2024-09-11T00:00:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:40 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T00:00:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:40 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 -- 172.21.15.19:0/1738438207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 msgr2=0x7fc8901020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 --2- 172.21.15.19:0/1738438207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8901020b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc880009900 tx=0x7fc88002a410 comp rx=0 tx=0).stop 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 -- 172.21.15.19:0/1738438207 shutdown_connections 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 --2- 172.21.15.19:0/1738438207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc890108060 0x7fc89010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 --2- 172.21.15.19:0/1738438207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8901076e0 0x7fc890107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 --2- 172.21.15.19:0/1738438207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8901020b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 -- 172.21.15.19:0/1738438207 >> 172.21.15.19:0/1738438207 conn(0x7fc8900fd700 msgr2=0x7fc8900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 -- 172.21.15.19:0/1738438207 shutdown_connections 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.757+0000 7fc8948d8640 1 -- 172.21.15.19:0/1738438207 wait complete. 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 Processor -- start 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 -- start start 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8900fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8901076e0 0x7fc8900fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc890108060 0x7fc8900fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc890111d20 con 0x7fc890101cd0 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc890111ba0 con 0x7fc8901076e0 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc8948d8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc890111ea0 con 0x7fc890108060 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc88e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8900fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc88e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8900fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45862/0 (socket says 172.21.15.19:45862) 2024-09-11T00:00:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.758+0000 7fc88e59c640 1 -- 172.21.15.19:0/2538993627 learned_addr learned my addr 172.21.15.19:0/2538993627 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc887fff640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8901076e0 0x7fc8900fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc88e59c640 1 -- 172.21.15.19:0/2538993627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc890108060 msgr2=0x7fc8900fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc88e59c640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc890108060 0x7fc8900fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc88e59c640 1 -- 172.21.15.19:0/2538993627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8901076e0 msgr2=0x7fc8900fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc88e59c640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8901076e0 0x7fc8900fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc88e59c640 1 -- 172.21.15.19:0/2538993627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8901a76a0 con 0x7fc890101cd0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc88e59c640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8900fdc00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc880006010 tx=0x7fc8800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc8877fe640 1 -- 172.21.15.19:0/2538993627 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88003f030 con 0x7fc890101cd0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8901a7930 con 0x7fc890101cd0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc8877fe640 1 -- 172.21.15.19:0/2538993627 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc880003800 con 0x7fc890101cd0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc8877fe640 1 -- 172.21.15.19:0/2538993627 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880035070 con 0x7fc890101cd0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.759+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8901a7ee0 con 0x7fc890101cd0 2024-09-11T00:00:40.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.760+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8901020b0 con 0x7fc890101cd0 2024-09-11T00:00:40.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.761+0000 7fc8877fe640 1 -- 172.21.15.19:0/2538993627 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc880031b10 con 0x7fc890101cd0 2024-09-11T00:00:40.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.762+0000 7fc8877fe640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc87c0b5330 0x7fc87c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:40.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.762+0000 7fc887fff640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc87c0b5330 0x7fc87c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:40.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.762+0000 7fc8877fe640 1 -- 172.21.15.19:0/2538993627 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7fc880106650 con 0x7fc890101cd0 2024-09-11T00:00:40.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.763+0000 7fc887fff640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc87c0b5330 0x7fc87c0b77f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc8900ff6f0 tx=0x7fc878008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:40.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.766+0000 7fc8877fe640 1 -- 172.21.15.19:0/2538993627 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc8800cd530 con 0x7fc890101cd0 2024-09-11T00:00:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:40.992+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc8901a8270 con 0x7fc890101cd0 2024-09-11T00:00:41.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.302+0000 7fc8877fe640 1 -- 172.21.15.19:0/2538993627 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fc8800cce30 con 0x7fc890101cd0 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc87c0b5330 msgr2=0x7fc87c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc87c0b5330 0x7fc87c0b77f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc8900ff6f0 tx=0x7fc878008040 comp rx=0 tx=0).stop 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 msgr2=0x7fc8900fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8900fdc00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc880006010 tx=0x7fc8800042f0 comp rx=0 tx=0).stop 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 shutdown_connections 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc890108060 0x7fc8900fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8901076e0 0x7fc8900fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc87c0b5330 0x7fc87c0b77f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 --2- 172.21.15.19:0/2538993627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc890101cd0 0x7fc8900fdc00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 >> 172.21.15.19:0/2538993627 conn(0x7fc8900fd700 msgr2=0x7fc89006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.305+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 shutdown_connections 2024-09-11T00:00:41.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:41.306+0000 7fc8948d8640 1 -- 172.21.15.19:0/2538993627 wait complete. 2024-09-11T00:00:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:41 smithi131 ceph-mon[35491]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 90 B/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-11T00:00:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:41 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2538993627' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T00:00:41.670 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:41 smithi019 ceph-mon[30859]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 90 B/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-11T00:00:41.670 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:41 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2538993627' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T00:00:41.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:41 smithi135 ceph-mon[35432]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 90 B/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-11T00:00:41.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:41 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2538993627' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T00:00:42.133 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-11T00:00:42.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T00:00:42.399 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:42.521 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:42 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2538993627' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T00:00:42.521 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:42 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:00:42.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:42 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2538993627' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T00:00:42.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:42 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:00:42.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:42 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2538993627' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T00:00:42.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:42 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:00:42.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 -- 172.21.15.19:0/17425108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 msgr2=0x7f730c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:42.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 --2- 172.21.15.19:0/17425108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c1031a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7308009900 tx=0x7f730802a410 comp rx=0 tx=0).stop 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 -- 172.21.15.19:0/17425108 shutdown_connections 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 --2- 172.21.15.19:0/17425108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f730c109150 0x7f730c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 --2- 172.21.15.19:0/17425108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f730c1087d0 0x7f730c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 --2- 172.21.15.19:0/17425108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c1031a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 -- 172.21.15.19:0/17425108 >> 172.21.15.19:0/17425108 conn(0x7f730c0fe830 msgr2=0x7f730c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.902+0000 7f7313b0a640 1 -- 172.21.15.19:0/17425108 shutdown_connections 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 -- 172.21.15.19:0/17425108 wait complete. 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 Processor -- start 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 -- start start 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f730c1087d0 0x7f730c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:42.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f730c109150 0x7f730c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112e60 con 0x7f730c102dc0 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112ce0 con 0x7f730c1087d0 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f7313b0a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112fe0 con 0x7f730c109150 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.903+0000 7f73118a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57230/0 (socket says 172.21.15.19:57230) 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 -- 172.21.15.19:0/3840924893 learned_addr learned my addr 172.21.15.19:0/3840924893 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73110a5640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f730c1087d0 0x7f730c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 -- 172.21.15.19:0/3840924893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f730c109150 msgr2=0x7f730c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73120a7640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f730c109150 0x7f730c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f730c109150 0x7f730c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 -- 172.21.15.19:0/3840924893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f730c1087d0 msgr2=0x7f730c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f730c1087d0 0x7f730c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:42.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 -- 172.21.15.19:0/3840924893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1a77b0 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73110a5640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f730c1087d0 0x7f730c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f73118a6640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c0754a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7308005ab0 tx=0x7f7308003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f7302ffd640 1 -- 172.21.15.19:0/3840924893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730803f070 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c1a7a40 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f7302ffd640 1 -- 172.21.15.19:0/3840924893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7308031d60 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f7302ffd640 1 -- 172.21.15.19:0/3840924893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308035030 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.904+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a7f20 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.905+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c1031a0 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.907+0000 7f7302ffd640 1 -- 172.21.15.19:0/3840924893 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f730803b560 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.907+0000 7f7302ffd640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72f80b5330 0x7f72f80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.908+0000 7f73110a5640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72f80b5330 0x7f72f80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.908+0000 7f7302ffd640 1 -- 172.21.15.19:0/3840924893 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7f7308106ea0 con 0x7f730c102dc0 2024-09-11T00:00:42.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.908+0000 7f73110a5640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72f80b5330 0x7f72f80b77f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f730c076f90 tx=0x7f72fc005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:42.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:42.911+0000 7f7302ffd640 1 -- 172.21.15.19:0/3840924893 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f73080cdd80 con 0x7f730c102dc0 2024-09-11T00:00:43.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.124+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f730c063590 con 0x7f72f80b5330 2024-09-11T00:00:43.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.149+0000 7f7302ffd640 1 -- 172.21.15.19:0/3840924893 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f730c063590 con 0x7f72f80b5330 2024-09-11T00:00:43.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72f80b5330 msgr2=0x7f72f80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:43.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72f80b5330 0x7f72f80b77f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f730c076f90 tx=0x7f72fc005e50 comp rx=0 tx=0).stop 2024-09-11T00:00:43.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 msgr2=0x7f730c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:43.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c0754a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7308005ab0 tx=0x7f7308003cd0 comp rx=0 tx=0).stop 2024-09-11T00:00:43.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 shutdown_connections 2024-09-11T00:00:43.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f730c109150 0x7f730c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:43.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f730c1087d0 0x7f730c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:43.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72f80b5330 0x7f72f80b77f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:43.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 --2- 172.21.15.19:0/3840924893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f730c102dc0 0x7f730c0754a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:43.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 >> 172.21.15.19:0/3840924893 conn(0x7f730c0fe830 msgr2=0x7f730c0ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:43.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 shutdown_connections 2024-09-11T00:00:43.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:43.152+0000 7f7313b0a640 1 -- 172.21.15.19:0/3840924893 wait complete. 2024-09-11T00:00:43.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:43 smithi019 ceph-mon[30859]: pgmap v269: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-11T00:00:43.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:43 smithi019 ceph-mon[30859]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:43.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:00:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:00:43.130+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:00:43.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:00:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:00:43.130+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:00:43.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:00:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:00:43.130+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:00:43.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:00:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:00:43.130+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:00:43.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:00:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:00:43.130+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:00:43.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:43 smithi135 ceph-mon[35432]: pgmap v269: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-11T00:00:43.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:43 smithi135 ceph-mon[35432]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:43.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:43 smithi131 ceph-mon[35491]: pgmap v269: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-11T00:00:43.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:43 smithi131 ceph-mon[35491]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:43.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T00:00:44.230 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:44.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.714+0000 7f72e83cb640 1 -- 172.21.15.19:0/1128438590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 msgr2=0x7f72e01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:44.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.714+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1128438590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01020b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009900 tx=0x7f72dc02a410 comp rx=0 tx=0).stop 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 -- 172.21.15.19:0/1128438590 shutdown_connections 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1128438590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e0108060 0x7f72e010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1128438590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72e01076e0 0x7f72e0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1128438590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01020b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 -- 172.21.15.19:0/1128438590 >> 172.21.15.19:0/1128438590 conn(0x7f72e00fd700 msgr2=0x7f72e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 -- 172.21.15.19:0/1128438590 shutdown_connections 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 -- 172.21.15.19:0/1128438590 wait complete. 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 Processor -- start 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.715+0000 7f72e83cb640 1 -- start start 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e83cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e83cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e01076e0 0x7f72e0198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e83cb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72e0108060 0x7f72e019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:44.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e83cb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0111d20 con 0x7f72e0101cd0 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e83cb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0111ba0 con 0x7f72e0108060 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e83cb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0111ea0 con 0x7f72e01076e0 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57264/0 (socket says 172.21.15.19:57264) 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 -- 172.21.15.19:0/1757083542 learned_addr learned my addr 172.21.15.19:0/1757083542 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6968640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72e0108060 0x7f72e019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e5966640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e01076e0 0x7f72e0198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 -- 172.21.15.19:0/1757083542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e01076e0 msgr2=0x7f72e0198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e01076e0 0x7f72e0198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 -- 172.21.15.19:0/1757083542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72e0108060 msgr2=0x7f72e019dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:44.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72e0108060 0x7f72e019dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 -- 172.21.15.19:0/1757083542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e019e2a0 con 0x7f72e0101cd0 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6968640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72e0108060 0x7f72e019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e6167640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01981f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005940 tx=0x7f72dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72d77fe640 1 -- 172.21.15.19:0/1757083542 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc03f030 con 0x7f72e0101cd0 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72d77fe640 1 -- 172.21.15.19:0/1757083542 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72dc003cb0 con 0x7f72e0101cd0 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e019e530 con 0x7f72e0101cd0 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.716+0000 7f72d77fe640 1 -- 172.21.15.19:0/1757083542 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc035070 con 0x7f72e0101cd0 2024-09-11T00:00:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.717+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e01a4c50 con 0x7f72e0101cd0 2024-09-11T00:00:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.718+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e01020b0 con 0x7f72e0101cd0 2024-09-11T00:00:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.720+0000 7f72d77fe640 1 -- 172.21.15.19:0/1757083542 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f72dc03bbf0 con 0x7f72e0101cd0 2024-09-11T00:00:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.720+0000 7f72d77fe640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72cc0b5440 0x7f72cc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.721+0000 7f72e5966640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72cc0b5440 0x7f72cc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.721+0000 7f72d77fe640 1 -- 172.21.15.19:0/1757083542 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7f72dc106c20 con 0x7f72e0101cd0 2024-09-11T00:00:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.721+0000 7f72e5966640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72cc0b5440 0x7f72cc0b7900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f72e0107500 tx=0x7f72d0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:44.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.724+0000 7f72d77fe640 1 -- 172.21.15.19:0/1757083542 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f72dc0cd9a0 con 0x7f72e0101cd0 2024-09-11T00:00:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.938+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f72e0063590 con 0x7f72cc0b5440 2024-09-11T00:00:44.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.963+0000 7f72d77fe640 1 -- 172.21.15.19:0/1757083542 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f72e0063590 con 0x7f72cc0b5440 2024-09-11T00:00:44.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72cc0b5440 msgr2=0x7f72cc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72cc0b5440 0x7f72cc0b7900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f72e0107500 tx=0x7f72d0008040 comp rx=0 tx=0).stop 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 msgr2=0x7f72e01981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01981f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005940 tx=0x7f72dc0042f0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 shutdown_connections 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72e0108060 0x7f72e019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e01076e0 0x7f72e0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72cc0b5440 0x7f72cc0b7900 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 --2- 172.21.15.19:0/1757083542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72e0101cd0 0x7f72e01981f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 >> 172.21.15.19:0/1757083542 conn(0x7f72e00fd700 msgr2=0x7f72e00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 shutdown_connections 2024-09-11T00:00:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:44.965+0000 7f72e83cb640 1 -- 172.21.15.19:0/1757083542 wait complete. 2024-09-11T00:00:45.760 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:45 smithi019 ceph-mon[30859]: pgmap v270: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-11T00:00:45.760 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:45 smithi019 ceph-mon[30859]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-11T00:00:45.761 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:45 smithi019 ceph-mon[30859]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:45.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T00:00:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:45 smithi135 ceph-mon[35432]: pgmap v270: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-11T00:00:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:45 smithi135 ceph-mon[35432]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-11T00:00:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:45 smithi135 ceph-mon[35432]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:46.046 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:45 smithi131 ceph-mon[35491]: pgmap v270: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-11T00:00:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:45 smithi131 ceph-mon[35491]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-11T00:00:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:45 smithi131 ceph-mon[35491]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 -- 172.21.15.19:0/688346262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d81087d0 msgr2=0x7f80d8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 --2- 172.21.15.19:0/688346262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d81087d0 0x7f80d8108c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009900 tx=0x7f80c802a410 comp rx=0 tx=0).stop 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 -- 172.21.15.19:0/688346262 shutdown_connections 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 --2- 172.21.15.19:0/688346262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d8109150 0x7f80d810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 --2- 172.21.15.19:0/688346262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d81087d0 0x7f80d8108c10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 --2- 172.21.15.19:0/688346262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8102dc0 0x7f80d81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 -- 172.21.15.19:0/688346262 >> 172.21.15.19:0/688346262 conn(0x7f80d80fe830 msgr2=0x7f80d8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 -- 172.21.15.19:0/688346262 shutdown_connections 2024-09-11T00:00:46.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.544+0000 7f80df508640 1 -- 172.21.15.19:0/688346262 wait complete. 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.545+0000 7f80df508640 1 Processor -- start 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.545+0000 7f80df508640 1 -- start start 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80df508640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8102dc0 0x7f80d8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80df508640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d81087d0 0x7f80d81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80df508640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d8109150 0x7f80d819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80df508640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f80d8112e10 con 0x7f80d8109150 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80df508640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f80d8112c90 con 0x7f80d81087d0 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80df508640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80d8112f90 con 0x7f80d8102dc0 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d8109150 0x7f80d819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d8109150 0x7f80d819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57282/0 (socket says 172.21.15.19:57282) 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 -- 172.21.15.19:0/697183657 learned_addr learned my addr 172.21.15.19:0/697183657 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80dd2a4640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8102dc0 0x7f80d8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80dcaa3640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d81087d0 0x7f80d81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 -- 172.21.15.19:0/697183657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8102dc0 msgr2=0x7f80d8199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8102dc0 0x7f80d8199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 -- 172.21.15.19:0/697183657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d81087d0 msgr2=0x7f80d81997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d81087d0 0x7f80d81997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 -- 172.21.15.19:0/697183657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d819f330 con 0x7f80d8109150 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80dcaa3640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d81087d0 0x7f80d81997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ddaa5640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d8109150 0x7f80d819eb60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f80d000cce0 tx=0x7f80d000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ce7fc640 1 -- 172.21.15.19:0/697183657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d000f450 con 0x7f80d8109150 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ce7fc640 1 -- 172.21.15.19:0/697183657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d000faa0 con 0x7f80d8109150 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80ce7fc640 1 -- 172.21.15.19:0/697183657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0018a80 con 0x7f80d8109150 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.546+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d819f620 con 0x7f80d8109150 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.547+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d81a5d60 con 0x7f80d8109150 2024-09-11T00:00:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.548+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d81031a0 con 0x7f80d8109150 2024-09-11T00:00:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.549+0000 7f80ce7fc640 1 -- 172.21.15.19:0/697183657 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f80d0020030 con 0x7f80d8109150 2024-09-11T00:00:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.550+0000 7f80ce7fc640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c40b5440 0x7f80c40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.550+0000 7f80dd2a4640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c40b5440 0x7f80c40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.550+0000 7f80ce7fc640 1 -- 172.21.15.19:0/697183657 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7f80d00e5ea0 con 0x7f80d8109150 2024-09-11T00:00:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.550+0000 7f80dd2a4640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c40b5440 0x7f80c40b7900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009990 tx=0x7f80d4009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.554+0000 7f80ce7fc640 1 -- 172.21.15.19:0/697183657 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80d0014030 con 0x7f80d8109150 2024-09-11T00:00:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.772+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f80d8063590 con 0x7f80c40b5440 2024-09-11T00:00:46.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.777+0000 7f80ce7fc640 1 -- 172.21.15.19:0/697183657 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f80d8063590 con 0x7f80c40b5440 2024-09-11T00:00:46.778 INFO:teuthology.orchestra.run.smithi019.stdout:/volumes/qa/sv_0/1a5ea954-cee5-40ef-8ce2-c3b0dae03e9f 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c40b5440 msgr2=0x7f80c40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c40b5440 0x7f80c40b7900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009990 tx=0x7f80d4009110 comp rx=0 tx=0).stop 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d8109150 msgr2=0x7f80d819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d8109150 0x7f80d819eb60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f80d000cce0 tx=0x7f80d000a620 comp rx=0 tx=0).stop 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 shutdown_connections 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80c40b5440 0x7f80c40b7900 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80d8109150 0x7f80d819eb60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80d81087d0 0x7f80d81997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 --2- 172.21.15.19:0/697183657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8102dc0 0x7f80d8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.779+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 >> 172.21.15.19:0/697183657 conn(0x7f80d80fe830 msgr2=0x7f80d8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:46.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.780+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 shutdown_connections 2024-09-11T00:00:46.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:46.780+0000 7f80df508640 1 -- 172.21.15.19:0/697183657 wait complete. 2024-09-11T00:00:47.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T00:00:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:47.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:47 smithi019 ceph-mon[30859]: pgmap v271: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-11T00:00:47.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:47 smithi019 ceph-mon[30859]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:47 smithi135 ceph-mon[35432]: pgmap v271: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-11T00:00:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:47 smithi135 ceph-mon[35432]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:47 smithi131 ceph-mon[35491]: pgmap v271: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-11T00:00:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:47 smithi131 ceph-mon[35491]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.192+0000 7f3ea30d4640 1 -- 172.21.15.19:0/1141701228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 msgr2=0x7f3e9c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.192+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/1141701228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c1031a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009900 tx=0x7f3e8c02a410 comp rx=0 tx=0).stop 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.192+0000 7f3ea30d4640 1 -- 172.21.15.19:0/1141701228 shutdown_connections 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/1141701228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e9c109150 0x7f3e9c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/1141701228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1087d0 0x7f3e9c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/1141701228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c1031a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 -- 172.21.15.19:0/1141701228 >> 172.21.15.19:0/1141701228 conn(0x7f3e9c0fe830 msgr2=0x7f3e9c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 -- 172.21.15.19:0/1141701228 shutdown_connections 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 -- 172.21.15.19:0/1141701228 wait complete. 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 Processor -- start 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 -- start start 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1087d0 0x7f3e9c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e9c109150 0x7f3e9c19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c112e10 con 0x7f3e9c102dc0 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c112c90 con 0x7f3e9c109150 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.193+0000 7f3ea30d4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c112f90 con 0x7f3e9c1087d0 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57292/0 (socket says 172.21.15.19:57292) 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 -- 172.21.15.19:0/881619147 learned_addr learned my addr 172.21.15.19:0/881619147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea1671640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e9c109150 0x7f3e9c19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3e9bfff640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1087d0 0x7f3e9c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 -- 172.21.15.19:0/881619147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1087d0 msgr2=0x7f3e9c1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1087d0 0x7f3e9c1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 -- 172.21.15.19:0/881619147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e9c109150 msgr2=0x7f3e9c19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e9c109150 0x7f3e9c19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 -- 172.21.15.19:0/881619147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c19f410 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea1671640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e9c109150 0x7f3e9c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea0e70640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c199360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c006010 tx=0x7f3e8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3e99ffb640 1 -- 172.21.15.19:0/881619147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c03f030 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3e99ffb640 1 -- 172.21.15.19:0/881619147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e8c003800 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c19f6a0 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.194+0000 7f3e99ffb640 1 -- 172.21.15.19:0/881619147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c035070 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.195+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1a5dc0 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.196+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c1031a0 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.197+0000 7f3e99ffb640 1 -- 172.21.15.19:0/881619147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f3e8c031b10 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.198+0000 7f3e99ffb640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e840b5440 0x7f3e840b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.198+0000 7f3e9bfff640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e840b5440 0x7f3e840b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.198+0000 7f3e99ffb640 1 -- 172.21.15.19:0/881619147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7f3e8c106a20 con 0x7f3e9c102dc0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.199+0000 7f3e9bfff640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e840b5440 0x7f3e840b7900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005fd0 tx=0x7f3e90005e20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.201+0000 7f3e99ffb640 1 -- 172.21.15.19:0/881619147 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e8c0cd740 con 0x7f3e9c102dc0 2024-09-11T00:00:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.414+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3e9c063590 con 0x7f3e840b5440 2024-09-11T00:00:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.441+0000 7f3e99ffb640 1 -- 172.21.15.19:0/881619147 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3e9c063590 con 0x7f3e840b5440 2024-09-11T00:00:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e840b5440 msgr2=0x7f3e840b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e840b5440 0x7f3e840b7900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005fd0 tx=0x7f3e90005e20 comp rx=0 tx=0).stop 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 msgr2=0x7f3e9c199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c199360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c006010 tx=0x7f3e8c0042f0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 shutdown_connections 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e9c109150 0x7f3e9c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1087d0 0x7f3e9c1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e840b5440 0x7f3e840b7900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 --2- 172.21.15.19:0/881619147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e9c102dc0 0x7f3e9c199360 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 >> 172.21.15.19:0/881619147 conn(0x7f3e9c0fe830 msgr2=0x7f3e9c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 shutdown_connections 2024-09-11T00:00:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:48.443+0000 7f3ea30d4640 1 -- 172.21.15.19:0/881619147 wait complete. 2024-09-11T00:00:49.327 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T00:00:49.590 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:49.854 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:49 smithi019 ceph-mon[30859]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:49.854 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:49 smithi019 ceph-mon[30859]: pgmap v272: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T00:00:49.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:49 smithi135 ceph-mon[35432]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:49.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:49 smithi135 ceph-mon[35432]: pgmap v272: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T00:00:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:49 smithi131 ceph-mon[35491]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:49 smithi131 ceph-mon[35491]: pgmap v272: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T00:00:50.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.058+0000 7f8559251640 1 -- 172.21.15.19:0/3316779243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554108060 msgr2=0x7f855410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:50.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.058+0000 7f8559251640 1 --2- 172.21.15.19:0/3316779243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554108060 0x7f855410e860 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f854c009ca0 tx=0x7f854c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 -- 172.21.15.19:0/3316779243 shutdown_connections 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 --2- 172.21.15.19:0/3316779243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554108060 0x7f855410e860 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 --2- 172.21.15.19:0/3316779243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85541076e0 0x7f8554107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 --2- 172.21.15.19:0/3316779243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8554101cd0 0x7f85541020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 -- 172.21.15.19:0/3316779243 >> 172.21.15.19:0/3316779243 conn(0x7f85540fd700 msgr2=0x7f85540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 -- 172.21.15.19:0/3316779243 shutdown_connections 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 -- 172.21.15.19:0/3316779243 wait complete. 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 Processor -- start 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.059+0000 7f8559251640 1 -- start start 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8559251640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554101cd0 0x7f85540fde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8559251640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85541076e0 0x7f85540fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8559251640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8554108060 0x7f85540fe900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8559251640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8554111ce0 con 0x7f8554101cd0 2024-09-11T00:00:50.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8559251640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8554111b60 con 0x7f8554108060 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8559251640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8554111e60 con 0x7f85541076e0 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554101cd0 0x7f85540fde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554101cd0 0x7f85540fde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57306/0 (socket says 172.21.15.19:57306) 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 -- 172.21.15.19:0/1719778342 learned_addr learned my addr 172.21.15.19:0/1719778342 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f854bfff640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85541076e0 0x7f85540fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f855359e640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8554108060 0x7f85540fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 -- 172.21.15.19:0/1719778342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85541076e0 msgr2=0x7f85540fe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85541076e0 0x7f85540fe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 -- 172.21.15.19:0/1719778342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8554108060 msgr2=0x7f85540fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8554108060 0x7f85540fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 -- 172.21.15.19:0/1719778342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85541a7670 con 0x7f8554101cd0 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8552d9d640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554101cd0 0x7f85540fde80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f854400d950 tx=0x7f854400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8550d99640 1 -- 172.21.15.19:0/1719778342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544017070 con 0x7f8554101cd0 2024-09-11T00:00:50.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8550d99640 1 -- 172.21.15.19:0/1719778342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8544009c30 con 0x7f8554101cd0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85541a7960 con 0x7f8554101cd0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.060+0000 7f8550d99640 1 -- 172.21.15.19:0/1719778342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854400f620 con 0x7f8554101cd0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.061+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85541a7ea0 con 0x7f8554101cd0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.062+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85541020b0 con 0x7f8554101cd0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.063+0000 7f8550d99640 1 -- 172.21.15.19:0/1719778342 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f8544010460 con 0x7f8554101cd0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.064+0000 7f8550d99640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85400b53c0 0x7f85400b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.064+0000 7f854bfff640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85400b53c0 0x7f85400b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.064+0000 7f8550d99640 1 -- 172.21.15.19:0/1719778342 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7f85440e59e0 con 0x7f8554101cd0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.064+0000 7f854bfff640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85400b53c0 0x7f85400b7880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85540ff970 tx=0x7f853c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:50.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.067+0000 7f8550d99640 1 -- 172.21.15.19:0/1719778342 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85440ac760 con 0x7f8554101cd0 2024-09-11T00:00:50.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.282+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f8554063590 con 0x7f85400b53c0 2024-09-11T00:00:50.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.287+0000 7f8550d99640 1 -- 172.21.15.19:0/1719778342 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8554063590 con 0x7f85400b53c0 2024-09-11T00:00:50.288 INFO:teuthology.orchestra.run.smithi019.stdout:/volumes/qa/sv_1/1ebe79f0-92c6-4491-8575-597db5c1194b 2024-09-11T00:00:50.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85400b53c0 msgr2=0x7f85400b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85400b53c0 0x7f85400b7880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85540ff970 tx=0x7f853c00a2d0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554101cd0 msgr2=0x7f85540fde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554101cd0 0x7f85540fde80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f854400d950 tx=0x7f854400de10 comp rx=0 tx=0).stop 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 shutdown_connections 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8554108060 0x7f85540fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85541076e0 0x7f85540fe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85400b53c0 0x7f85400b7880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 --2- 172.21.15.19:0/1719778342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8554101cd0 0x7f85540fde80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 >> 172.21.15.19:0/1719778342 conn(0x7f85540fd700 msgr2=0x7f855406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 shutdown_connections 2024-09-11T00:00:50.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:50.289+0000 7f8559251640 1 -- 172.21.15.19:0/1719778342 wait complete. 2024-09-11T00:00:51.003 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:51.265 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:51.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:51 smithi019 ceph-mon[30859]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:51.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:51 smithi019 ceph-mon[30859]: pgmap v273: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-11T00:00:51.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 -- 172.21.15.19:0/1628969192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 msgr2=0x7fd7841031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1628969192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd7841031a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd774009ca0 tx=0x7fd77402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 -- 172.21.15.19:0/1628969192 shutdown_connections 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1628969192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd784109150 0x7fd78410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1628969192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7841087d0 0x7fd784108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1628969192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd7841031a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 -- 172.21.15.19:0/1628969192 >> 172.21.15.19:0/1628969192 conn(0x7fd7840fe830 msgr2=0x7fd784100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 -- 172.21.15.19:0/1628969192 shutdown_connections 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 -- 172.21.15.19:0/1628969192 wait complete. 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 Processor -- start 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.735+0000 7fd7898b7640 1 -- start start 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7898b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd784199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7898b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7841087d0 0x7fd784199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7898b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd784109150 0x7fd78419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7898b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd784112e10 con 0x7fd784102dc0 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7898b7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd784112c90 con 0x7fd7841087d0 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7898b7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd784112f90 con 0x7fd784109150 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd784199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd784199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48968/0 (socket says 172.21.15.19:48968) 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 -- 172.21.15.19:0/1311875695 learned_addr learned my addr 172.21.15.19:0/1311875695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7827fc640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7841087d0 0x7fd784199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7837fe640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd784109150 0x7fd78419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 -- 172.21.15.19:0/1311875695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd784109150 msgr2=0x7fd78419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd784109150 0x7fd78419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 -- 172.21.15.19:0/1311875695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7841087d0 msgr2=0x7fd784199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7841087d0 0x7fd784199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 -- 172.21.15.19:0/1311875695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78419f3b0 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7827fc640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7841087d0 0x7fd784199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd782ffd640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd784199300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd774006010 tx=0x7fd7740319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7888b5640 1 -- 172.21.15.19:0/1311875695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774003bf0 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.736+0000 7fd7888b5640 1 -- 172.21.15.19:0/1311875695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd774003d90 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.737+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78419f640 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.737+0000 7fd7888b5640 1 -- 172.21.15.19:0/1311875695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77402fc20 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.737+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7841a5de0 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.738+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7841031a0 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.739+0000 7fd7888b5640 1 -- 172.21.15.19:0/1311875695 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fd7740046a0 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.740+0000 7fd7888b5640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd76c0b5440 0x7fd76c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.740+0000 7fd7888b5640 1 -- 172.21.15.19:0/1311875695 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7fd7741072a0 con 0x7fd784102dc0 2024-09-11T00:00:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.740+0000 7fd7827fc640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd76c0b5440 0x7fd76c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.740+0000 7fd7827fc640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd76c0b5440 0x7fd76c0b7900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd784108270 tx=0x7fd778008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.743+0000 7fd7888b5640 1 -- 172.21.15.19:0/1311875695 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd7740ce020 con 0x7fd784102dc0 2024-09-11T00:00:51.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:51 smithi135 ceph-mon[35432]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:51.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:51 smithi135 ceph-mon[35432]: pgmap v273: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-11T00:00:51.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.967+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd78402e5c0 con 0x7fd784102dc0 2024-09-11T00:00:51.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.967+0000 7fd7888b5640 1 -- 172.21.15.19:0/1311875695 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7fd7740cd920 con 0x7fd784102dc0 2024-09-11T00:00:51.969 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:51.969 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-11T00:00:41:297551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:00:40.994067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:00:51.969 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.969+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd76c0b5440 msgr2=0x7fd76c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.969+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd76c0b5440 0x7fd76c0b7900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd784108270 tx=0x7fd778008040 comp rx=0 tx=0).stop 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.969+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 msgr2=0x7fd784199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.969+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd784199300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd774006010 tx=0x7fd7740319f0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.969+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 shutdown_connections 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.969+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd784109150 0x7fd78419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.969+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7841087d0 0x7fd784199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.970+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd76c0b5440 0x7fd76c0b7900 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.970+0000 7fd7898b7640 1 --2- 172.21.15.19:0/1311875695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd784102dc0 0x7fd784199300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.970+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 >> 172.21.15.19:0/1311875695 conn(0x7fd7840fe830 msgr2=0x7fd784100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.970+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 shutdown_connections 2024-09-11T00:00:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:51.970+0000 7fd7898b7640 1 -- 172.21.15.19:0/1311875695 wait complete. 2024-09-11T00:00:52.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:51 smithi131 ceph-mon[35491]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:52.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:51 smithi131 ceph-mon[35491]: pgmap v273: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1311875695' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]} : dispatch 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-11T00:00:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:52 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-11T00:00:52.740 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:00:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1311875695' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-11T00:00:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-11T00:00:52.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-11T00:00:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]} : dispatch 2024-09-11T00:00:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-11T00:00:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-11T00:00:52.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:52 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-11T00:00:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:53.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1311875695' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:53.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-11T00:00:53.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-11T00:00:53.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-11T00:00:53.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]} : dispatch 2024-09-11T00:00:53.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-11T00:00:53.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-11T00:00:53.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:52 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-11T00:00:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 -- 172.21.15.19:0/2584745157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8102da0 msgr2=0x7f07e8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 --2- 172.21.15.19:0/2584745157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8102da0 0x7f07e8103180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009900 tx=0x7f07d802a410 comp rx=0 tx=0).stop 2024-09-11T00:00:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 -- 172.21.15.19:0/2584745157 shutdown_connections 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 --2- 172.21.15.19:0/2584745157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07e8109130 0x7f07e810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 --2- 172.21.15.19:0/2584745157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e81087b0 0x7f07e8108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 --2- 172.21.15.19:0/2584745157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8102da0 0x7f07e8103180 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 -- 172.21.15.19:0/2584745157 >> 172.21.15.19:0/2584745157 conn(0x7f07e80fe810 msgr2=0x7f07e8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 -- 172.21.15.19:0/2584745157 shutdown_connections 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.487+0000 7f07ed54a640 1 -- 172.21.15.19:0/2584745157 wait complete. 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 Processor -- start 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 -- start start 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e8102da0 0x7f07e81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07e81087b0 0x7f07e8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8109130 0x7f07e819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8112df0 con 0x7f07e8109130 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8112c70 con 0x7f07e81087b0 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07ed54a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8112f70 con 0x7f07e8102da0 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.488+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8109130 0x7f07e819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8109130 0x7f07e819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48988/0 (socket says 172.21.15.19:48988) 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 -- 172.21.15.19:0/3512909812 learned_addr learned my addr 172.21.15.19:0/3512909812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e6ffd640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e8102da0 0x7f07e81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07dffff640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07e81087b0 0x7f07e8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 -- 172.21.15.19:0/3512909812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e8102da0 msgr2=0x7f07e81992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e8102da0 0x7f07e81992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 -- 172.21.15.19:0/3512909812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07e81087b0 msgr2=0x7f07e8199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07e81087b0 0x7f07e8199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 -- 172.21.15.19:0/3512909812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e819f370 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e77fe640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8109130 0x7f07e819eba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f07e000cce0 tx=0x7f07e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e4ff9640 1 -- 172.21.15.19:0/3512909812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e000f450 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e4ff9640 1 -- 172.21.15.19:0/3512909812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e000faa0 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e819f660 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07e4ff9640 1 -- 172.21.15.19:0/3512909812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0018b70 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.489+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e81a5da0 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.490+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e8103180 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.492+0000 7f07e4ff9640 1 -- 172.21.15.19:0/3512909812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f07e000f5f0 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.493+0000 7f07e4ff9640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07d40b5440 0x7f07d40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.493+0000 7f07e6ffd640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07d40b5440 0x7f07d40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.493+0000 7f07e4ff9640 1 -- 172.21.15.19:0/3512909812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f07e00e65f0 con 0x7f07e8109130 2024-09-11T00:00:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.493+0000 7f07e6ffd640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07d40b5440 0x7f07d40b7900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f07d8031440 tx=0x7f07d8005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.496+0000 7f07e4ff9640 1 -- 172.21.15.19:0/3512909812 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07e0014030 con 0x7f07e8109130 2024-09-11T00:00:53.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.689+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07e819a3f0 con 0x7f07e8109130 2024-09-11T00:00:53.691 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: pgmap v274: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-11T00:00:53.691 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-11T00:00:53.691 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-11T00:00:53.691 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T00:00:53.691 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-11T00:00:53.692 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-11T00:00:53.692 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T00:00:53.692 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-11T00:00:53.692 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:53 smithi019 ceph-mon[30859]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T00:00:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.691+0000 7f07e4ff9640 1 -- 172.21.15.19:0/3512909812 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22967 (secure 0 0 0) 0x7f07e00ad3c0 con 0x7f07e8109130 2024-09-11T00:00:53.693 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:53.693 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:53.600623+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07d40b5440 msgr2=0x7f07d40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07d40b5440 0x7f07d40b7900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f07d8031440 tx=0x7f07d8005e80 comp rx=0 tx=0).stop 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8109130 msgr2=0x7f07e819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8109130 0x7f07e819eba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f07e000cce0 tx=0x7f07e000a620 comp rx=0 tx=0).stop 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 shutdown_connections 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07d40b5440 0x7f07d40b7900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07e8109130 0x7f07e819eba0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07e81087b0 0x7f07e8199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 --2- 172.21.15.19:0/3512909812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e8102da0 0x7f07e81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 >> 172.21.15.19:0/3512909812 conn(0x7f07e80fe810 msgr2=0x7f07e8100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 shutdown_connections 2024-09-11T00:00:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:53.693+0000 7f07ed54a640 1 -- 172.21.15.19:0/3512909812 wait complete. 2024-09-11T00:00:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: pgmap v274: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-11T00:00:53.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-11T00:00:53.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-11T00:00:53.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T00:00:53.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-11T00:00:53.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-11T00:00:53.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T00:00:53.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-11T00:00:53.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:53 smithi135 ceph-mon[35432]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T00:00:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: pgmap v274: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-11T00:00:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-11T00:00:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-11T00:00:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T00:00:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-11T00:00:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-11T00:00:54.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T00:00:54.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-11T00:00:54.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:53 smithi131 ceph-mon[35491]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T00:00:54.463 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T00:00:54.463 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:00:54.726 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:54 smithi019 ceph-mon[30859]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T00:00:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:54 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3512909812' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:54.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:54 smithi135 ceph-mon[35432]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T00:00:54.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:54 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3512909812' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:55.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:54 smithi131 ceph-mon[35491]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T00:00:55.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:54 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3512909812' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:00:55.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 -- 172.21.15.19:0/3229366068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c102dc0 msgr2=0x7fb33c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 --2- 172.21.15.19:0/3229366068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c102dc0 0x7fb33c1031a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009900 tx=0x7fb32c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 -- 172.21.15.19:0/3229366068 shutdown_connections 2024-09-11T00:00:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 --2- 172.21.15.19:0/3229366068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb33c109150 0x7fb33c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 --2- 172.21.15.19:0/3229366068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb33c1087d0 0x7fb33c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 --2- 172.21.15.19:0/3229366068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c102dc0 0x7fb33c1031a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 -- 172.21.15.19:0/3229366068 >> 172.21.15.19:0/3229366068 conn(0x7fb33c0fe830 msgr2=0x7fb33c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 -- 172.21.15.19:0/3229366068 shutdown_connections 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 -- 172.21.15.19:0/3229366068 wait complete. 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.179+0000 7fb342f4a640 1 Processor -- start 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb342f4a640 1 -- start start 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb342f4a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb33c102dc0 0x7fb33c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb342f4a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c1087d0 0x7fb33c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb342f4a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb33c109150 0x7fb33c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb342f4a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c112e50 con 0x7fb33c1087d0 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb342f4a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c112cd0 con 0x7fb33c109150 2024-09-11T00:00:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb342f4a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c112fd0 con 0x7fb33c102dc0 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c1087d0 0x7fb33c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c1087d0 0x7fb33c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49002/0 (socket says 172.21.15.19:49002) 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 -- 172.21.15.19:0/1687142483 learned_addr learned my addr 172.21.15.19:0/1687142483 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb340ce6640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb33c102dc0 0x7fb33c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb3414e7640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb33c109150 0x7fb33c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 -- 172.21.15.19:0/1687142483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb33c102dc0 msgr2=0x7fb33c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb33c102dc0 0x7fb33c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 -- 172.21.15.19:0/1687142483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb33c109150 msgr2=0x7fb33c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb33c109150 0x7fb33c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 -- 172.21.15.19:0/1687142483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c1a7860 con 0x7fb33c1087d0 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb3414e7640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb33c109150 0x7fb33c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.180+0000 7fb33bfff640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c1087d0 0x7fb33c0759e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb32400b4a0 tx=0x7fb32400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.181+0000 7fb339ffb640 1 -- 172.21.15.19:0/1687142483 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324014070 con 0x7fb33c1087d0 2024-09-11T00:00:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.181+0000 7fb339ffb640 1 -- 172.21.15.19:0/1687142483 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb324010ac0 con 0x7fb33c1087d0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.181+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33c1a7b50 con 0x7fb33c1087d0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.181+0000 7fb339ffb640 1 -- 172.21.15.19:0/1687142483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324017c30 con 0x7fb33c1087d0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.181+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33c1a8090 con 0x7fb33c1087d0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.182+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c103220 con 0x7fb33c1087d0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.183+0000 7fb339ffb640 1 -- 172.21.15.19:0/1687142483 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb324010610 con 0x7fb33c1087d0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.184+0000 7fb339ffb640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3280b53c0 0x7fb3280b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.184+0000 7fb340ce6640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3280b53c0 0x7fb3280b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.184+0000 7fb339ffb640 1 -- 172.21.15.19:0/1687142483 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb3240e57b0 con 0x7fb33c1087d0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.184+0000 7fb340ce6640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3280b53c0 0x7fb3280b7880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb32c031440 tx=0x7fb32c005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.188+0000 7fb339ffb640 1 -- 172.21.15.19:0/1687142483 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3240ac410 con 0x7fb33c1087d0 2024-09-11T00:00:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.369+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb33c063590 con 0x7fb3280b53c0 2024-09-11T00:00:55.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.375+0000 7fb339ffb640 1 -- 172.21.15.19:0/1687142483 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258781 (secure 0 0 0) 0x7fb33c063590 con 0x7fb3280b53c0 2024-09-11T00:00:55.566 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:55.567 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:00:55.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3280b53c0 msgr2=0x7fb3280b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3280b53c0 0x7fb3280b7880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb32c031440 tx=0x7fb32c005e80 comp rx=0 tx=0).stop 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c1087d0 msgr2=0x7fb33c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c1087d0 0x7fb33c0759e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb32400b4a0 tx=0x7fb32400b960 comp rx=0 tx=0).stop 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 shutdown_connections 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb33c109150 0x7fb33c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3280b53c0 0x7fb3280b7880 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb33c1087d0 0x7fb33c0759e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 --2- 172.21.15.19:0/1687142483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb33c102dc0 0x7fb33c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 >> 172.21.15.19:0/1687142483 conn(0x7fb33c0fe830 msgr2=0x7fb33c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 shutdown_connections 2024-09-11T00:00:55.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:55.378+0000 7fb342f4a640 1 -- 172.21.15.19:0/1687142483 wait complete. 2024-09-11T00:00:55.693 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:55 smithi019 ceph-mon[30859]: pgmap v277: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.9 KiB/s wr, 10 op/s 2024-09-11T00:00:55.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:55 smithi135 ceph-mon[35432]: pgmap v277: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.9 KiB/s wr, 10 op/s 2024-09-11T00:00:56.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:55 smithi131 ceph-mon[35491]: pgmap v277: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.9 KiB/s wr, 10 op/s 2024-09-11T00:00:56.151 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-11T00:00:54.492731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641403,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":183,"num_read_kb":172,"num_write":274,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363532,"kb_used_data":10116,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578292,"statfs":{"total":1151940427776,"available":1151568171008,"internally_reserved":0,"allocated":10358784,"data_stored":6792923,"data_compressed":116230,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45422,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":71,"num_write":25,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002296"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235684+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:00:29.235684+0000","last_peered":"2024-09-11T00:00:29.235684+0000","last_clean":"2024-09-11T00:00:29.235684+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:00:29.235684+0000","last_undegraded":"2024-09-11T00:00:29.235684+0000","last_fullsized":"2024-09-11T00:00:29.235684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.254924+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:00:29.254924+0000","last_peered":"2024-09-11T00:00:29.254924+0000","last_clean":"2024-09-11T00:00:29.254924+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:00:29.254924+0000","last_undegraded":"2024-09-11T00:00:29.254924+0000","last_fullsized":"2024-09-11T00:00:29.254924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.254687+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:00:29.254687+0000","last_peered":"2024-09-11T00:00:29.254687+0000","last_clean":"2024-09-11T00:00:29.254687+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:00:29.254687+0000","last_undegraded":"2024-09-11T00:00:29.254687+0000","last_fullsized":"2024-09-11T00:00:29.254687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606424+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:00:52.606424+0000","last_peered":"2024-09-11T00:00:52.606424+0000","last_clean":"2024-09-11T00:00:52.606424+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:00:52.606424+0000","last_undegraded":"2024-09-11T00:00:52.606424+0000","last_fullsized":"2024-09-11T00:00:52.606424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607907+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:00:53.607907+0000","last_peered":"2024-09-11T00:00:53.607907+0000","last_clean":"2024-09-11T00:00:53.607907+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:00:53.607907+0000","last_undegraded":"2024-09-11T00:00:53.607907+0000","last_fullsized":"2024-09-11T00:00:53.607907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237254+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:00:29.237254+0000","last_peered":"2024-09-11T00:00:29.237254+0000","last_clean":"2024-09-11T00:00:29.237254+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:00:29.237254+0000","last_undegraded":"2024-09-11T00:00:29.237254+0000","last_fullsized":"2024-09-11T00:00:29.237254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250411+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:00:29.250411+0000","last_peered":"2024-09-11T00:00:29.250411+0000","last_clean":"2024-09-11T00:00:29.250411+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:00:29.250411+0000","last_undegraded":"2024-09-11T00:00:29.250411+0000","last_fullsized":"2024-09-11T00:00:29.250411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251100+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:00:29.251100+0000","last_peered":"2024-09-11T00:00:29.251100+0000","last_clean":"2024-09-11T00:00:29.251100+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:00:29.251100+0000","last_undegraded":"2024-09-11T00:00:29.251100+0000","last_fullsized":"2024-09-11T00:00:29.251100+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250428+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:00:29.250428+0000","last_peered":"2024-09-11T00:00:29.250428+0000","last_clean":"2024-09-11T00:00:29.250428+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:00:29.250428+0000","last_undegraded":"2024-09-11T00:00:29.250428+0000","last_fullsized":"2024-09-11T00:00:29.250428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237705+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:00:29.237705+0000","last_peered":"2024-09-11T00:00:29.237705+0000","last_clean":"2024-09-11T00:00:29.237705+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:00:29.237705+0000","last_undegraded":"2024-09-11T00:00:29.237705+0000","last_fullsized":"2024-09-11T00:00:29.237705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251910+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:00:29.251910+0000","last_peered":"2024-09-11T00:00:29.251910+0000","last_clean":"2024-09-11T00:00:29.251910+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:00:29.251910+0000","last_undegraded":"2024-09-11T00:00:29.251910+0000","last_fullsized":"2024-09-11T00:00:29.251910+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606579+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:00:52.606579+0000","last_peered":"2024-09-11T00:00:52.606579+0000","last_clean":"2024-09-11T00:00:52.606579+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:00:52.606579+0000","last_undegraded":"2024-09-11T00:00:52.606579+0000","last_fullsized":"2024-09-11T00:00:52.606579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251218+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:00:29.251218+0000","last_peered":"2024-09-11T00:00:29.251218+0000","last_clean":"2024-09-11T00:00:29.251218+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:00:29.251218+0000","last_undegraded":"2024-09-11T00:00:29.251218+0000","last_fullsized":"2024-09-11T00:00:29.251218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.254795+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:00:29.254795+0000","last_peered":"2024-09-11T00:00:29.254795+0000","last_clean":"2024-09-11T00:00:29.254795+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:00:29.254795+0000","last_undegraded":"2024-09-11T00:00:29.254795+0000","last_fullsized":"2024-09-11T00:00:29.254795+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.255352+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:00:29.255352+0000","last_peered":"2024-09-11T00:00:29.255352+0000","last_clean":"2024-09-11T00:00:29.255352+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:00:29.255352+0000","last_undegraded":"2024-09-11T00:00:29.255352+0000","last_fullsized":"2024-09-11T00:00:29.255352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.249826+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:00:29.249826+0000","last_peered":"2024-09-11T00:00:29.249826+0000","last_clean":"2024-09-11T00:00:29.249826+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:00:29.249826+0000","last_undegraded":"2024-09-11T00:00:29.249826+0000","last_fullsized":"2024-09-11T00:00:29.249826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235804+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:00:29.235804+0000","last_peered":"2024-09-11T00:00:29.235804+0000","last_clean":"2024-09-11T00:00:29.235804+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:00:29.235804+0000","last_undegraded":"2024-09-11T00:00:29.235804+0000","last_fullsized":"2024-09-11T00:00:29.235804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237302+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:00:29.237302+0000","last_peered":"2024-09-11T00:00:29.237302+0000","last_clean":"2024-09-11T00:00:29.237302+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:00:29.237302+0000","last_undegraded":"2024-09-11T00:00:29.237302+0000","last_fullsized":"2024-09-11T00:00:29.237302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250513+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:00:29.250513+0000","last_peered":"2024-09-11T00:00:29.250513+0000","last_clean":"2024-09-11T00:00:29.250513+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:00:29.250513+0000","last_undegraded":"2024-09-11T00:00:29.250513+0000","last_fullsized":"2024-09-11T00:00:29.250513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235382+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:00:29.235382+0000","last_peered":"2024-09-11T00:00:29.235382+0000","last_clean":"2024-09-11T00:00:29.235382+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:00:29.235382+0000","last_undegraded":"2024-09-11T00:00:29.235382+0000","last_fullsized":"2024-09-11T00:00:29.235382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251396+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:00:29.251396+0000","last_peered":"2024-09-11T00:00:29.251396+0000","last_clean":"2024-09-11T00:00:29.251396+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:00:29.251396+0000","last_undegraded":"2024-09-11T00:00:29.251396+0000","last_fullsized":"2024-09-11T00:00:29.251396+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250304+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:00:29.250304+0000","last_peered":"2024-09-11T00:00:29.250304+0000","last_clean":"2024-09-11T00:00:29.250304+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:00:29.250304+0000","last_undegraded":"2024-09-11T00:00:29.250304+0000","last_fullsized":"2024-09-11T00:00:29.250304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251182+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:00:29.251182+0000","last_peered":"2024-09-11T00:00:29.251182+0000","last_clean":"2024-09-11T00:00:29.251182+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:00:29.251182+0000","last_undegraded":"2024-09-11T00:00:29.251182+0000","last_fullsized":"2024-09-11T00:00:29.251182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608682+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:00:52.608682+0000","last_peered":"2024-09-11T00:00:52.608682+0000","last_clean":"2024-09-11T00:00:52.608682+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:00:52.608682+0000","last_undegraded":"2024-09-11T00:00:52.608682+0000","last_fullsized":"2024-09-11T00:00:52.608682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252090+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:00:29.252090+0000","last_peered":"2024-09-11T00:00:29.252090+0000","last_clean":"2024-09-11T00:00:29.252090+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:00:29.252090+0000","last_undegraded":"2024-09-11T00:00:29.252090+0000","last_fullsized":"2024-09-11T00:00:29.252090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250123+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:00:29.250123+0000","last_peered":"2024-09-11T00:00:29.250123+0000","last_clean":"2024-09-11T00:00:29.250123+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:00:29.250123+0000","last_undegraded":"2024-09-11T00:00:29.250123+0000","last_fullsized":"2024-09-11T00:00:29.250123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235736+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:00:29.235736+0000","last_peered":"2024-09-11T00:00:29.235736+0000","last_clean":"2024-09-11T00:00:29.235736+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:00:29.235736+0000","last_undegraded":"2024-09-11T00:00:29.235736+0000","last_fullsized":"2024-09-11T00:00:29.235736+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250924+0000","last_change":"2024-09-11T00:00:28.241671+0000","last_active":"2024-09-11T00:00:29.250924+0000","last_peered":"2024-09-11T00:00:29.250924+0000","last_clean":"2024-09-11T00:00:29.250924+0000","last_became_active":"2024-09-11T00:00:28.241376+0000","last_became_peered":"2024-09-11T00:00:28.241376+0000","last_unstale":"2024-09-11T00:00:29.250924+0000","last_undegraded":"2024-09-11T00:00:29.250924+0000","last_fullsized":"2024-09-11T00:00:29.250924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:21.744542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.255493+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:00:29.255493+0000","last_peered":"2024-09-11T00:00:29.255493+0000","last_clean":"2024-09-11T00:00:29.255493+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:00:29.255493+0000","last_undegraded":"2024-09-11T00:00:29.255493+0000","last_fullsized":"2024-09-11T00:00:29.255493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.253046+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:00:29.253046+0000","last_peered":"2024-09-11T00:00:29.253046+0000","last_clean":"2024-09-11T00:00:29.253046+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:00:29.253046+0000","last_undegraded":"2024-09-11T00:00:29.253046+0000","last_fullsized":"2024-09-11T00:00:29.253046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250279+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:00:29.250279+0000","last_peered":"2024-09-11T00:00:29.250279+0000","last_clean":"2024-09-11T00:00:29.250279+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:00:29.250279+0000","last_undegraded":"2024-09-11T00:00:29.250279+0000","last_fullsized":"2024-09-11T00:00:29.250279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235434+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:00:29.235434+0000","last_peered":"2024-09-11T00:00:29.235434+0000","last_clean":"2024-09-11T00:00:29.235434+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:00:29.235434+0000","last_undegraded":"2024-09-11T00:00:29.235434+0000","last_fullsized":"2024-09-11T00:00:29.235434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608446+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:00:53.608446+0000","last_peered":"2024-09-11T00:00:53.608446+0000","last_clean":"2024-09-11T00:00:53.608446+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:00:53.608446+0000","last_undegraded":"2024-09-11T00:00:53.608446+0000","last_fullsized":"2024-09-11T00:00:53.608446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":42,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608882+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:00:52.608882+0000","last_peered":"2024-09-11T00:00:52.608882+0000","last_clean":"2024-09-11T00:00:52.608882+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:00:52.608882+0000","last_undegraded":"2024-09-11T00:00:52.608882+0000","last_fullsized":"2024-09-11T00:00:52.608882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608839+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:00:52.608839+0000","last_peered":"2024-09-11T00:00:52.608839+0000","last_clean":"2024-09-11T00:00:52.608839+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:00:52.608839+0000","last_undegraded":"2024-09-11T00:00:52.608839+0000","last_fullsized":"2024-09-11T00:00:52.608839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.298200+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:38.298200+0000","last_peered":"2024-09-11T00:00:38.298200+0000","last_clean":"2024-09-11T00:00:38.298200+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:38.298200+0000","last_undegraded":"2024-09-11T00:00:38.298200+0000","last_fullsized":"2024-09-11T00:00:38.298200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.297979+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:38.297979+0000","last_peered":"2024-09-11T00:00:38.297979+0000","last_clean":"2024-09-11T00:00:38.297979+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:38.297979+0000","last_undegraded":"2024-09-11T00:00:38.297979+0000","last_fullsized":"2024-09-11T00:00:38.297979+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251213+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:00:29.251213+0000","last_peered":"2024-09-11T00:00:29.251213+0000","last_clean":"2024-09-11T00:00:29.251213+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:00:29.251213+0000","last_undegraded":"2024-09-11T00:00:29.251213+0000","last_fullsized":"2024-09-11T00:00:29.251213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.609608+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:52.609608+0000","last_peered":"2024-09-11T00:00:52.609608+0000","last_clean":"2024-09-11T00:00:52.609608+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:52.609608+0000","last_undegraded":"2024-09-11T00:00:52.609608+0000","last_fullsized":"2024-09-11T00:00:52.609608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237019+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:00:29.237019+0000","last_peered":"2024-09-11T00:00:29.237019+0000","last_clean":"2024-09-11T00:00:29.237019+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:00:29.237019+0000","last_undegraded":"2024-09-11T00:00:29.237019+0000","last_fullsized":"2024-09-11T00:00:29.237019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:50.323926+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:00:50.323926+0000","last_peered":"2024-09-11T00:00:50.323926+0000","last_clean":"2024-09-11T00:00:50.323926+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:00:50.323926+0000","last_undegraded":"2024-09-11T00:00:50.323926+0000","last_fullsized":"2024-09-11T00:00:50.323926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250864+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:00:29.250864+0000","last_peered":"2024-09-11T00:00:29.250864+0000","last_clean":"2024-09-11T00:00:29.250864+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:00:29.250864+0000","last_undegraded":"2024-09-11T00:00:29.250864+0000","last_fullsized":"2024-09-11T00:00:29.250864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:37.295860+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:37.295860+0000","last_peered":"2024-09-11T00:00:37.295860+0000","last_clean":"2024-09-11T00:00:37.295860+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:37.295860+0000","last_undegraded":"2024-09-11T00:00:37.295860+0000","last_fullsized":"2024-09-11T00:00:37.295860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.255151+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:00:29.255151+0000","last_peered":"2024-09-11T00:00:29.255151+0000","last_clean":"2024-09-11T00:00:29.255151+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:00:29.255151+0000","last_undegraded":"2024-09-11T00:00:29.255151+0000","last_fullsized":"2024-09-11T00:00:29.255151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.609068+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:52.609068+0000","last_peered":"2024-09-11T00:00:52.609068+0000","last_clean":"2024-09-11T00:00:52.609068+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:52.609068+0000","last_undegraded":"2024-09-11T00:00:52.609068+0000","last_fullsized":"2024-09-11T00:00:52.609068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250749+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:00:29.250749+0000","last_peered":"2024-09-11T00:00:29.250749+0000","last_clean":"2024-09-11T00:00:29.250749+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:00:29.250749+0000","last_undegraded":"2024-09-11T00:00:29.250749+0000","last_fullsized":"2024-09-11T00:00:29.250749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'22","reported_seq":73,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:51.327403+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:00:51.327403+0000","last_peered":"2024-09-11T00:00:51.327403+0000","last_clean":"2024-09-11T00:00:51.327403+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:00:51.327403+0000","last_undegraded":"2024-09-11T00:00:51.327403+0000","last_fullsized":"2024-09-11T00:00:51.327403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608809+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:00:53.608809+0000","last_peered":"2024-09-11T00:00:53.608809+0000","last_clean":"2024-09-11T00:00:53.608809+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:00:53.608809+0000","last_undegraded":"2024-09-11T00:00:53.608809+0000","last_fullsized":"2024-09-11T00:00:53.608809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.300170+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:38.300170+0000","last_peered":"2024-09-11T00:00:38.300170+0000","last_clean":"2024-09-11T00:00:38.300170+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:38.300170+0000","last_undegraded":"2024-09-11T00:00:38.300170+0000","last_fullsized":"2024-09-11T00:00:38.300170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250343+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:00:29.250343+0000","last_peered":"2024-09-11T00:00:29.250343+0000","last_clean":"2024-09-11T00:00:29.250343+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:00:29.250343+0000","last_undegraded":"2024-09-11T00:00:29.250343+0000","last_fullsized":"2024-09-11T00:00:29.250343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608764+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:52.608764+0000","last_peered":"2024-09-11T00:00:52.608764+0000","last_clean":"2024-09-11T00:00:52.608764+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:52.608764+0000","last_undegraded":"2024-09-11T00:00:52.608764+0000","last_fullsized":"2024-09-11T00:00:52.608764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252289+0000","last_change":"2024-09-11T00:00:28.236633+0000","last_active":"2024-09-11T00:00:29.252289+0000","last_peered":"2024-09-11T00:00:29.252289+0000","last_clean":"2024-09-11T00:00:29.252289+0000","last_became_active":"2024-09-11T00:00:28.236204+0000","last_became_peered":"2024-09-11T00:00:28.236204+0000","last_unstale":"2024-09-11T00:00:29.252289+0000","last_undegraded":"2024-09-11T00:00:29.252289+0000","last_fullsized":"2024-09-11T00:00:29.252289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:35.601993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":42,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606079+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:00:52.606079+0000","last_peered":"2024-09-11T00:00:52.606079+0000","last_clean":"2024-09-11T00:00:52.606079+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:00:52.606079+0000","last_undegraded":"2024-09-11T00:00:52.606079+0000","last_fullsized":"2024-09-11T00:00:52.606079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.249912+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:00:29.249912+0000","last_peered":"2024-09-11T00:00:29.249912+0000","last_clean":"2024-09-11T00:00:29.249912+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:00:29.249912+0000","last_undegraded":"2024-09-11T00:00:29.249912+0000","last_fullsized":"2024-09-11T00:00:29.249912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":76,"state":"peering","last_fresh":"2024-09-11T00:00:29.250040+0000","last_change":"2024-09-11T00:00:52.608898+0000","last_active":"2024-09-11T00:00:52.608898+0000","last_peered":"2024-09-11T00:00:29.250040+0000","last_clean":"2024-09-11T00:00:29.250040+0000","last_became_active":"2024-09-11T00:00:28.251776+0000","last_became_peered":"2024-09-11T00:00:28.251776+0000","last_unstale":"2024-09-11T00:00:29.250040+0000","last_undegraded":"2024-09-11T00:00:29.250040+0000","last_fullsized":"2024-09-11T00:00:29.250040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:39.306029+0000","last_change":"2024-09-11T00:00:26.218066+0000","last_active":"2024-09-11T00:00:39.306029+0000","last_peered":"2024-09-11T00:00:39.306029+0000","last_clean":"2024-09-11T00:00:39.306029+0000","last_became_active":"2024-09-11T00:00:26.217641+0000","last_became_peered":"2024-09-11T00:00:26.217641+0000","last_unstale":"2024-09-11T00:00:39.306029+0000","last_undegraded":"2024-09-11T00:00:39.306029+0000","last_fullsized":"2024-09-11T00:00:39.306029+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:45.368536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235682+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:00:29.235682+0000","last_peered":"2024-09-11T00:00:29.235682+0000","last_clean":"2024-09-11T00:00:29.235682+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:00:29.235682+0000","last_undegraded":"2024-09-11T00:00:29.235682+0000","last_fullsized":"2024-09-11T00:00:29.235682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.258342+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:29.258342+0000","last_peered":"2024-09-11T00:00:29.258342+0000","last_clean":"2024-09-11T00:00:29.258342+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:29.258342+0000","last_undegraded":"2024-09-11T00:00:29.258342+0000","last_fullsized":"2024-09-11T00:00:29.258342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252397+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:00:29.252397+0000","last_peered":"2024-09-11T00:00:29.252397+0000","last_clean":"2024-09-11T00:00:29.252397+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:00:29.252397+0000","last_undegraded":"2024-09-11T00:00:29.252397+0000","last_fullsized":"2024-09-11T00:00:29.252397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.609102+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:52.609102+0000","last_peered":"2024-09-11T00:00:52.609102+0000","last_clean":"2024-09-11T00:00:52.609102+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:52.609102+0000","last_undegraded":"2024-09-11T00:00:52.609102+0000","last_fullsized":"2024-09-11T00:00:52.609102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:31.498117+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:00:31.498117+0000","last_peered":"2024-09-11T00:00:31.498117+0000","last_clean":"2024-09-11T00:00:31.498117+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:00:31.498117+0000","last_undegraded":"2024-09-11T00:00:31.498117+0000","last_fullsized":"2024-09-11T00:00:31.498117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":2,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-11T00:00:29.250871+0000","last_change":"2024-09-11T00:00:53.263375+0000","last_active":"2024-09-11T00:00:53.263375+0000","last_peered":"2024-09-11T00:00:29.250871+0000","last_clean":"2024-09-11T00:00:29.250871+0000","last_became_active":"2024-09-11T00:00:26.813046+0000","last_became_peered":"2024-09-11T00:00:26.813046+0000","last_unstale":"2024-09-11T00:00:29.250871+0000","last_undegraded":"2024-09-11T00:00:29.250871+0000","last_fullsized":"2024-09-11T00:00:29.250871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252151+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:00:29.252151+0000","last_peered":"2024-09-11T00:00:29.252151+0000","last_clean":"2024-09-11T00:00:29.252151+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:00:29.252151+0000","last_undegraded":"2024-09-11T00:00:29.252151+0000","last_fullsized":"2024-09-11T00:00:29.252151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250127+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:29.250127+0000","last_peered":"2024-09-11T00:00:29.250127+0000","last_clean":"2024-09-11T00:00:29.250127+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:29.250127+0000","last_undegraded":"2024-09-11T00:00:29.250127+0000","last_fullsized":"2024-09-11T00:00:29.250127+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606188+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:52.606188+0000","last_peered":"2024-09-11T00:00:52.606188+0000","last_clean":"2024-09-11T00:00:52.606188+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:52.606188+0000","last_undegraded":"2024-09-11T00:00:52.606188+0000","last_fullsized":"2024-09-11T00:00:52.606188+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252274+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:00:29.252274+0000","last_peered":"2024-09-11T00:00:29.252274+0000","last_clean":"2024-09-11T00:00:29.252274+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:00:29.252274+0000","last_undegraded":"2024-09-11T00:00:29.252274+0000","last_fullsized":"2024-09-11T00:00:29.252274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.299439+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:38.299439+0000","last_peered":"2024-09-11T00:00:38.299439+0000","last_clean":"2024-09-11T00:00:38.299439+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:38.299439+0000","last_undegraded":"2024-09-11T00:00:38.299439+0000","last_fullsized":"2024-09-11T00:00:38.299439+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.249752+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:00:29.249752+0000","last_peered":"2024-09-11T00:00:29.249752+0000","last_clean":"2024-09-11T00:00:29.249752+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:00:29.249752+0000","last_undegraded":"2024-09-11T00:00:29.249752+0000","last_fullsized":"2024-09-11T00:00:29.249752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:48.321875+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:00:48.321875+0000","last_peered":"2024-09-11T00:00:48.321875+0000","last_clean":"2024-09-11T00:00:48.321875+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:00:48.321875+0000","last_undegraded":"2024-09-11T00:00:48.321875+0000","last_fullsized":"2024-09-11T00:00:48.321875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251106+0000","last_change":"2024-09-11T00:00:28.250566+0000","last_active":"2024-09-11T00:00:29.251106+0000","last_peered":"2024-09-11T00:00:29.251106+0000","last_clean":"2024-09-11T00:00:29.251106+0000","last_became_active":"2024-09-11T00:00:28.250064+0000","last_became_peered":"2024-09-11T00:00:28.250064+0000","last_unstale":"2024-09-11T00:00:29.251106+0000","last_undegraded":"2024-09-11T00:00:29.251106+0000","last_fullsized":"2024-09-11T00:00:29.251106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:18.453617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251915+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:29.251915+0000","last_peered":"2024-09-11T00:00:29.251915+0000","last_clean":"2024-09-11T00:00:29.251915+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:29.251915+0000","last_undegraded":"2024-09-11T00:00:29.251915+0000","last_fullsized":"2024-09-11T00:00:29.251915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237537+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:00:29.237537+0000","last_peered":"2024-09-11T00:00:29.237537+0000","last_clean":"2024-09-11T00:00:29.237537+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:00:29.237537+0000","last_undegraded":"2024-09-11T00:00:29.237537+0000","last_fullsized":"2024-09-11T00:00:29.237537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237000+0000","last_change":"2024-09-11T00:00:26.305312+0000","last_active":"2024-09-11T00:00:29.237000+0000","last_peered":"2024-09-11T00:00:29.237000+0000","last_clean":"2024-09-11T00:00:29.237000+0000","last_became_active":"2024-09-11T00:00:26.305002+0000","last_became_peered":"2024-09-11T00:00:26.305002+0000","last_unstale":"2024-09-11T00:00:29.237000+0000","last_undegraded":"2024-09-11T00:00:29.237000+0000","last_fullsized":"2024-09-11T00:00:29.237000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:16.586179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:32.135198+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:00:32.135198+0000","last_peered":"2024-09-11T00:00:32.135198+0000","last_clean":"2024-09-11T00:00:32.135198+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:00:32.135198+0000","last_undegraded":"2024-09-11T00:00:32.135198+0000","last_fullsized":"2024-09-11T00:00:32.135198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251153+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:00:29.251153+0000","last_peered":"2024-09-11T00:00:29.251153+0000","last_clean":"2024-09-11T00:00:29.251153+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:00:29.251153+0000","last_undegraded":"2024-09-11T00:00:29.251153+0000","last_fullsized":"2024-09-11T00:00:29.251153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:49.249890+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:00:49.249890+0000","last_peered":"2024-09-11T00:00:49.249890+0000","last_clean":"2024-09-11T00:00:49.249890+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:00:49.249890+0000","last_undegraded":"2024-09-11T00:00:49.249890+0000","last_fullsized":"2024-09-11T00:00:49.249890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251735+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:00:29.251735+0000","last_peered":"2024-09-11T00:00:29.251735+0000","last_clean":"2024-09-11T00:00:29.251735+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:00:29.251735+0000","last_undegraded":"2024-09-11T00:00:29.251735+0000","last_fullsized":"2024-09-11T00:00:29.251735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606708+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:52.606708+0000","last_peered":"2024-09-11T00:00:52.606708+0000","last_clean":"2024-09-11T00:00:52.606708+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:52.606708+0000","last_undegraded":"2024-09-11T00:00:52.606708+0000","last_fullsized":"2024-09-11T00:00:52.606708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.255142+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:00:29.255142+0000","last_peered":"2024-09-11T00:00:29.255142+0000","last_clean":"2024-09-11T00:00:29.255142+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:00:29.255142+0000","last_undegraded":"2024-09-11T00:00:29.255142+0000","last_fullsized":"2024-09-11T00:00:29.255142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:37.295097+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:37.295097+0000","last_peered":"2024-09-11T00:00:37.295097+0000","last_clean":"2024-09-11T00:00:37.295097+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:37.295097+0000","last_undegraded":"2024-09-11T00:00:37.295097+0000","last_fullsized":"2024-09-11T00:00:37.295097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607559+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:00:53.607559+0000","last_peered":"2024-09-11T00:00:53.607559+0000","last_clean":"2024-09-11T00:00:53.607559+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:00:53.607559+0000","last_undegraded":"2024-09-11T00:00:53.607559+0000","last_fullsized":"2024-09-11T00:00:53.607559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:37.294051+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:37.294051+0000","last_peered":"2024-09-11T00:00:37.294051+0000","last_clean":"2024-09-11T00:00:37.294051+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:37.294051+0000","last_undegraded":"2024-09-11T00:00:37.294051+0000","last_fullsized":"2024-09-11T00:00:37.294051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235378+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:00:29.235378+0000","last_peered":"2024-09-11T00:00:29.235378+0000","last_clean":"2024-09-11T00:00:29.235378+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:00:29.235378+0000","last_undegraded":"2024-09-11T00:00:29.235378+0000","last_fullsized":"2024-09-11T00:00:29.235378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.253089+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:29.253089+0000","last_peered":"2024-09-11T00:00:29.253089+0000","last_clean":"2024-09-11T00:00:29.253089+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:29.253089+0000","last_undegraded":"2024-09-11T00:00:29.253089+0000","last_fullsized":"2024-09-11T00:00:29.253089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251838+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:00:29.251838+0000","last_peered":"2024-09-11T00:00:29.251838+0000","last_clean":"2024-09-11T00:00:29.251838+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:00:29.251838+0000","last_undegraded":"2024-09-11T00:00:29.251838+0000","last_fullsized":"2024-09-11T00:00:29.251838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251008+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:00:29.251008+0000","last_peered":"2024-09-11T00:00:29.251008+0000","last_clean":"2024-09-11T00:00:29.251008+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:00:29.251008+0000","last_undegraded":"2024-09-11T00:00:29.251008+0000","last_fullsized":"2024-09-11T00:00:29.251008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608973+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:00:52.608973+0000","last_peered":"2024-09-11T00:00:52.608973+0000","last_clean":"2024-09-11T00:00:52.608973+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:00:52.608973+0000","last_undegraded":"2024-09-11T00:00:52.608973+0000","last_fullsized":"2024-09-11T00:00:52.608973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250529+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:00:29.250529+0000","last_peered":"2024-09-11T00:00:29.250529+0000","last_clean":"2024-09-11T00:00:29.250529+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:00:29.250529+0000","last_undegraded":"2024-09-11T00:00:29.250529+0000","last_fullsized":"2024-09-11T00:00:29.250529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.255187+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:00:29.255187+0000","last_peered":"2024-09-11T00:00:29.255187+0000","last_clean":"2024-09-11T00:00:29.255187+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:00:29.255187+0000","last_undegraded":"2024-09-11T00:00:29.255187+0000","last_fullsized":"2024-09-11T00:00:29.255187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:30.148730+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:30.148730+0000","last_peered":"2024-09-11T00:00:30.148730+0000","last_clean":"2024-09-11T00:00:30.148730+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:30.148730+0000","last_undegraded":"2024-09-11T00:00:30.148730+0000","last_fullsized":"2024-09-11T00:00:30.148730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251871+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:00:29.251871+0000","last_peered":"2024-09-11T00:00:29.251871+0000","last_clean":"2024-09-11T00:00:29.251871+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:00:29.251871+0000","last_undegraded":"2024-09-11T00:00:29.251871+0000","last_fullsized":"2024-09-11T00:00:29.251871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.300062+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:38.300062+0000","last_peered":"2024-09-11T00:00:38.300062+0000","last_clean":"2024-09-11T00:00:38.300062+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:38.300062+0000","last_undegraded":"2024-09-11T00:00:38.300062+0000","last_fullsized":"2024-09-11T00:00:38.300062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50801,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":102,"num_read_kb":103,"num_write":149,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":152381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710738,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":819200,"data_stored":404601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1043273,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":404837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":996687,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":404226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":1004780,"data_compressed":38741,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":405054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":404537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":452169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":445082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":843776,"data_stored":405497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:00:56.156 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:00:56.414 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:56.801 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:56 smithi019 ceph-mon[30859]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 -- 172.21.15.19:0/1827671440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4104600 msgr2=0x7f0ed410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 --2- 172.21.15.19:0/1827671440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4104600 0x7f0ed410caf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009ca0 tx=0x7f0ec802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 -- 172.21.15.19:0/1827671440 shutdown_connections 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 --2- 172.21.15.19:0/1827671440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed410d140 0x7f0ed410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 --2- 172.21.15.19:0/1827671440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4104600 0x7f0ed410caf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 --2- 172.21.15.19:0/1827671440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4103ce0 0x7f0ed41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 -- 172.21.15.19:0/1827671440 >> 172.21.15.19:0/1827671440 conn(0x7f0ed40fd700 msgr2=0x7f0ed40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 -- 172.21.15.19:0/1827671440 shutdown_connections 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.887+0000 7f0ed906e640 1 -- 172.21.15.19:0/1827671440 wait complete. 2024-09-11T00:00:56.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 Processor -- start 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 -- start start 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4103ce0 0x7f0ed4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4104600 0x7f0ed41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed410d140 0x7f0ed419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4112db0 con 0x7f0ed4103ce0 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4112c30 con 0x7f0ed410d140 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed906e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4112f30 con 0x7f0ed4104600 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4103ce0 0x7f0ed4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4103ce0 0x7f0ed4199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49030/0 (socket says 172.21.15.19:49030) 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.888+0000 7f0ed2d9d640 1 -- 172.21.15.19:0/832406506 learned_addr learned my addr 172.21.15.19:0/832406506 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed359e640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed410d140 0x7f0ed419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:56.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed259c640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4104600 0x7f0ed41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed2d9d640 1 -- 172.21.15.19:0/832406506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4104600 msgr2=0x7f0ed41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed2d9d640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4104600 0x7f0ed41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed2d9d640 1 -- 172.21.15.19:0/832406506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed410d140 msgr2=0x7f0ed419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed2d9d640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed410d140 0x7f0ed419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed2d9d640 1 -- 172.21.15.19:0/832406506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed419f330 con 0x7f0ed4103ce0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed2d9d640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4103ce0 0x7f0ed4199280 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400d770 tx=0x7f0ec400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ebbfff640 1 -- 172.21.15.19:0/832406506 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4017070 con 0x7f0ed4103ce0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed419f620 con 0x7f0ed4103ce0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ebbfff640 1 -- 172.21.15.19:0/832406506 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec40054d0 con 0x7f0ed4103ce0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ebbfff640 1 -- 172.21.15.19:0/832406506 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4004c30 con 0x7f0ed4103ce0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.889+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed41a5ce0 con 0x7f0ed4103ce0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.890+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed41040c0 con 0x7f0ed4103ce0 2024-09-11T00:00:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.892+0000 7f0ebbfff640 1 -- 172.21.15.19:0/832406506 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f0ec4004e10 con 0x7f0ed4103ce0 2024-09-11T00:00:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.892+0000 7f0ebbfff640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0ebc0b53c0 0x7f0ebc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.892+0000 7f0ed259c640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0ebc0b53c0 0x7f0ebc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.893+0000 7f0ebbfff640 1 -- 172.21.15.19:0/832406506 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f0ec40e5a10 con 0x7f0ed4103ce0 2024-09-11T00:00:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.893+0000 7f0ed259c640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0ebc0b53c0 0x7f0ebc0b7880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ed41012f0 tx=0x7f0ec8009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:56.897+0000 7f0ebbfff640 1 -- 172.21.15.19:0/832406506 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0ec40ac6d0 con 0x7f0ed4103ce0 2024-09-11T00:00:56.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:56 smithi135 ceph-mon[35432]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:00:57.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:56 smithi131 ceph-mon[35491]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:00:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.079+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ed40ffa20 con 0x7f0ebc0b53c0 2024-09-11T00:00:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.084+0000 7f0ebbfff640 1 -- 172.21.15.19:0/832406506 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258831 (secure 0 0 0) 0x7f0ed40ffa20 con 0x7f0ebc0b53c0 2024-09-11T00:00:57.087 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:00:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0ebc0b53c0 msgr2=0x7f0ebc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0ebc0b53c0 0x7f0ebc0b7880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ed41012f0 tx=0x7f0ec8009360 comp rx=0 tx=0).stop 2024-09-11T00:00:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4103ce0 msgr2=0x7f0ed4199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4103ce0 0x7f0ed4199280 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400d770 tx=0x7f0ec400dc30 comp rx=0 tx=0).stop 2024-09-11T00:00:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 shutdown_connections 2024-09-11T00:00:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed410d140 0x7f0ed419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4104600 0x7f0ed41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0ebc0b53c0 0x7f0ebc0b7880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 --2- 172.21.15.19:0/832406506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed4103ce0 0x7f0ed4199280 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 >> 172.21.15.19:0/832406506 conn(0x7f0ed40fd700 msgr2=0x7f0ed40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 shutdown_connections 2024-09-11T00:00:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:57.087+0000 7f0ed906e640 1 -- 172.21.15.19:0/832406506 wait complete. 2024-09-11T00:00:57.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:57 smithi019 ceph-mon[30859]: pgmap v278: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2024-09-11T00:00:57.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:57 smithi019 ceph-mon[30859]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:00:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-11T00:00:56.493122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641403,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":274,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363692,"kb_used_data":10248,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578132,"statfs":{"total":1151940427776,"available":1151568007168,"internally_reserved":0,"allocated":10493952,"data_stored":6893455,"data_compressed":145075,"data_compressed_allocated":188416,"data_compressed_original":1875968,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24587,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":44,"num_write":12,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002153"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235684+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:00:29.235684+0000","last_peered":"2024-09-11T00:00:29.235684+0000","last_clean":"2024-09-11T00:00:29.235684+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:00:29.235684+0000","last_undegraded":"2024-09-11T00:00:29.235684+0000","last_fullsized":"2024-09-11T00:00:29.235684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607796+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:00:53.607796+0000","last_peered":"2024-09-11T00:00:53.607796+0000","last_clean":"2024-09-11T00:00:53.607796+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:00:53.607796+0000","last_undegraded":"2024-09-11T00:00:53.607796+0000","last_fullsized":"2024-09-11T00:00:53.607796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607548+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:00:53.607548+0000","last_peered":"2024-09-11T00:00:53.607548+0000","last_clean":"2024-09-11T00:00:53.607548+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:00:53.607548+0000","last_undegraded":"2024-09-11T00:00:53.607548+0000","last_fullsized":"2024-09-11T00:00:53.607548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606424+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:00:52.606424+0000","last_peered":"2024-09-11T00:00:52.606424+0000","last_clean":"2024-09-11T00:00:52.606424+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:00:52.606424+0000","last_undegraded":"2024-09-11T00:00:52.606424+0000","last_fullsized":"2024-09-11T00:00:52.606424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607907+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:00:53.607907+0000","last_peered":"2024-09-11T00:00:53.607907+0000","last_clean":"2024-09-11T00:00:53.607907+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:00:53.607907+0000","last_undegraded":"2024-09-11T00:00:53.607907+0000","last_fullsized":"2024-09-11T00:00:53.607907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237254+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:00:29.237254+0000","last_peered":"2024-09-11T00:00:29.237254+0000","last_clean":"2024-09-11T00:00:29.237254+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:00:29.237254+0000","last_undegraded":"2024-09-11T00:00:29.237254+0000","last_fullsized":"2024-09-11T00:00:29.237254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250411+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:00:29.250411+0000","last_peered":"2024-09-11T00:00:29.250411+0000","last_clean":"2024-09-11T00:00:29.250411+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:00:29.250411+0000","last_undegraded":"2024-09-11T00:00:29.250411+0000","last_fullsized":"2024-09-11T00:00:29.250411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697403+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:00:53.697403+0000","last_peered":"2024-09-11T00:00:53.697403+0000","last_clean":"2024-09-11T00:00:53.697403+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:00:53.697403+0000","last_undegraded":"2024-09-11T00:00:53.697403+0000","last_fullsized":"2024-09-11T00:00:53.697403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698427+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:00:53.698427+0000","last_peered":"2024-09-11T00:00:53.698427+0000","last_clean":"2024-09-11T00:00:53.698427+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:00:53.698427+0000","last_undegraded":"2024-09-11T00:00:53.698427+0000","last_fullsized":"2024-09-11T00:00:53.698427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237705+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:00:29.237705+0000","last_peered":"2024-09-11T00:00:29.237705+0000","last_clean":"2024-09-11T00:00:29.237705+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:00:29.237705+0000","last_undegraded":"2024-09-11T00:00:29.237705+0000","last_fullsized":"2024-09-11T00:00:29.237705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251910+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:00:29.251910+0000","last_peered":"2024-09-11T00:00:29.251910+0000","last_clean":"2024-09-11T00:00:29.251910+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:00:29.251910+0000","last_undegraded":"2024-09-11T00:00:29.251910+0000","last_fullsized":"2024-09-11T00:00:29.251910+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606579+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:00:52.606579+0000","last_peered":"2024-09-11T00:00:52.606579+0000","last_clean":"2024-09-11T00:00:52.606579+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:00:52.606579+0000","last_undegraded":"2024-09-11T00:00:52.606579+0000","last_fullsized":"2024-09-11T00:00:52.606579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608293+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:00:53.608293+0000","last_peered":"2024-09-11T00:00:53.608293+0000","last_clean":"2024-09-11T00:00:53.608293+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:00:53.608293+0000","last_undegraded":"2024-09-11T00:00:53.608293+0000","last_fullsized":"2024-09-11T00:00:53.608293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607421+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:00:53.607421+0000","last_peered":"2024-09-11T00:00:53.607421+0000","last_clean":"2024-09-11T00:00:53.607421+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:00:53.607421+0000","last_undegraded":"2024-09-11T00:00:53.607421+0000","last_fullsized":"2024-09-11T00:00:53.607421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607980+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:00:53.607980+0000","last_peered":"2024-09-11T00:00:53.607980+0000","last_clean":"2024-09-11T00:00:53.607980+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:00:53.607980+0000","last_undegraded":"2024-09-11T00:00:53.607980+0000","last_fullsized":"2024-09-11T00:00:53.607980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697447+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:00:53.697447+0000","last_peered":"2024-09-11T00:00:53.697447+0000","last_clean":"2024-09-11T00:00:53.697447+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:00:53.697447+0000","last_undegraded":"2024-09-11T00:00:53.697447+0000","last_fullsized":"2024-09-11T00:00:53.697447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235804+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:00:29.235804+0000","last_peered":"2024-09-11T00:00:29.235804+0000","last_clean":"2024-09-11T00:00:29.235804+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:00:29.235804+0000","last_undegraded":"2024-09-11T00:00:29.235804+0000","last_fullsized":"2024-09-11T00:00:29.235804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237302+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:00:29.237302+0000","last_peered":"2024-09-11T00:00:29.237302+0000","last_clean":"2024-09-11T00:00:29.237302+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:00:29.237302+0000","last_undegraded":"2024-09-11T00:00:29.237302+0000","last_fullsized":"2024-09-11T00:00:29.237302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608539+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:00:53.608539+0000","last_peered":"2024-09-11T00:00:53.608539+0000","last_clean":"2024-09-11T00:00:53.608539+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:00:53.608539+0000","last_undegraded":"2024-09-11T00:00:53.608539+0000","last_fullsized":"2024-09-11T00:00:53.608539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235382+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:00:29.235382+0000","last_peered":"2024-09-11T00:00:29.235382+0000","last_clean":"2024-09-11T00:00:29.235382+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:00:29.235382+0000","last_undegraded":"2024-09-11T00:00:29.235382+0000","last_fullsized":"2024-09-11T00:00:29.235382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608387+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:00:53.608387+0000","last_peered":"2024-09-11T00:00:53.608387+0000","last_clean":"2024-09-11T00:00:53.608387+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:00:53.608387+0000","last_undegraded":"2024-09-11T00:00:53.608387+0000","last_fullsized":"2024-09-11T00:00:53.608387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697829+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:00:53.697829+0000","last_peered":"2024-09-11T00:00:53.697829+0000","last_clean":"2024-09-11T00:00:53.697829+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:00:53.697829+0000","last_undegraded":"2024-09-11T00:00:53.697829+0000","last_fullsized":"2024-09-11T00:00:53.697829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697440+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:00:53.697440+0000","last_peered":"2024-09-11T00:00:53.697440+0000","last_clean":"2024-09-11T00:00:53.697440+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:00:53.697440+0000","last_undegraded":"2024-09-11T00:00:53.697440+0000","last_fullsized":"2024-09-11T00:00:53.697440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608682+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:00:52.608682+0000","last_peered":"2024-09-11T00:00:52.608682+0000","last_clean":"2024-09-11T00:00:52.608682+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:00:52.608682+0000","last_undegraded":"2024-09-11T00:00:52.608682+0000","last_fullsized":"2024-09-11T00:00:52.608682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697755+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:00:53.697755+0000","last_peered":"2024-09-11T00:00:53.697755+0000","last_clean":"2024-09-11T00:00:53.697755+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:00:53.697755+0000","last_undegraded":"2024-09-11T00:00:53.697755+0000","last_fullsized":"2024-09-11T00:00:53.697755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608401+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:00:53.608401+0000","last_peered":"2024-09-11T00:00:53.608401+0000","last_clean":"2024-09-11T00:00:53.608401+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:00:53.608401+0000","last_undegraded":"2024-09-11T00:00:53.608401+0000","last_fullsized":"2024-09-11T00:00:53.608401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235736+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:00:29.235736+0000","last_peered":"2024-09-11T00:00:29.235736+0000","last_clean":"2024-09-11T00:00:29.235736+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:00:29.235736+0000","last_undegraded":"2024-09-11T00:00:29.235736+0000","last_fullsized":"2024-09-11T00:00:29.235736+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610028+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:00:53.610028+0000","last_peered":"2024-09-11T00:00:53.610028+0000","last_clean":"2024-09-11T00:00:53.610028+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:00:53.610028+0000","last_undegraded":"2024-09-11T00:00:53.610028+0000","last_fullsized":"2024-09-11T00:00:53.610028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608648+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:00:53.608648+0000","last_peered":"2024-09-11T00:00:53.608648+0000","last_clean":"2024-09-11T00:00:53.608648+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:00:53.608648+0000","last_undegraded":"2024-09-11T00:00:53.608648+0000","last_fullsized":"2024-09-11T00:00:53.608648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608123+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:00:53.608123+0000","last_peered":"2024-09-11T00:00:53.608123+0000","last_clean":"2024-09-11T00:00:53.608123+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:00:53.608123+0000","last_undegraded":"2024-09-11T00:00:53.608123+0000","last_fullsized":"2024-09-11T00:00:53.608123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607903+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:00:53.607903+0000","last_peered":"2024-09-11T00:00:53.607903+0000","last_clean":"2024-09-11T00:00:53.607903+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:00:53.607903+0000","last_undegraded":"2024-09-11T00:00:53.607903+0000","last_fullsized":"2024-09-11T00:00:53.607903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235434+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:00:29.235434+0000","last_peered":"2024-09-11T00:00:29.235434+0000","last_clean":"2024-09-11T00:00:29.235434+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:00:29.235434+0000","last_undegraded":"2024-09-11T00:00:29.235434+0000","last_fullsized":"2024-09-11T00:00:29.235434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608446+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:00:53.608446+0000","last_peered":"2024-09-11T00:00:53.608446+0000","last_clean":"2024-09-11T00:00:53.608446+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:00:53.608446+0000","last_undegraded":"2024-09-11T00:00:53.608446+0000","last_fullsized":"2024-09-11T00:00:53.608446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":42,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608882+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:00:52.608882+0000","last_peered":"2024-09-11T00:00:52.608882+0000","last_clean":"2024-09-11T00:00:52.608882+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:00:52.608882+0000","last_undegraded":"2024-09-11T00:00:52.608882+0000","last_fullsized":"2024-09-11T00:00:52.608882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608839+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:00:52.608839+0000","last_peered":"2024-09-11T00:00:52.608839+0000","last_clean":"2024-09-11T00:00:52.608839+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:00:52.608839+0000","last_undegraded":"2024-09-11T00:00:52.608839+0000","last_fullsized":"2024-09-11T00:00:52.608839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.298200+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:38.298200+0000","last_peered":"2024-09-11T00:00:38.298200+0000","last_clean":"2024-09-11T00:00:38.298200+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:38.298200+0000","last_undegraded":"2024-09-11T00:00:38.298200+0000","last_fullsized":"2024-09-11T00:00:38.298200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697456+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:00:53.697456+0000","last_peered":"2024-09-11T00:00:53.697456+0000","last_clean":"2024-09-11T00:00:53.697456+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:00:53.697456+0000","last_undegraded":"2024-09-11T00:00:53.697456+0000","last_fullsized":"2024-09-11T00:00:53.697456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.609608+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:52.609608+0000","last_peered":"2024-09-11T00:00:52.609608+0000","last_clean":"2024-09-11T00:00:52.609608+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:52.609608+0000","last_undegraded":"2024-09-11T00:00:52.609608+0000","last_fullsized":"2024-09-11T00:00:52.609608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237019+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:00:29.237019+0000","last_peered":"2024-09-11T00:00:29.237019+0000","last_clean":"2024-09-11T00:00:29.237019+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:00:29.237019+0000","last_undegraded":"2024-09-11T00:00:29.237019+0000","last_fullsized":"2024-09-11T00:00:29.237019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:50.323926+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:00:50.323926+0000","last_peered":"2024-09-11T00:00:50.323926+0000","last_clean":"2024-09-11T00:00:50.323926+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:00:50.323926+0000","last_undegraded":"2024-09-11T00:00:50.323926+0000","last_fullsized":"2024-09-11T00:00:50.323926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697914+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:00:53.697914+0000","last_peered":"2024-09-11T00:00:53.697914+0000","last_clean":"2024-09-11T00:00:53.697914+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:00:53.697914+0000","last_undegraded":"2024-09-11T00:00:53.697914+0000","last_fullsized":"2024-09-11T00:00:53.697914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:37.295860+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:37.295860+0000","last_peered":"2024-09-11T00:00:37.295860+0000","last_clean":"2024-09-11T00:00:37.295860+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:37.295860+0000","last_undegraded":"2024-09-11T00:00:37.295860+0000","last_fullsized":"2024-09-11T00:00:37.295860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608380+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:00:53.608380+0000","last_peered":"2024-09-11T00:00:53.608380+0000","last_clean":"2024-09-11T00:00:53.608380+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:00:53.608380+0000","last_undegraded":"2024-09-11T00:00:53.608380+0000","last_fullsized":"2024-09-11T00:00:53.608380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.609068+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:52.609068+0000","last_peered":"2024-09-11T00:00:52.609068+0000","last_clean":"2024-09-11T00:00:52.609068+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:52.609068+0000","last_undegraded":"2024-09-11T00:00:52.609068+0000","last_fullsized":"2024-09-11T00:00:52.609068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697945+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:00:53.697945+0000","last_peered":"2024-09-11T00:00:53.697945+0000","last_clean":"2024-09-11T00:00:53.697945+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:00:53.697945+0000","last_undegraded":"2024-09-11T00:00:53.697945+0000","last_fullsized":"2024-09-11T00:00:53.697945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'22","reported_seq":73,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:51.327403+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:00:51.327403+0000","last_peered":"2024-09-11T00:00:51.327403+0000","last_clean":"2024-09-11T00:00:51.327403+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:00:51.327403+0000","last_undegraded":"2024-09-11T00:00:51.327403+0000","last_fullsized":"2024-09-11T00:00:51.327403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608809+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:00:53.608809+0000","last_peered":"2024-09-11T00:00:53.608809+0000","last_clean":"2024-09-11T00:00:53.608809+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:00:53.608809+0000","last_undegraded":"2024-09-11T00:00:53.608809+0000","last_fullsized":"2024-09-11T00:00:53.608809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607445+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:00:53.607445+0000","last_peered":"2024-09-11T00:00:53.607445+0000","last_clean":"2024-09-11T00:00:53.607445+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:00:53.607445+0000","last_undegraded":"2024-09-11T00:00:53.607445+0000","last_fullsized":"2024-09-11T00:00:53.607445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608764+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:52.608764+0000","last_peered":"2024-09-11T00:00:52.608764+0000","last_clean":"2024-09-11T00:00:52.608764+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:52.608764+0000","last_undegraded":"2024-09-11T00:00:52.608764+0000","last_fullsized":"2024-09-11T00:00:52.608764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252289+0000","last_change":"2024-09-11T00:00:28.236633+0000","last_active":"2024-09-11T00:00:29.252289+0000","last_peered":"2024-09-11T00:00:29.252289+0000","last_clean":"2024-09-11T00:00:29.252289+0000","last_became_active":"2024-09-11T00:00:28.236204+0000","last_became_peered":"2024-09-11T00:00:28.236204+0000","last_unstale":"2024-09-11T00:00:29.252289+0000","last_undegraded":"2024-09-11T00:00:29.252289+0000","last_fullsized":"2024-09-11T00:00:29.252289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:35.601993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":42,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606079+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:00:52.606079+0000","last_peered":"2024-09-11T00:00:52.606079+0000","last_clean":"2024-09-11T00:00:52.606079+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:00:52.606079+0000","last_undegraded":"2024-09-11T00:00:52.606079+0000","last_fullsized":"2024-09-11T00:00:52.606079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.249912+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:00:29.249912+0000","last_peered":"2024-09-11T00:00:29.249912+0000","last_clean":"2024-09-11T00:00:29.249912+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:00:29.249912+0000","last_undegraded":"2024-09-11T00:00:29.249912+0000","last_fullsized":"2024-09-11T00:00:29.249912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":76,"state":"peering","last_fresh":"2024-09-11T00:00:29.250040+0000","last_change":"2024-09-11T00:00:52.608898+0000","last_active":"2024-09-11T00:00:52.608898+0000","last_peered":"2024-09-11T00:00:29.250040+0000","last_clean":"2024-09-11T00:00:29.250040+0000","last_became_active":"2024-09-11T00:00:28.251776+0000","last_became_peered":"2024-09-11T00:00:28.251776+0000","last_unstale":"2024-09-11T00:00:29.250040+0000","last_undegraded":"2024-09-11T00:00:29.250040+0000","last_fullsized":"2024-09-11T00:00:29.250040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:39.306029+0000","last_change":"2024-09-11T00:00:26.218066+0000","last_active":"2024-09-11T00:00:39.306029+0000","last_peered":"2024-09-11T00:00:39.306029+0000","last_clean":"2024-09-11T00:00:39.306029+0000","last_became_active":"2024-09-11T00:00:26.217641+0000","last_became_peered":"2024-09-11T00:00:26.217641+0000","last_unstale":"2024-09-11T00:00:39.306029+0000","last_undegraded":"2024-09-11T00:00:39.306029+0000","last_fullsized":"2024-09-11T00:00:39.306029+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:45.368536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235682+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:00:29.235682+0000","last_peered":"2024-09-11T00:00:29.235682+0000","last_clean":"2024-09-11T00:00:29.235682+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:00:29.235682+0000","last_undegraded":"2024-09-11T00:00:29.235682+0000","last_fullsized":"2024-09-11T00:00:29.235682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252397+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:00:29.252397+0000","last_peered":"2024-09-11T00:00:29.252397+0000","last_clean":"2024-09-11T00:00:29.252397+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:00:29.252397+0000","last_undegraded":"2024-09-11T00:00:29.252397+0000","last_fullsized":"2024-09-11T00:00:29.252397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.609102+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:52.609102+0000","last_peered":"2024-09-11T00:00:52.609102+0000","last_clean":"2024-09-11T00:00:52.609102+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:52.609102+0000","last_undegraded":"2024-09-11T00:00:52.609102+0000","last_fullsized":"2024-09-11T00:00:52.609102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:31.498117+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:00:31.498117+0000","last_peered":"2024-09-11T00:00:31.498117+0000","last_clean":"2024-09-11T00:00:31.498117+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:00:31.498117+0000","last_undegraded":"2024-09-11T00:00:31.498117+0000","last_fullsized":"2024-09-11T00:00:31.498117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":2,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-11T00:00:29.250871+0000","last_change":"2024-09-11T00:00:53.263375+0000","last_active":"2024-09-11T00:00:53.263375+0000","last_peered":"2024-09-11T00:00:29.250871+0000","last_clean":"2024-09-11T00:00:29.250871+0000","last_became_active":"2024-09-11T00:00:26.813046+0000","last_became_peered":"2024-09-11T00:00:26.813046+0000","last_unstale":"2024-09-11T00:00:29.250871+0000","last_undegraded":"2024-09-11T00:00:29.250871+0000","last_fullsized":"2024-09-11T00:00:29.250871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.252151+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:00:29.252151+0000","last_peered":"2024-09-11T00:00:29.252151+0000","last_clean":"2024-09-11T00:00:29.252151+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:00:29.252151+0000","last_undegraded":"2024-09-11T00:00:29.252151+0000","last_fullsized":"2024-09-11T00:00:29.252151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.250127+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:29.250127+0000","last_peered":"2024-09-11T00:00:29.250127+0000","last_clean":"2024-09-11T00:00:29.250127+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:29.250127+0000","last_undegraded":"2024-09-11T00:00:29.250127+0000","last_fullsized":"2024-09-11T00:00:29.250127+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606188+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:52.606188+0000","last_peered":"2024-09-11T00:00:52.606188+0000","last_clean":"2024-09-11T00:00:52.606188+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:52.606188+0000","last_undegraded":"2024-09-11T00:00:52.606188+0000","last_fullsized":"2024-09-11T00:00:52.606188+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697601+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:00:53.697601+0000","last_peered":"2024-09-11T00:00:53.697601+0000","last_clean":"2024-09-11T00:00:53.697601+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:00:53.697601+0000","last_undegraded":"2024-09-11T00:00:53.697601+0000","last_fullsized":"2024-09-11T00:00:53.697601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.299439+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:38.299439+0000","last_peered":"2024-09-11T00:00:38.299439+0000","last_clean":"2024-09-11T00:00:38.299439+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:38.299439+0000","last_undegraded":"2024-09-11T00:00:38.299439+0000","last_fullsized":"2024-09-11T00:00:38.299439+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607136+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:00:53.607136+0000","last_peered":"2024-09-11T00:00:53.607136+0000","last_clean":"2024-09-11T00:00:53.607136+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:00:53.607136+0000","last_undegraded":"2024-09-11T00:00:53.607136+0000","last_fullsized":"2024-09-11T00:00:53.607136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608332+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:00:53.608332+0000","last_peered":"2024-09-11T00:00:53.608332+0000","last_clean":"2024-09-11T00:00:53.608332+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:00:53.608332+0000","last_undegraded":"2024-09-11T00:00:53.608332+0000","last_fullsized":"2024-09-11T00:00:53.608332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251106+0000","last_change":"2024-09-11T00:00:28.250566+0000","last_active":"2024-09-11T00:00:29.251106+0000","last_peered":"2024-09-11T00:00:29.251106+0000","last_clean":"2024-09-11T00:00:29.251106+0000","last_became_active":"2024-09-11T00:00:28.250064+0000","last_became_peered":"2024-09-11T00:00:28.250064+0000","last_unstale":"2024-09-11T00:00:29.251106+0000","last_undegraded":"2024-09-11T00:00:29.251106+0000","last_fullsized":"2024-09-11T00:00:29.251106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:18.453617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251915+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:29.251915+0000","last_peered":"2024-09-11T00:00:29.251915+0000","last_clean":"2024-09-11T00:00:29.251915+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:29.251915+0000","last_undegraded":"2024-09-11T00:00:29.251915+0000","last_fullsized":"2024-09-11T00:00:29.251915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237537+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:00:29.237537+0000","last_peered":"2024-09-11T00:00:29.237537+0000","last_clean":"2024-09-11T00:00:29.237537+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:00:29.237537+0000","last_undegraded":"2024-09-11T00:00:29.237537+0000","last_fullsized":"2024-09-11T00:00:29.237537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.237000+0000","last_change":"2024-09-11T00:00:26.305312+0000","last_active":"2024-09-11T00:00:29.237000+0000","last_peered":"2024-09-11T00:00:29.237000+0000","last_clean":"2024-09-11T00:00:29.237000+0000","last_became_active":"2024-09-11T00:00:26.305002+0000","last_became_peered":"2024-09-11T00:00:26.305002+0000","last_unstale":"2024-09-11T00:00:29.237000+0000","last_undegraded":"2024-09-11T00:00:29.237000+0000","last_fullsized":"2024-09-11T00:00:29.237000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:16.586179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:32.135198+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:00:32.135198+0000","last_peered":"2024-09-11T00:00:32.135198+0000","last_clean":"2024-09-11T00:00:32.135198+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:00:32.135198+0000","last_undegraded":"2024-09-11T00:00:32.135198+0000","last_fullsized":"2024-09-11T00:00:32.135198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607608+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:00:53.607608+0000","last_peered":"2024-09-11T00:00:53.607608+0000","last_clean":"2024-09-11T00:00:53.607608+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:00:53.607608+0000","last_undegraded":"2024-09-11T00:00:53.607608+0000","last_fullsized":"2024-09-11T00:00:53.607608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:49.249890+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:00:49.249890+0000","last_peered":"2024-09-11T00:00:49.249890+0000","last_clean":"2024-09-11T00:00:49.249890+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:00:49.249890+0000","last_undegraded":"2024-09-11T00:00:49.249890+0000","last_fullsized":"2024-09-11T00:00:49.249890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697866+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:00:53.697866+0000","last_peered":"2024-09-11T00:00:53.697866+0000","last_clean":"2024-09-11T00:00:53.697866+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:00:53.697866+0000","last_undegraded":"2024-09-11T00:00:53.697866+0000","last_fullsized":"2024-09-11T00:00:53.697866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.606708+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:52.606708+0000","last_peered":"2024-09-11T00:00:52.606708+0000","last_clean":"2024-09-11T00:00:52.606708+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:52.606708+0000","last_undegraded":"2024-09-11T00:00:52.606708+0000","last_fullsized":"2024-09-11T00:00:52.606708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607896+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:00:53.607896+0000","last_peered":"2024-09-11T00:00:53.607896+0000","last_clean":"2024-09-11T00:00:53.607896+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:00:53.607896+0000","last_undegraded":"2024-09-11T00:00:53.607896+0000","last_fullsized":"2024-09-11T00:00:53.607896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607559+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:00:53.607559+0000","last_peered":"2024-09-11T00:00:53.607559+0000","last_clean":"2024-09-11T00:00:53.607559+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:00:53.607559+0000","last_undegraded":"2024-09-11T00:00:53.607559+0000","last_fullsized":"2024-09-11T00:00:53.607559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.235378+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:00:29.235378+0000","last_peered":"2024-09-11T00:00:29.235378+0000","last_clean":"2024-09-11T00:00:29.235378+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:00:29.235378+0000","last_undegraded":"2024-09-11T00:00:29.235378+0000","last_fullsized":"2024-09-11T00:00:29.235378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697657+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:00:53.697657+0000","last_peered":"2024-09-11T00:00:53.697657+0000","last_clean":"2024-09-11T00:00:53.697657+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:00:53.697657+0000","last_undegraded":"2024-09-11T00:00:53.697657+0000","last_fullsized":"2024-09-11T00:00:53.697657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:29.251008+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:00:29.251008+0000","last_peered":"2024-09-11T00:00:29.251008+0000","last_clean":"2024-09-11T00:00:29.251008+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:00:29.251008+0000","last_undegraded":"2024-09-11T00:00:29.251008+0000","last_fullsized":"2024-09-11T00:00:29.251008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:00:52.608973+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:00:52.608973+0000","last_peered":"2024-09-11T00:00:52.608973+0000","last_clean":"2024-09-11T00:00:52.608973+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:00:52.608973+0000","last_undegraded":"2024-09-11T00:00:52.608973+0000","last_fullsized":"2024-09-11T00:00:52.608973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697588+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:00:53.697588+0000","last_peered":"2024-09-11T00:00:53.697588+0000","last_clean":"2024-09-11T00:00:53.697588+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:00:53.697588+0000","last_undegraded":"2024-09-11T00:00:53.697588+0000","last_fullsized":"2024-09-11T00:00:53.697588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608277+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:00:53.608277+0000","last_peered":"2024-09-11T00:00:53.608277+0000","last_clean":"2024-09-11T00:00:53.608277+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:00:53.608277+0000","last_undegraded":"2024-09-11T00:00:53.608277+0000","last_fullsized":"2024-09-11T00:00:53.608277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697953+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697953+0000","last_peered":"2024-09-11T00:00:53.697953+0000","last_clean":"2024-09-11T00:00:53.697953+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697953+0000","last_undegraded":"2024-09-11T00:00:53.697953+0000","last_fullsized":"2024-09-11T00:00:53.697953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697819+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:00:53.697819+0000","last_peered":"2024-09-11T00:00:53.697819+0000","last_clean":"2024-09-11T00:00:53.697819+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:00:53.697819+0000","last_undegraded":"2024-09-11T00:00:53.697819+0000","last_fullsized":"2024-09-11T00:00:53.697819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T00:00:38.300062+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:38.300062+0000","last_peered":"2024-09-11T00:00:38.300062+0000","last_clean":"2024-09-11T00:00:38.300062+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:38.300062+0000","last_undegraded":"2024-09-11T00:00:38.300062+0000","last_fullsized":"2024-09-11T00:00:38.300062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50801,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":107,"num_read_kb":108,"num_write":149,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":168103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710738,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":819200,"data_stored":404601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1043273,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":404837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":996687,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":1004780,"data_compressed":38741,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":405054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378689,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":477184,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":468264,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:00:57.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:00:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:57 smithi135 ceph-mon[35432]: pgmap v278: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2024-09-11T00:00:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:57 smithi135 ceph-mon[35432]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:00:58.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:57 smithi131 ceph-mon[35491]: pgmap v278: 97 pgs: 2 peering, 95 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2024-09-11T00:00:58.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:57 smithi131 ceph-mon[35491]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:00:58.122 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.596+0000 7fa1cc72a640 1 -- 172.21.15.19:0/2538509817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4104570 msgr2=0x7fa1c410cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.596+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/2538509817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4104570 0x7fa1c410cb50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009900 tx=0x7fa1b802a410 comp rx=0 tx=0).stop 2024-09-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 -- 172.21.15.19:0/2538509817 shutdown_connections 2024-09-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/2538509817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c410d120 0x7fa1c410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/2538509817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4104570 0x7fa1c410cb50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/2538509817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4103b70 0x7fa1c4103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 -- 172.21.15.19:0/2538509817 >> 172.21.15.19:0/2538509817 conn(0x7fa1c40fd700 msgr2=0x7fa1c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 -- 172.21.15.19:0/2538509817 shutdown_connections 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 -- 172.21.15.19:0/2538509817 wait complete. 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 Processor -- start 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.597+0000 7fa1cc72a640 1 -- start start 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cc72a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4103b70 0x7fa1c4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cc72a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4104570 0x7fa1c4199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cc72a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c410d120 0x7fa1c419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cc72a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112df0 con 0x7fa1c4103b70 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cc72a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112c70 con 0x7fa1c410d120 2024-09-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cc72a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112f70 con 0x7fa1c4104570 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4103b70 0x7fa1c4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4103b70 0x7fa1c4199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49048/0 (socket says 172.21.15.19:49048) 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 -- 172.21.15.19:0/3191851401 learned_addr learned my addr 172.21.15.19:0/3191851401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1c9cc5640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4104570 0x7fa1c4199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cacc7640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c410d120 0x7fa1c419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 -- 172.21.15.19:0/3191851401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4104570 msgr2=0x7fa1c4199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4104570 0x7fa1c4199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 -- 172.21.15.19:0/3191851401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c410d120 msgr2=0x7fa1c419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c410d120 0x7fa1c419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 -- 172.21.15.19:0/3191851401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c419f3d0 con 0x7fa1c4103b70 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1cacc7640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c410d120 0x7fa1c419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1ca4c6640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4103b70 0x7fa1c4199320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400eab0 tx=0x7fa1b400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.598+0000 7fa1c37fe640 1 -- 172.21.15.19:0/3191851401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400ce40 con 0x7fa1c4103b70 2024-09-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.599+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c419f6c0 con 0x7fa1c4103b70 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.599+0000 7fa1c37fe640 1 -- 172.21.15.19:0/3191851401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1b4011920 con 0x7fa1c4103b70 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.599+0000 7fa1c37fe640 1 -- 172.21.15.19:0/3191851401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4010a30 con 0x7fa1c4103b70 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.599+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c41a5f50 con 0x7fa1c4103b70 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.600+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c4103f50 con 0x7fa1c4103b70 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.601+0000 7fa1c37fe640 1 -- 172.21.15.19:0/3191851401 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa1b400f040 con 0x7fa1c4103b70 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.603+0000 7fa1c37fe640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1ac0b53c0 0x7fa1ac0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.603+0000 7fa1c9cc5640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1ac0b53c0 0x7fa1ac0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.603+0000 7fa1c37fe640 1 -- 172.21.15.19:0/3191851401 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa1b40e60d0 con 0x7fa1c4103b70 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.603+0000 7fa1c9cc5640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1ac0b53c0 0x7fa1ac0b7880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005ab0 tx=0x7fa1b8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.605+0000 7fa1c37fe640 1 -- 172.21.15.19:0/3191851401 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa1b4016030 con 0x7fa1c4103b70 2024-09-11T00:00:58.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.789+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1c41081f0 con 0x7fa1ac0b53c0 2024-09-11T00:00:58.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.793+0000 7fa1c37fe640 1 -- 172.21.15.19:0/3191851401 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258984 (secure 0 0 0) 0x7fa1c41081f0 con 0x7fa1ac0b53c0 2024-09-11T00:00:58.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:00:58.797 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.797+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1ac0b53c0 msgr2=0x7fa1ac0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.797+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1ac0b53c0 0x7fa1ac0b7880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005ab0 tx=0x7fa1b8005a20 comp rx=0 tx=0).stop 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.797+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4103b70 msgr2=0x7fa1c4199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.797+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4103b70 0x7fa1c4199320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400eab0 tx=0x7fa1b400ef70 comp rx=0 tx=0).stop 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.797+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 shutdown_connections 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.797+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c410d120 0x7fa1c419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.798+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4104570 0x7fa1c4199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.798+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1ac0b53c0 0x7fa1ac0b7880 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.798+0000 7fa1cc72a640 1 --2- 172.21.15.19:0/3191851401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1c4103b70 0x7fa1c4199320 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:58.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.798+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 >> 172.21.15.19:0/3191851401 conn(0x7fa1c40fd700 msgr2=0x7fa1c40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:58.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.798+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 shutdown_connections 2024-09-11T00:00:58.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:00:58.798+0000 7fa1cc72a640 1 -- 172.21.15.19:0/3191851401 wait complete. 2024-09-11T00:00:59.606 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-11T00:00:58.493611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649555,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":213,"num_read_kb":194,"num_write":283,"num_write_kb":2254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363872,"kb_used_data":10396,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577952,"statfs":{"total":1151940427776,"available":1151567822848,"internally_reserved":0,"allocated":10645504,"data_stored":6998081,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32739,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":21,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610528+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:00:53.610528+0000","last_peered":"2024-09-11T00:00:53.610528+0000","last_clean":"2024-09-11T00:00:53.610528+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:00:53.610528+0000","last_undegraded":"2024-09-11T00:00:53.610528+0000","last_fullsized":"2024-09-11T00:00:53.610528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607796+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:00:53.607796+0000","last_peered":"2024-09-11T00:00:53.607796+0000","last_clean":"2024-09-11T00:00:53.607796+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:00:53.607796+0000","last_undegraded":"2024-09-11T00:00:53.607796+0000","last_fullsized":"2024-09-11T00:00:53.607796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607548+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:00:53.607548+0000","last_peered":"2024-09-11T00:00:53.607548+0000","last_clean":"2024-09-11T00:00:53.607548+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:00:53.607548+0000","last_undegraded":"2024-09-11T00:00:53.607548+0000","last_fullsized":"2024-09-11T00:00:53.607548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:00:53.605506+0000","last_peered":"2024-09-11T00:00:53.605506+0000","last_clean":"2024-09-11T00:00:53.605506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:00:53.605506+0000","last_undegraded":"2024-09-11T00:00:53.605506+0000","last_fullsized":"2024-09-11T00:00:53.605506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607907+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:00:53.607907+0000","last_peered":"2024-09-11T00:00:53.607907+0000","last_clean":"2024-09-11T00:00:53.607907+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:00:53.607907+0000","last_undegraded":"2024-09-11T00:00:53.607907+0000","last_fullsized":"2024-09-11T00:00:53.607907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697868+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:00:53.697868+0000","last_peered":"2024-09-11T00:00:53.697868+0000","last_clean":"2024-09-11T00:00:53.697868+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:00:53.697868+0000","last_undegraded":"2024-09-11T00:00:53.697868+0000","last_fullsized":"2024-09-11T00:00:53.697868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607284+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:00:53.607284+0000","last_peered":"2024-09-11T00:00:53.607284+0000","last_clean":"2024-09-11T00:00:53.607284+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:00:53.607284+0000","last_undegraded":"2024-09-11T00:00:53.607284+0000","last_fullsized":"2024-09-11T00:00:53.607284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697403+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:00:53.697403+0000","last_peered":"2024-09-11T00:00:53.697403+0000","last_clean":"2024-09-11T00:00:53.697403+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:00:53.697403+0000","last_undegraded":"2024-09-11T00:00:53.697403+0000","last_fullsized":"2024-09-11T00:00:53.697403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698427+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:00:53.698427+0000","last_peered":"2024-09-11T00:00:53.698427+0000","last_clean":"2024-09-11T00:00:53.698427+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:00:53.698427+0000","last_undegraded":"2024-09-11T00:00:53.698427+0000","last_fullsized":"2024-09-11T00:00:53.698427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698160+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:00:53.698160+0000","last_peered":"2024-09-11T00:00:53.698160+0000","last_clean":"2024-09-11T00:00:53.698160+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:00:53.698160+0000","last_undegraded":"2024-09-11T00:00:53.698160+0000","last_fullsized":"2024-09-11T00:00:53.698160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607338+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:00:53.607338+0000","last_peered":"2024-09-11T00:00:53.607338+0000","last_clean":"2024-09-11T00:00:53.607338+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:00:53.607338+0000","last_undegraded":"2024-09-11T00:00:53.607338+0000","last_fullsized":"2024-09-11T00:00:53.607338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605630+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:00:53.605630+0000","last_peered":"2024-09-11T00:00:53.605630+0000","last_clean":"2024-09-11T00:00:53.605630+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:00:53.605630+0000","last_undegraded":"2024-09-11T00:00:53.605630+0000","last_fullsized":"2024-09-11T00:00:53.605630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608293+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:00:53.608293+0000","last_peered":"2024-09-11T00:00:53.608293+0000","last_clean":"2024-09-11T00:00:53.608293+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:00:53.608293+0000","last_undegraded":"2024-09-11T00:00:53.608293+0000","last_fullsized":"2024-09-11T00:00:53.608293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607421+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:00:53.607421+0000","last_peered":"2024-09-11T00:00:53.607421+0000","last_clean":"2024-09-11T00:00:53.607421+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:00:53.607421+0000","last_undegraded":"2024-09-11T00:00:53.607421+0000","last_fullsized":"2024-09-11T00:00:53.607421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607980+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:00:53.607980+0000","last_peered":"2024-09-11T00:00:53.607980+0000","last_clean":"2024-09-11T00:00:53.607980+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:00:53.607980+0000","last_undegraded":"2024-09-11T00:00:53.607980+0000","last_fullsized":"2024-09-11T00:00:53.607980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697447+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:00:53.697447+0000","last_peered":"2024-09-11T00:00:53.697447+0000","last_clean":"2024-09-11T00:00:53.697447+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:00:53.697447+0000","last_undegraded":"2024-09-11T00:00:53.697447+0000","last_fullsized":"2024-09-11T00:00:53.697447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610581+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:00:53.610581+0000","last_peered":"2024-09-11T00:00:53.610581+0000","last_clean":"2024-09-11T00:00:53.610581+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:00:53.610581+0000","last_undegraded":"2024-09-11T00:00:53.610581+0000","last_fullsized":"2024-09-11T00:00:53.610581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604702+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:00:53.604702+0000","last_peered":"2024-09-11T00:00:53.604702+0000","last_clean":"2024-09-11T00:00:53.604702+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:00:53.604702+0000","last_undegraded":"2024-09-11T00:00:53.604702+0000","last_fullsized":"2024-09-11T00:00:53.604702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608539+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:00:53.608539+0000","last_peered":"2024-09-11T00:00:53.608539+0000","last_clean":"2024-09-11T00:00:53.608539+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:00:53.608539+0000","last_undegraded":"2024-09-11T00:00:53.608539+0000","last_fullsized":"2024-09-11T00:00:53.608539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609167+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:00:53.609167+0000","last_peered":"2024-09-11T00:00:53.609167+0000","last_clean":"2024-09-11T00:00:53.609167+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:00:53.609167+0000","last_undegraded":"2024-09-11T00:00:53.609167+0000","last_fullsized":"2024-09-11T00:00:53.609167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608387+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:00:53.608387+0000","last_peered":"2024-09-11T00:00:53.608387+0000","last_clean":"2024-09-11T00:00:53.608387+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:00:53.608387+0000","last_undegraded":"2024-09-11T00:00:53.608387+0000","last_fullsized":"2024-09-11T00:00:53.608387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697829+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:00:53.697829+0000","last_peered":"2024-09-11T00:00:53.697829+0000","last_clean":"2024-09-11T00:00:53.697829+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:00:53.697829+0000","last_undegraded":"2024-09-11T00:00:53.697829+0000","last_fullsized":"2024-09-11T00:00:53.697829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697440+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:00:53.697440+0000","last_peered":"2024-09-11T00:00:53.697440+0000","last_clean":"2024-09-11T00:00:53.697440+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:00:53.697440+0000","last_undegraded":"2024-09-11T00:00:53.697440+0000","last_fullsized":"2024-09-11T00:00:53.697440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609524+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:00:53.609524+0000","last_peered":"2024-09-11T00:00:53.609524+0000","last_clean":"2024-09-11T00:00:53.609524+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:00:53.609524+0000","last_undegraded":"2024-09-11T00:00:53.609524+0000","last_fullsized":"2024-09-11T00:00:53.609524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697755+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:00:53.697755+0000","last_peered":"2024-09-11T00:00:53.697755+0000","last_clean":"2024-09-11T00:00:53.697755+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:00:53.697755+0000","last_undegraded":"2024-09-11T00:00:53.697755+0000","last_fullsized":"2024-09-11T00:00:53.697755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608401+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:00:53.608401+0000","last_peered":"2024-09-11T00:00:53.608401+0000","last_clean":"2024-09-11T00:00:53.608401+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:00:53.608401+0000","last_undegraded":"2024-09-11T00:00:53.608401+0000","last_fullsized":"2024-09-11T00:00:53.608401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609403+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:00:53.609403+0000","last_peered":"2024-09-11T00:00:53.609403+0000","last_clean":"2024-09-11T00:00:53.609403+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:00:53.609403+0000","last_undegraded":"2024-09-11T00:00:53.609403+0000","last_fullsized":"2024-09-11T00:00:53.609403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610028+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:00:53.610028+0000","last_peered":"2024-09-11T00:00:53.610028+0000","last_clean":"2024-09-11T00:00:53.610028+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:00:53.610028+0000","last_undegraded":"2024-09-11T00:00:53.610028+0000","last_fullsized":"2024-09-11T00:00:53.610028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608648+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:00:53.608648+0000","last_peered":"2024-09-11T00:00:53.608648+0000","last_clean":"2024-09-11T00:00:53.608648+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:00:53.608648+0000","last_undegraded":"2024-09-11T00:00:53.608648+0000","last_fullsized":"2024-09-11T00:00:53.608648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608123+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:00:53.608123+0000","last_peered":"2024-09-11T00:00:53.608123+0000","last_clean":"2024-09-11T00:00:53.608123+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:00:53.608123+0000","last_undegraded":"2024-09-11T00:00:53.608123+0000","last_fullsized":"2024-09-11T00:00:53.608123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607903+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:00:53.607903+0000","last_peered":"2024-09-11T00:00:53.607903+0000","last_clean":"2024-09-11T00:00:53.607903+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:00:53.607903+0000","last_undegraded":"2024-09-11T00:00:53.607903+0000","last_fullsized":"2024-09-11T00:00:53.607903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607733+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:00:53.607733+0000","last_peered":"2024-09-11T00:00:53.607733+0000","last_clean":"2024-09-11T00:00:53.607733+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:00:53.607733+0000","last_undegraded":"2024-09-11T00:00:53.607733+0000","last_fullsized":"2024-09-11T00:00:53.607733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608446+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:00:53.608446+0000","last_peered":"2024-09-11T00:00:53.608446+0000","last_clean":"2024-09-11T00:00:53.608446+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:00:53.608446+0000","last_undegraded":"2024-09-11T00:00:53.608446+0000","last_fullsized":"2024-09-11T00:00:53.608446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":49,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:56.332885+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:00:56.332885+0000","last_peered":"2024-09-11T00:00:56.332885+0000","last_clean":"2024-09-11T00:00:56.332885+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:00:56.332885+0000","last_undegraded":"2024-09-11T00:00:56.332885+0000","last_fullsized":"2024-09-11T00:00:56.332885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609036+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:00:53.609036+0000","last_peered":"2024-09-11T00:00:53.609036+0000","last_clean":"2024-09-11T00:00:53.609036+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:00:53.609036+0000","last_undegraded":"2024-09-11T00:00:53.609036+0000","last_fullsized":"2024-09-11T00:00:53.609036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697456+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:00:53.697456+0000","last_peered":"2024-09-11T00:00:53.697456+0000","last_clean":"2024-09-11T00:00:53.697456+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:00:53.697456+0000","last_undegraded":"2024-09-11T00:00:53.697456+0000","last_fullsized":"2024-09-11T00:00:53.697456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604331+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:00:53.604331+0000","last_peered":"2024-09-11T00:00:53.604331+0000","last_clean":"2024-09-11T00:00:53.604331+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:00:53.604331+0000","last_undegraded":"2024-09-11T00:00:53.604331+0000","last_fullsized":"2024-09-11T00:00:53.604331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:55.330741+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:00:55.330741+0000","last_peered":"2024-09-11T00:00:55.330741+0000","last_clean":"2024-09-11T00:00:55.330741+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:00:55.330741+0000","last_undegraded":"2024-09-11T00:00:55.330741+0000","last_fullsized":"2024-09-11T00:00:55.330741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697914+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:00:53.697914+0000","last_peered":"2024-09-11T00:00:53.697914+0000","last_clean":"2024-09-11T00:00:53.697914+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:00:53.697914+0000","last_undegraded":"2024-09-11T00:00:53.697914+0000","last_fullsized":"2024-09-11T00:00:53.697914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608380+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:00:53.608380+0000","last_peered":"2024-09-11T00:00:53.608380+0000","last_clean":"2024-09-11T00:00:53.608380+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:00:53.608380+0000","last_undegraded":"2024-09-11T00:00:53.608380+0000","last_fullsized":"2024-09-11T00:00:53.608380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697945+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:00:53.697945+0000","last_peered":"2024-09-11T00:00:53.697945+0000","last_clean":"2024-09-11T00:00:53.697945+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:00:53.697945+0000","last_undegraded":"2024-09-11T00:00:53.697945+0000","last_fullsized":"2024-09-11T00:00:53.697945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'25","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:56.334364+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:00:56.334364+0000","last_peered":"2024-09-11T00:00:56.334364+0000","last_clean":"2024-09-11T00:00:56.334364+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:00:56.334364+0000","last_undegraded":"2024-09-11T00:00:56.334364+0000","last_fullsized":"2024-09-11T00:00:56.334364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54952,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":74,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608809+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:00:53.608809+0000","last_peered":"2024-09-11T00:00:53.608809+0000","last_clean":"2024-09-11T00:00:53.608809+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:00:53.608809+0000","last_undegraded":"2024-09-11T00:00:53.608809+0000","last_fullsized":"2024-09-11T00:00:53.608809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607445+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:00:53.607445+0000","last_peered":"2024-09-11T00:00:53.607445+0000","last_clean":"2024-09-11T00:00:53.607445+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:00:53.607445+0000","last_undegraded":"2024-09-11T00:00:53.607445+0000","last_fullsized":"2024-09-11T00:00:53.607445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610837+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:00:53.610837+0000","last_peered":"2024-09-11T00:00:53.610837+0000","last_clean":"2024-09-11T00:00:53.610837+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:00:53.610837+0000","last_undegraded":"2024-09-11T00:00:53.610837+0000","last_fullsized":"2024-09-11T00:00:53.610837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":49,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:56.333776+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:00:56.333776+0000","last_peered":"2024-09-11T00:00:56.333776+0000","last_clean":"2024-09-11T00:00:56.333776+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:00:56.333776+0000","last_undegraded":"2024-09-11T00:00:56.333776+0000","last_fullsized":"2024-09-11T00:00:56.333776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607094+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:00:53.607094+0000","last_peered":"2024-09-11T00:00:53.607094+0000","last_clean":"2024-09-11T00:00:53.607094+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:00:53.607094+0000","last_undegraded":"2024-09-11T00:00:53.607094+0000","last_fullsized":"2024-09-11T00:00:53.607094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.699247+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:00:53.699247+0000","last_peered":"2024-09-11T00:00:53.699247+0000","last_clean":"2024-09-11T00:00:53.699247+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:00:53.699247+0000","last_undegraded":"2024-09-11T00:00:53.699247+0000","last_fullsized":"2024-09-11T00:00:53.699247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608145+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:00:53.608145+0000","last_peered":"2024-09-11T00:00:53.608145+0000","last_clean":"2024-09-11T00:00:53.608145+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:00:53.608145+0000","last_undegraded":"2024-09-11T00:00:53.608145+0000","last_fullsized":"2024-09-11T00:00:53.608145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607541+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:00:53.607541+0000","last_peered":"2024-09-11T00:00:53.607541+0000","last_clean":"2024-09-11T00:00:53.607541+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:00:53.607541+0000","last_undegraded":"2024-09-11T00:00:53.607541+0000","last_fullsized":"2024-09-11T00:00:53.607541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607290+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:00:53.607290+0000","last_peered":"2024-09-11T00:00:53.607290+0000","last_clean":"2024-09-11T00:00:53.607290+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:00:53.607290+0000","last_undegraded":"2024-09-11T00:00:53.607290+0000","last_fullsized":"2024-09-11T00:00:53.607290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607628+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:00:53.607628+0000","last_peered":"2024-09-11T00:00:53.607628+0000","last_clean":"2024-09-11T00:00:53.607628+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:00:53.607628+0000","last_undegraded":"2024-09-11T00:00:53.607628+0000","last_fullsized":"2024-09-11T00:00:53.607628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607354+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607354+0000","last_peered":"2024-09-11T00:00:53.607354+0000","last_clean":"2024-09-11T00:00:53.607354+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607354+0000","last_undegraded":"2024-09-11T00:00:53.607354+0000","last_fullsized":"2024-09-11T00:00:53.607354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605463+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605463+0000","last_peered":"2024-09-11T00:00:53.605463+0000","last_clean":"2024-09-11T00:00:53.605463+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605463+0000","last_undegraded":"2024-09-11T00:00:53.605463+0000","last_fullsized":"2024-09-11T00:00:53.605463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697601+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:00:53.697601+0000","last_peered":"2024-09-11T00:00:53.697601+0000","last_clean":"2024-09-11T00:00:53.697601+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:00:53.697601+0000","last_undegraded":"2024-09-11T00:00:53.697601+0000","last_fullsized":"2024-09-11T00:00:53.697601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607224+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607224+0000","last_peered":"2024-09-11T00:00:53.607224+0000","last_clean":"2024-09-11T00:00:53.607224+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607224+0000","last_undegraded":"2024-09-11T00:00:53.607224+0000","last_fullsized":"2024-09-11T00:00:53.607224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607136+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:00:53.607136+0000","last_peered":"2024-09-11T00:00:53.607136+0000","last_clean":"2024-09-11T00:00:53.607136+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:00:53.607136+0000","last_undegraded":"2024-09-11T00:00:53.607136+0000","last_fullsized":"2024-09-11T00:00:53.607136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608332+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:00:53.608332+0000","last_peered":"2024-09-11T00:00:53.608332+0000","last_clean":"2024-09-11T00:00:53.608332+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:00:53.608332+0000","last_undegraded":"2024-09-11T00:00:53.608332+0000","last_fullsized":"2024-09-11T00:00:53.608332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612423+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:00:53.612423+0000","last_peered":"2024-09-11T00:00:53.612423+0000","last_clean":"2024-09-11T00:00:53.612423+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:00:53.612423+0000","last_undegraded":"2024-09-11T00:00:53.612423+0000","last_fullsized":"2024-09-11T00:00:53.612423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607808+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607808+0000","last_peered":"2024-09-11T00:00:53.607808+0000","last_clean":"2024-09-11T00:00:53.607808+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607808+0000","last_undegraded":"2024-09-11T00:00:53.607808+0000","last_fullsized":"2024-09-11T00:00:53.607808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697889+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:00:53.697889+0000","last_peered":"2024-09-11T00:00:53.697889+0000","last_clean":"2024-09-11T00:00:53.697889+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:00:53.697889+0000","last_undegraded":"2024-09-11T00:00:53.697889+0000","last_fullsized":"2024-09-11T00:00:53.697889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.611825+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.611825+0000","last_peered":"2024-09-11T00:00:53.611825+0000","last_clean":"2024-09-11T00:00:53.611825+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.611825+0000","last_undegraded":"2024-09-11T00:00:53.611825+0000","last_fullsized":"2024-09-11T00:00:53.611825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697988+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:00:53.697988+0000","last_peered":"2024-09-11T00:00:53.697988+0000","last_clean":"2024-09-11T00:00:53.697988+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:00:53.697988+0000","last_undegraded":"2024-09-11T00:00:53.697988+0000","last_fullsized":"2024-09-11T00:00:53.697988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607608+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:00:53.607608+0000","last_peered":"2024-09-11T00:00:53.607608+0000","last_clean":"2024-09-11T00:00:53.607608+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:00:53.607608+0000","last_undegraded":"2024-09-11T00:00:53.607608+0000","last_fullsized":"2024-09-11T00:00:53.607608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:54.250572+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:00:54.250572+0000","last_peered":"2024-09-11T00:00:54.250572+0000","last_clean":"2024-09-11T00:00:54.250572+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:00:54.250572+0000","last_undegraded":"2024-09-11T00:00:54.250572+0000","last_fullsized":"2024-09-11T00:00:54.250572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697866+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:00:53.697866+0000","last_peered":"2024-09-11T00:00:53.697866+0000","last_clean":"2024-09-11T00:00:53.697866+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:00:53.697866+0000","last_undegraded":"2024-09-11T00:00:53.697866+0000","last_fullsized":"2024-09-11T00:00:53.697866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607896+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:00:53.607896+0000","last_peered":"2024-09-11T00:00:53.607896+0000","last_clean":"2024-09-11T00:00:53.607896+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:00:53.607896+0000","last_undegraded":"2024-09-11T00:00:53.607896+0000","last_fullsized":"2024-09-11T00:00:53.607896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607559+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:00:53.607559+0000","last_peered":"2024-09-11T00:00:53.607559+0000","last_clean":"2024-09-11T00:00:53.607559+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:00:53.607559+0000","last_undegraded":"2024-09-11T00:00:53.607559+0000","last_fullsized":"2024-09-11T00:00:53.607559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607830+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:00:53.607830+0000","last_peered":"2024-09-11T00:00:53.607830+0000","last_clean":"2024-09-11T00:00:53.607830+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:00:53.607830+0000","last_undegraded":"2024-09-11T00:00:53.607830+0000","last_fullsized":"2024-09-11T00:00:53.607830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697657+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:00:53.697657+0000","last_peered":"2024-09-11T00:00:53.697657+0000","last_clean":"2024-09-11T00:00:53.697657+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:00:53.697657+0000","last_undegraded":"2024-09-11T00:00:53.697657+0000","last_fullsized":"2024-09-11T00:00:53.697657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607530+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:00:53.607530+0000","last_peered":"2024-09-11T00:00:53.607530+0000","last_clean":"2024-09-11T00:00:53.607530+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:00:53.607530+0000","last_undegraded":"2024-09-11T00:00:53.607530+0000","last_fullsized":"2024-09-11T00:00:53.607530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609349+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:00:53.609349+0000","last_peered":"2024-09-11T00:00:53.609349+0000","last_clean":"2024-09-11T00:00:53.609349+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:00:53.609349+0000","last_undegraded":"2024-09-11T00:00:53.609349+0000","last_fullsized":"2024-09-11T00:00:53.609349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697588+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:00:53.697588+0000","last_peered":"2024-09-11T00:00:53.697588+0000","last_clean":"2024-09-11T00:00:53.697588+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:00:53.697588+0000","last_undegraded":"2024-09-11T00:00:53.697588+0000","last_fullsized":"2024-09-11T00:00:53.697588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608277+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:00:53.608277+0000","last_peered":"2024-09-11T00:00:53.608277+0000","last_clean":"2024-09-11T00:00:53.608277+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:00:53.608277+0000","last_undegraded":"2024-09-11T00:00:53.608277+0000","last_fullsized":"2024-09-11T00:00:53.608277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697953+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697953+0000","last_peered":"2024-09-11T00:00:53.697953+0000","last_clean":"2024-09-11T00:00:53.697953+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697953+0000","last_undegraded":"2024-09-11T00:00:53.697953+0000","last_fullsized":"2024-09-11T00:00:53.697953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697819+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:00:53.697819+0000","last_peered":"2024-09-11T00:00:53.697819+0000","last_clean":"2024-09-11T00:00:53.697819+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:00:53.697819+0000","last_undegraded":"2024-09-11T00:00:53.697819+0000","last_fullsized":"2024-09-11T00:00:53.697819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604729+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604729+0000","last_peered":"2024-09-11T00:00:53.604729+0000","last_clean":"2024-09-11T00:00:53.604729+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604729+0000","last_undegraded":"2024-09-11T00:00:53.604729+0000","last_fullsized":"2024-09-11T00:00:53.604729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58953,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":158,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":176859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710739,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1068870,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070493,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":1014132,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":1013425,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":423081,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378689,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":477184,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":468264,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:00:59.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph status --format=json 2024-09-11T00:00:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:59 smithi135 ceph-mon[35432]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.9 KiB/s wr, 9 op/s; 75 B/s, 0 objects/s recovering 2024-09-11T00:00:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:00:59 smithi135 ceph-mon[35432]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:00:59.994 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:59 smithi019 ceph-mon[30859]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.9 KiB/s wr, 9 op/s; 75 B/s, 0 objects/s recovering 2024-09-11T00:00:59.994 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:00:59 smithi019 ceph-mon[30859]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:59 smithi131 ceph-mon[35491]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.9 KiB/s wr, 9 op/s; 75 B/s, 0 objects/s recovering 2024-09-11T00:01:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:00:59 smithi131 ceph-mon[35491]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:00.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 -- 172.21.15.19:0/2728660212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 msgr2=0x7f4e301031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/2728660212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e301031a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009ca0 tx=0x7f4e2802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 -- 172.21.15.19:0/2728660212 shutdown_connections 2024-09-11T00:01:00.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/2728660212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30109150 0x7f4e3010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/2728660212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e301087d0 0x7f4e30108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/2728660212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e301031a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 -- 172.21.15.19:0/2728660212 >> 172.21.15.19:0/2728660212 conn(0x7f4e300fe830 msgr2=0x7f4e30100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 -- 172.21.15.19:0/2728660212 shutdown_connections 2024-09-11T00:01:00.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.347+0000 7f4e34ea7640 1 -- 172.21.15.19:0/2728660212 wait complete. 2024-09-11T00:01:00.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 Processor -- start 2024-09-11T00:01:00.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 -- start start 2024-09-11T00:01:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e30199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e301087d0 0x7f4e30199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30109150 0x7f4e3019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4e30112e10 con 0x7f4e30102dc0 2024-09-11T00:01:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4e30112c90 con 0x7f4e301087d0 2024-09-11T00:01:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e34ea7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e30112f90 con 0x7f4e30109150 2024-09-11T00:01:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e2e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e30199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e2e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e30199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49066/0 (socket says 172.21.15.19:49066) 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e2e59c640 1 -- 172.21.15.19:0/724494685 learned_addr learned my addr 172.21.15.19:0/724494685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.348+0000 7f4e2dd9b640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e301087d0 0x7f4e30199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e2ed9d640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30109150 0x7f4e3019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e2e59c640 1 -- 172.21.15.19:0/724494685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30109150 msgr2=0x7f4e3019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e2e59c640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30109150 0x7f4e3019ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e2e59c640 1 -- 172.21.15.19:0/724494685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e301087d0 msgr2=0x7f4e30199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e2e59c640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e301087d0 0x7f4e30199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e2e59c640 1 -- 172.21.15.19:0/724494685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3019f3d0 con 0x7f4e30102dc0 2024-09-11T00:01:00.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e2e59c640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e30199320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4e28006010 tx=0x7f4e280319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e277fe640 1 -- 172.21.15.19:0/724494685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28003bf0 con 0x7f4e30102dc0 2024-09-11T00:01:00.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e277fe640 1 -- 172.21.15.19:0/724494685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e28003d90 con 0x7f4e30102dc0 2024-09-11T00:01:00.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3019f660 con 0x7f4e30102dc0 2024-09-11T00:01:00.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e277fe640 1 -- 172.21.15.19:0/724494685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2802fc20 con 0x7f4e30102dc0 2024-09-11T00:01:00.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.349+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e301a5e00 con 0x7f4e30102dc0 2024-09-11T00:01:00.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.350+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e301031a0 con 0x7f4e30102dc0 2024-09-11T00:01:00.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.351+0000 7f4e277fe640 1 -- 172.21.15.19:0/724494685 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f4e280046a0 con 0x7f4e30102dc0 2024-09-11T00:01:00.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.352+0000 7f4e277fe640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4e1c0b53c0 0x7f4e1c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.352+0000 7f4e2dd9b640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4e1c0b53c0 0x7f4e1c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.353+0000 7f4e277fe640 1 -- 172.21.15.19:0/724494685 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f4e28107320 con 0x7f4e30102dc0 2024-09-11T00:01:00.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.353+0000 7f4e2dd9b640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4e1c0b53c0 0x7f4e1c0b7880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e301021c0 tx=0x7f4e1800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.355+0000 7f4e277fe640 1 -- 172.21.15.19:0/724494685 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4e280cdfe0 con 0x7f4e30102dc0 2024-09-11T00:01:00.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.613+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4e3002e5c0 con 0x7f4e30102dc0 2024-09-11T00:01:00.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.613+0000 7f4e277fe640 1 -- 172.21.15.19:0/724494685 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2909 (secure 0 0 0) 0x7f4e280cd8e0 con 0x7f4e30102dc0 2024-09-11T00:01:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:00.615 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":438,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1726012776,"num_in_osds":12,"osd_in_since":1726012753,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":64,"data_bytes":649555,"bytes_used":372604928,"bytes_avail":1151567822848,"bytes_total":1151940427776,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":75,"recovering_keys_per_sec":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"read_bytes_sec":7166,"write_bytes_sec":4990,"read_op_per_sec":6,"write_op_per_sec":2},"fsmap":{"epoch":24,"btime":"2024-09-11T00:00:41:297551+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"l","status":"up:standby-replay","gid":24565},{"filesystem_id":1,"rank":1,"name":"h","status":"up:standby-replay","gid":24578},{"filesystem_id":1,"rank":0,"name":"f","status":"up:standby-replay","gid":24598},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24604},{"filesystem_id":1,"rank":1,"name":"b","status":"up:active","gid":24605},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24625}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"services":{"dashboard":"https://172.21.15.19:8443/"}},"servicemap":{"epoch":19,"modified":"2024-09-11T00:00:58.493971+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T00:01:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4e1c0b53c0 msgr2=0x7f4e1c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4e1c0b53c0 0x7f4e1c0b7880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e301021c0 tx=0x7f4e1800b390 comp rx=0 tx=0).stop 2024-09-11T00:01:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 msgr2=0x7f4e30199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e30199320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4e28006010 tx=0x7f4e280319f0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 shutdown_connections 2024-09-11T00:01:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30109150 0x7f4e3019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e301087d0 0x7f4e30199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4e1c0b53c0 0x7f4e1c0b7880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 --2- 172.21.15.19:0/724494685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e30102dc0 0x7f4e30199320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 >> 172.21.15.19:0/724494685 conn(0x7f4e300fe830 msgr2=0x7f4e30100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 shutdown_connections 2024-09-11T00:01:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:00.616+0000 7f4e34ea7640 1 -- 172.21.15.19:0/724494685 wait complete. 2024-09-11T00:01:00.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:00 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/724494685' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-11T00:01:00.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:00 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/724494685' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-11T00:01:01.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:00 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/724494685' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-11T00:01:01.443 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-09-11T00:01:01.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:01:01.666 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:01 smithi019 ceph-mon[30859]: pgmap v280: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 75 B/s, 0 objects/s recovering 2024-09-11T00:01:01.710 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:01.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:01 smithi131 ceph-mon[35491]: pgmap v280: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 75 B/s, 0 objects/s recovering 2024-09-11T00:01:01.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:01 smithi135 ceph-mon[35432]: pgmap v280: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 75 B/s, 0 objects/s recovering 2024-09-11T00:01:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 -- 172.21.15.19:0/960791500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4102dc0 msgr2=0x7f5ef41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 --2- 172.21.15.19:0/960791500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4102dc0 0x7f5ef41031a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009900 tx=0x7f5ef002a410 comp rx=0 tx=0).stop 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 -- 172.21.15.19:0/960791500 shutdown_connections 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 --2- 172.21.15.19:0/960791500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef4109150 0x7f5ef410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 --2- 172.21.15.19:0/960791500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ef41087d0 0x7f5ef4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 --2- 172.21.15.19:0/960791500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4102dc0 0x7f5ef41031a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 -- 172.21.15.19:0/960791500 >> 172.21.15.19:0/960791500 conn(0x7f5ef40fe830 msgr2=0x7f5ef4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 -- 172.21.15.19:0/960791500 shutdown_connections 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.216+0000 7f5efc164640 1 -- 172.21.15.19:0/960791500 wait complete. 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 Processor -- start 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 -- start start 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ef4102dc0 0x7f5ef4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef41087d0 0x7f5ef4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4109150 0x7f5ef419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:02.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4112dd0 con 0x7f5ef4109150 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4112c50 con 0x7f5ef41087d0 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.217+0000 7f5efc164640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4112f50 con 0x7f5ef4102dc0 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4109150 0x7f5ef419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4109150 0x7f5ef419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41578/0 (socket says 172.21.15.19:41578) 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 -- 172.21.15.19:0/829180666 learned_addr learned my addr 172.21.15.19:0/829180666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5ef96ff640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef41087d0 0x7f5ef4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5ef9f00640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ef4102dc0 0x7f5ef4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 -- 172.21.15.19:0/829180666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ef4102dc0 msgr2=0x7f5ef4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ef4102dc0 0x7f5ef4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 -- 172.21.15.19:0/829180666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef41087d0 msgr2=0x7f5ef4199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef41087d0 0x7f5ef4199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 -- 172.21.15.19:0/829180666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef419f2f0 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efa701640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4109150 0x7f5ef419eb20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00eaa0 tx=0x7f5eec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5eeaffd640 1 -- 172.21.15.19:0/829180666 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec004d20 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5eeaffd640 1 -- 172.21.15.19:0/829180666 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5eec005020 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef419f5e0 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5eeaffd640 1 -- 172.21.15.19:0/829180666 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0116b0 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.218+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef41a5ca0 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.219+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef41031a0 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.221+0000 7f5eeaffd640 1 -- 172.21.15.19:0/829180666 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f5eec00f040 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.222+0000 7f5eeaffd640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5ee00b53c0 0x7f5ee00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.222+0000 7f5ef9f00640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5ee00b53c0 0x7f5ee00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.222+0000 7f5eeaffd640 1 -- 172.21.15.19:0/829180666 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5eec0e5d80 con 0x7f5ef4109150 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.222+0000 7f5ef9f00640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5ee00b53c0 0x7f5ee00b7880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0031440 tx=0x7f5ef00095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:02.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.226+0000 7f5eeaffd640 1 -- 172.21.15.19:0/829180666 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5eec016030 con 0x7f5ef4109150 2024-09-11T00:01:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.410+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ef4063590 con 0x7f5ee00b53c0 2024-09-11T00:01:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.414+0000 7f5eeaffd640 1 -- 172.21.15.19:0/829180666 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258982 (secure 0 0 0) 0x7f5ef4063590 con 0x7f5ee00b53c0 2024-09-11T00:01:02.417 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:02.418 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:01:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5ee00b53c0 msgr2=0x7f5ee00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5ee00b53c0 0x7f5ee00b7880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0031440 tx=0x7f5ef00095f0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4109150 msgr2=0x7f5ef419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4109150 0x7f5ef419eb20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00eaa0 tx=0x7f5eec00eea0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 shutdown_connections 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5ee00b53c0 0x7f5ee00b7880 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ef4109150 0x7f5ef419eb20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef41087d0 0x7f5ef4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 --2- 172.21.15.19:0/829180666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ef4102dc0 0x7f5ef4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 >> 172.21.15.19:0/829180666 conn(0x7f5ef40fe830 msgr2=0x7f5ef4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 shutdown_connections 2024-09-11T00:01:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:02.418+0000 7f5efc164640 1 -- 172.21.15.19:0/829180666 wait complete. 2024-09-11T00:01:03.090 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-09-11T00:01:00.494244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649555,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":218,"num_read_kb":199,"num_write":283,"num_write_kb":2254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363880,"kb_used_data":10404,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577944,"statfs":{"total":1151940427776,"available":1151567814656,"internally_reserved":0,"allocated":10653696,"data_stored":7006233,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8152,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002051"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610528+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:00:53.610528+0000","last_peered":"2024-09-11T00:00:53.610528+0000","last_clean":"2024-09-11T00:00:53.610528+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:00:53.610528+0000","last_undegraded":"2024-09-11T00:00:53.610528+0000","last_fullsized":"2024-09-11T00:00:53.610528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607796+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:00:53.607796+0000","last_peered":"2024-09-11T00:00:53.607796+0000","last_clean":"2024-09-11T00:00:53.607796+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:00:53.607796+0000","last_undegraded":"2024-09-11T00:00:53.607796+0000","last_fullsized":"2024-09-11T00:00:53.607796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607548+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:00:53.607548+0000","last_peered":"2024-09-11T00:00:53.607548+0000","last_clean":"2024-09-11T00:00:53.607548+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:00:53.607548+0000","last_undegraded":"2024-09-11T00:00:53.607548+0000","last_fullsized":"2024-09-11T00:00:53.607548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:00:53.605506+0000","last_peered":"2024-09-11T00:00:53.605506+0000","last_clean":"2024-09-11T00:00:53.605506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:00:53.605506+0000","last_undegraded":"2024-09-11T00:00:53.605506+0000","last_fullsized":"2024-09-11T00:00:53.605506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607907+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:00:53.607907+0000","last_peered":"2024-09-11T00:00:53.607907+0000","last_clean":"2024-09-11T00:00:53.607907+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:00:53.607907+0000","last_undegraded":"2024-09-11T00:00:53.607907+0000","last_fullsized":"2024-09-11T00:00:53.607907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697868+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:00:53.697868+0000","last_peered":"2024-09-11T00:00:53.697868+0000","last_clean":"2024-09-11T00:00:53.697868+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:00:53.697868+0000","last_undegraded":"2024-09-11T00:00:53.697868+0000","last_fullsized":"2024-09-11T00:00:53.697868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607284+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:00:53.607284+0000","last_peered":"2024-09-11T00:00:53.607284+0000","last_clean":"2024-09-11T00:00:53.607284+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:00:53.607284+0000","last_undegraded":"2024-09-11T00:00:53.607284+0000","last_fullsized":"2024-09-11T00:00:53.607284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697403+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:00:53.697403+0000","last_peered":"2024-09-11T00:00:53.697403+0000","last_clean":"2024-09-11T00:00:53.697403+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:00:53.697403+0000","last_undegraded":"2024-09-11T00:00:53.697403+0000","last_fullsized":"2024-09-11T00:00:53.697403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698427+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:00:53.698427+0000","last_peered":"2024-09-11T00:00:53.698427+0000","last_clean":"2024-09-11T00:00:53.698427+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:00:53.698427+0000","last_undegraded":"2024-09-11T00:00:53.698427+0000","last_fullsized":"2024-09-11T00:00:53.698427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698160+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:00:53.698160+0000","last_peered":"2024-09-11T00:00:53.698160+0000","last_clean":"2024-09-11T00:00:53.698160+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:00:53.698160+0000","last_undegraded":"2024-09-11T00:00:53.698160+0000","last_fullsized":"2024-09-11T00:00:53.698160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607338+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:00:53.607338+0000","last_peered":"2024-09-11T00:00:53.607338+0000","last_clean":"2024-09-11T00:00:53.607338+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:00:53.607338+0000","last_undegraded":"2024-09-11T00:00:53.607338+0000","last_fullsized":"2024-09-11T00:00:53.607338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605630+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:00:53.605630+0000","last_peered":"2024-09-11T00:00:53.605630+0000","last_clean":"2024-09-11T00:00:53.605630+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:00:53.605630+0000","last_undegraded":"2024-09-11T00:00:53.605630+0000","last_fullsized":"2024-09-11T00:00:53.605630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608293+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:00:53.608293+0000","last_peered":"2024-09-11T00:00:53.608293+0000","last_clean":"2024-09-11T00:00:53.608293+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:00:53.608293+0000","last_undegraded":"2024-09-11T00:00:53.608293+0000","last_fullsized":"2024-09-11T00:00:53.608293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607421+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:00:53.607421+0000","last_peered":"2024-09-11T00:00:53.607421+0000","last_clean":"2024-09-11T00:00:53.607421+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:00:53.607421+0000","last_undegraded":"2024-09-11T00:00:53.607421+0000","last_fullsized":"2024-09-11T00:00:53.607421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607980+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:00:53.607980+0000","last_peered":"2024-09-11T00:00:53.607980+0000","last_clean":"2024-09-11T00:00:53.607980+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:00:53.607980+0000","last_undegraded":"2024-09-11T00:00:53.607980+0000","last_fullsized":"2024-09-11T00:00:53.607980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697447+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:00:53.697447+0000","last_peered":"2024-09-11T00:00:53.697447+0000","last_clean":"2024-09-11T00:00:53.697447+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:00:53.697447+0000","last_undegraded":"2024-09-11T00:00:53.697447+0000","last_fullsized":"2024-09-11T00:00:53.697447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610581+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:00:53.610581+0000","last_peered":"2024-09-11T00:00:53.610581+0000","last_clean":"2024-09-11T00:00:53.610581+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:00:53.610581+0000","last_undegraded":"2024-09-11T00:00:53.610581+0000","last_fullsized":"2024-09-11T00:00:53.610581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604702+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:00:53.604702+0000","last_peered":"2024-09-11T00:00:53.604702+0000","last_clean":"2024-09-11T00:00:53.604702+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:00:53.604702+0000","last_undegraded":"2024-09-11T00:00:53.604702+0000","last_fullsized":"2024-09-11T00:00:53.604702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608539+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:00:53.608539+0000","last_peered":"2024-09-11T00:00:53.608539+0000","last_clean":"2024-09-11T00:00:53.608539+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:00:53.608539+0000","last_undegraded":"2024-09-11T00:00:53.608539+0000","last_fullsized":"2024-09-11T00:00:53.608539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609167+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:00:53.609167+0000","last_peered":"2024-09-11T00:00:53.609167+0000","last_clean":"2024-09-11T00:00:53.609167+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:00:53.609167+0000","last_undegraded":"2024-09-11T00:00:53.609167+0000","last_fullsized":"2024-09-11T00:00:53.609167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608387+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:00:53.608387+0000","last_peered":"2024-09-11T00:00:53.608387+0000","last_clean":"2024-09-11T00:00:53.608387+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:00:53.608387+0000","last_undegraded":"2024-09-11T00:00:53.608387+0000","last_fullsized":"2024-09-11T00:00:53.608387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697829+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:00:53.697829+0000","last_peered":"2024-09-11T00:00:53.697829+0000","last_clean":"2024-09-11T00:00:53.697829+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:00:53.697829+0000","last_undegraded":"2024-09-11T00:00:53.697829+0000","last_fullsized":"2024-09-11T00:00:53.697829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697440+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:00:53.697440+0000","last_peered":"2024-09-11T00:00:53.697440+0000","last_clean":"2024-09-11T00:00:53.697440+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:00:53.697440+0000","last_undegraded":"2024-09-11T00:00:53.697440+0000","last_fullsized":"2024-09-11T00:00:53.697440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609524+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:00:53.609524+0000","last_peered":"2024-09-11T00:00:53.609524+0000","last_clean":"2024-09-11T00:00:53.609524+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:00:53.609524+0000","last_undegraded":"2024-09-11T00:00:53.609524+0000","last_fullsized":"2024-09-11T00:00:53.609524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697755+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:00:53.697755+0000","last_peered":"2024-09-11T00:00:53.697755+0000","last_clean":"2024-09-11T00:00:53.697755+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:00:53.697755+0000","last_undegraded":"2024-09-11T00:00:53.697755+0000","last_fullsized":"2024-09-11T00:00:53.697755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608401+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:00:53.608401+0000","last_peered":"2024-09-11T00:00:53.608401+0000","last_clean":"2024-09-11T00:00:53.608401+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:00:53.608401+0000","last_undegraded":"2024-09-11T00:00:53.608401+0000","last_fullsized":"2024-09-11T00:00:53.608401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609403+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:00:53.609403+0000","last_peered":"2024-09-11T00:00:53.609403+0000","last_clean":"2024-09-11T00:00:53.609403+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:00:53.609403+0000","last_undegraded":"2024-09-11T00:00:53.609403+0000","last_fullsized":"2024-09-11T00:00:53.609403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610028+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:00:53.610028+0000","last_peered":"2024-09-11T00:00:53.610028+0000","last_clean":"2024-09-11T00:00:53.610028+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:00:53.610028+0000","last_undegraded":"2024-09-11T00:00:53.610028+0000","last_fullsized":"2024-09-11T00:00:53.610028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608648+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:00:53.608648+0000","last_peered":"2024-09-11T00:00:53.608648+0000","last_clean":"2024-09-11T00:00:53.608648+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:00:53.608648+0000","last_undegraded":"2024-09-11T00:00:53.608648+0000","last_fullsized":"2024-09-11T00:00:53.608648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608123+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:00:53.608123+0000","last_peered":"2024-09-11T00:00:53.608123+0000","last_clean":"2024-09-11T00:00:53.608123+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:00:53.608123+0000","last_undegraded":"2024-09-11T00:00:53.608123+0000","last_fullsized":"2024-09-11T00:00:53.608123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607903+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:00:53.607903+0000","last_peered":"2024-09-11T00:00:53.607903+0000","last_clean":"2024-09-11T00:00:53.607903+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:00:53.607903+0000","last_undegraded":"2024-09-11T00:00:53.607903+0000","last_fullsized":"2024-09-11T00:00:53.607903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607733+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:00:53.607733+0000","last_peered":"2024-09-11T00:00:53.607733+0000","last_clean":"2024-09-11T00:00:53.607733+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:00:53.607733+0000","last_undegraded":"2024-09-11T00:00:53.607733+0000","last_fullsized":"2024-09-11T00:00:53.607733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608446+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:00:53.608446+0000","last_peered":"2024-09-11T00:00:53.608446+0000","last_clean":"2024-09-11T00:00:53.608446+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:00:53.608446+0000","last_undegraded":"2024-09-11T00:00:53.608446+0000","last_fullsized":"2024-09-11T00:00:53.608446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":49,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:56.332885+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:00:56.332885+0000","last_peered":"2024-09-11T00:00:56.332885+0000","last_clean":"2024-09-11T00:00:56.332885+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:00:56.332885+0000","last_undegraded":"2024-09-11T00:00:56.332885+0000","last_fullsized":"2024-09-11T00:00:56.332885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609036+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:00:53.609036+0000","last_peered":"2024-09-11T00:00:53.609036+0000","last_clean":"2024-09-11T00:00:53.609036+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:00:53.609036+0000","last_undegraded":"2024-09-11T00:00:53.609036+0000","last_fullsized":"2024-09-11T00:00:53.609036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697456+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:00:53.697456+0000","last_peered":"2024-09-11T00:00:53.697456+0000","last_clean":"2024-09-11T00:00:53.697456+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:00:53.697456+0000","last_undegraded":"2024-09-11T00:00:53.697456+0000","last_fullsized":"2024-09-11T00:00:53.697456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604331+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:00:53.604331+0000","last_peered":"2024-09-11T00:00:53.604331+0000","last_clean":"2024-09-11T00:00:53.604331+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:00:53.604331+0000","last_undegraded":"2024-09-11T00:00:53.604331+0000","last_fullsized":"2024-09-11T00:00:53.604331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:55.330741+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:00:55.330741+0000","last_peered":"2024-09-11T00:00:55.330741+0000","last_clean":"2024-09-11T00:00:55.330741+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:00:55.330741+0000","last_undegraded":"2024-09-11T00:00:55.330741+0000","last_fullsized":"2024-09-11T00:00:55.330741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697914+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:00:53.697914+0000","last_peered":"2024-09-11T00:00:53.697914+0000","last_clean":"2024-09-11T00:00:53.697914+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:00:53.697914+0000","last_undegraded":"2024-09-11T00:00:53.697914+0000","last_fullsized":"2024-09-11T00:00:53.697914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608380+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:00:53.608380+0000","last_peered":"2024-09-11T00:00:53.608380+0000","last_clean":"2024-09-11T00:00:53.608380+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:00:53.608380+0000","last_undegraded":"2024-09-11T00:00:53.608380+0000","last_fullsized":"2024-09-11T00:00:53.608380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697945+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:00:53.697945+0000","last_peered":"2024-09-11T00:00:53.697945+0000","last_clean":"2024-09-11T00:00:53.697945+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:00:53.697945+0000","last_undegraded":"2024-09-11T00:00:53.697945+0000","last_fullsized":"2024-09-11T00:00:53.697945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'25","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:56.334364+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:00:56.334364+0000","last_peered":"2024-09-11T00:00:56.334364+0000","last_clean":"2024-09-11T00:00:56.334364+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:00:56.334364+0000","last_undegraded":"2024-09-11T00:00:56.334364+0000","last_fullsized":"2024-09-11T00:00:56.334364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54952,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":74,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608809+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:00:53.608809+0000","last_peered":"2024-09-11T00:00:53.608809+0000","last_clean":"2024-09-11T00:00:53.608809+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:00:53.608809+0000","last_undegraded":"2024-09-11T00:00:53.608809+0000","last_fullsized":"2024-09-11T00:00:53.608809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607445+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:00:53.607445+0000","last_peered":"2024-09-11T00:00:53.607445+0000","last_clean":"2024-09-11T00:00:53.607445+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:00:53.607445+0000","last_undegraded":"2024-09-11T00:00:53.607445+0000","last_fullsized":"2024-09-11T00:00:53.607445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610837+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:00:53.610837+0000","last_peered":"2024-09-11T00:00:53.610837+0000","last_clean":"2024-09-11T00:00:53.610837+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:00:53.610837+0000","last_undegraded":"2024-09-11T00:00:53.610837+0000","last_fullsized":"2024-09-11T00:00:53.610837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":49,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:56.333776+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:00:56.333776+0000","last_peered":"2024-09-11T00:00:56.333776+0000","last_clean":"2024-09-11T00:00:56.333776+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:00:56.333776+0000","last_undegraded":"2024-09-11T00:00:56.333776+0000","last_fullsized":"2024-09-11T00:00:56.333776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607094+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:00:53.607094+0000","last_peered":"2024-09-11T00:00:53.607094+0000","last_clean":"2024-09-11T00:00:53.607094+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:00:53.607094+0000","last_undegraded":"2024-09-11T00:00:53.607094+0000","last_fullsized":"2024-09-11T00:00:53.607094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.699247+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:00:53.699247+0000","last_peered":"2024-09-11T00:00:53.699247+0000","last_clean":"2024-09-11T00:00:53.699247+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:00:53.699247+0000","last_undegraded":"2024-09-11T00:00:53.699247+0000","last_fullsized":"2024-09-11T00:00:53.699247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608145+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:00:53.608145+0000","last_peered":"2024-09-11T00:00:53.608145+0000","last_clean":"2024-09-11T00:00:53.608145+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:00:53.608145+0000","last_undegraded":"2024-09-11T00:00:53.608145+0000","last_fullsized":"2024-09-11T00:00:53.608145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607541+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:00:53.607541+0000","last_peered":"2024-09-11T00:00:53.607541+0000","last_clean":"2024-09-11T00:00:53.607541+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:00:53.607541+0000","last_undegraded":"2024-09-11T00:00:53.607541+0000","last_fullsized":"2024-09-11T00:00:53.607541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607290+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:00:53.607290+0000","last_peered":"2024-09-11T00:00:53.607290+0000","last_clean":"2024-09-11T00:00:53.607290+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:00:53.607290+0000","last_undegraded":"2024-09-11T00:00:53.607290+0000","last_fullsized":"2024-09-11T00:00:53.607290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607628+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:00:53.607628+0000","last_peered":"2024-09-11T00:00:53.607628+0000","last_clean":"2024-09-11T00:00:53.607628+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:00:53.607628+0000","last_undegraded":"2024-09-11T00:00:53.607628+0000","last_fullsized":"2024-09-11T00:00:53.607628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607354+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607354+0000","last_peered":"2024-09-11T00:00:53.607354+0000","last_clean":"2024-09-11T00:00:53.607354+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607354+0000","last_undegraded":"2024-09-11T00:00:53.607354+0000","last_fullsized":"2024-09-11T00:00:53.607354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605463+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605463+0000","last_peered":"2024-09-11T00:00:53.605463+0000","last_clean":"2024-09-11T00:00:53.605463+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605463+0000","last_undegraded":"2024-09-11T00:00:53.605463+0000","last_fullsized":"2024-09-11T00:00:53.605463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697601+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:00:53.697601+0000","last_peered":"2024-09-11T00:00:53.697601+0000","last_clean":"2024-09-11T00:00:53.697601+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:00:53.697601+0000","last_undegraded":"2024-09-11T00:00:53.697601+0000","last_fullsized":"2024-09-11T00:00:53.697601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607224+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607224+0000","last_peered":"2024-09-11T00:00:53.607224+0000","last_clean":"2024-09-11T00:00:53.607224+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607224+0000","last_undegraded":"2024-09-11T00:00:53.607224+0000","last_fullsized":"2024-09-11T00:00:53.607224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607136+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:00:53.607136+0000","last_peered":"2024-09-11T00:00:53.607136+0000","last_clean":"2024-09-11T00:00:53.607136+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:00:53.607136+0000","last_undegraded":"2024-09-11T00:00:53.607136+0000","last_fullsized":"2024-09-11T00:00:53.607136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":48,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:58.336103+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:00:58.336103+0000","last_peered":"2024-09-11T00:00:58.336103+0000","last_clean":"2024-09-11T00:00:58.336103+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:00:58.336103+0000","last_undegraded":"2024-09-11T00:00:58.336103+0000","last_fullsized":"2024-09-11T00:00:58.336103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612423+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:00:53.612423+0000","last_peered":"2024-09-11T00:00:53.612423+0000","last_clean":"2024-09-11T00:00:53.612423+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:00:53.612423+0000","last_undegraded":"2024-09-11T00:00:53.612423+0000","last_fullsized":"2024-09-11T00:00:53.612423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607808+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607808+0000","last_peered":"2024-09-11T00:00:53.607808+0000","last_clean":"2024-09-11T00:00:53.607808+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607808+0000","last_undegraded":"2024-09-11T00:00:53.607808+0000","last_fullsized":"2024-09-11T00:00:53.607808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697889+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:00:53.697889+0000","last_peered":"2024-09-11T00:00:53.697889+0000","last_clean":"2024-09-11T00:00:53.697889+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:00:53.697889+0000","last_undegraded":"2024-09-11T00:00:53.697889+0000","last_fullsized":"2024-09-11T00:00:53.697889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.611825+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.611825+0000","last_peered":"2024-09-11T00:00:53.611825+0000","last_clean":"2024-09-11T00:00:53.611825+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.611825+0000","last_undegraded":"2024-09-11T00:00:53.611825+0000","last_fullsized":"2024-09-11T00:00:53.611825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697988+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:00:53.697988+0000","last_peered":"2024-09-11T00:00:53.697988+0000","last_clean":"2024-09-11T00:00:53.697988+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:00:53.697988+0000","last_undegraded":"2024-09-11T00:00:53.697988+0000","last_fullsized":"2024-09-11T00:00:53.697988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607608+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:00:53.607608+0000","last_peered":"2024-09-11T00:00:53.607608+0000","last_clean":"2024-09-11T00:00:53.607608+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:00:53.607608+0000","last_undegraded":"2024-09-11T00:00:53.607608+0000","last_fullsized":"2024-09-11T00:00:53.607608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:54.250572+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:00:54.250572+0000","last_peered":"2024-09-11T00:00:54.250572+0000","last_clean":"2024-09-11T00:00:54.250572+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:00:54.250572+0000","last_undegraded":"2024-09-11T00:00:54.250572+0000","last_fullsized":"2024-09-11T00:00:54.250572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697866+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:00:53.697866+0000","last_peered":"2024-09-11T00:00:53.697866+0000","last_clean":"2024-09-11T00:00:53.697866+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:00:53.697866+0000","last_undegraded":"2024-09-11T00:00:53.697866+0000","last_fullsized":"2024-09-11T00:00:53.697866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607896+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:00:53.607896+0000","last_peered":"2024-09-11T00:00:53.607896+0000","last_clean":"2024-09-11T00:00:53.607896+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:00:53.607896+0000","last_undegraded":"2024-09-11T00:00:53.607896+0000","last_fullsized":"2024-09-11T00:00:53.607896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607559+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:00:53.607559+0000","last_peered":"2024-09-11T00:00:53.607559+0000","last_clean":"2024-09-11T00:00:53.607559+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:00:53.607559+0000","last_undegraded":"2024-09-11T00:00:53.607559+0000","last_fullsized":"2024-09-11T00:00:53.607559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607830+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:00:53.607830+0000","last_peered":"2024-09-11T00:00:53.607830+0000","last_clean":"2024-09-11T00:00:53.607830+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:00:53.607830+0000","last_undegraded":"2024-09-11T00:00:53.607830+0000","last_fullsized":"2024-09-11T00:00:53.607830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697657+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:00:53.697657+0000","last_peered":"2024-09-11T00:00:53.697657+0000","last_clean":"2024-09-11T00:00:53.697657+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:00:53.697657+0000","last_undegraded":"2024-09-11T00:00:53.697657+0000","last_fullsized":"2024-09-11T00:00:53.697657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607530+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:00:53.607530+0000","last_peered":"2024-09-11T00:00:53.607530+0000","last_clean":"2024-09-11T00:00:53.607530+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:00:53.607530+0000","last_undegraded":"2024-09-11T00:00:53.607530+0000","last_fullsized":"2024-09-11T00:00:53.607530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609349+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:00:53.609349+0000","last_peered":"2024-09-11T00:00:53.609349+0000","last_clean":"2024-09-11T00:00:53.609349+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:00:53.609349+0000","last_undegraded":"2024-09-11T00:00:53.609349+0000","last_fullsized":"2024-09-11T00:00:53.609349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697588+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:00:53.697588+0000","last_peered":"2024-09-11T00:00:53.697588+0000","last_clean":"2024-09-11T00:00:53.697588+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:00:53.697588+0000","last_undegraded":"2024-09-11T00:00:53.697588+0000","last_fullsized":"2024-09-11T00:00:53.697588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608277+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:00:53.608277+0000","last_peered":"2024-09-11T00:00:53.608277+0000","last_clean":"2024-09-11T00:00:53.608277+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:00:53.608277+0000","last_undegraded":"2024-09-11T00:00:53.608277+0000","last_fullsized":"2024-09-11T00:00:53.608277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697953+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697953+0000","last_peered":"2024-09-11T00:00:53.697953+0000","last_clean":"2024-09-11T00:00:53.697953+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697953+0000","last_undegraded":"2024-09-11T00:00:53.697953+0000","last_fullsized":"2024-09-11T00:00:53.697953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697819+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:00:53.697819+0000","last_peered":"2024-09-11T00:00:53.697819+0000","last_clean":"2024-09-11T00:00:53.697819+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:00:53.697819+0000","last_undegraded":"2024-09-11T00:00:53.697819+0000","last_fullsized":"2024-09-11T00:00:53.697819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604729+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604729+0000","last_peered":"2024-09-11T00:00:53.604729+0000","last_clean":"2024-09-11T00:00:53.604729+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604729+0000","last_undegraded":"2024-09-11T00:00:53.604729+0000","last_fullsized":"2024-09-11T00:00:53.604729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58953,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":158,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":181116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710739,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1068870,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070493,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266722,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":1014132,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626476,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":1013425,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":423081,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378689,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":477184,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542214,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":476416,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:01:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:03 smithi135 ceph-mon[35432]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:03 smithi135 ceph-mon[35432]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 61 B/s, 0 objects/s recovering 2024-09-11T00:01:04.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:03 smithi019 ceph-mon[30859]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:04.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:03 smithi019 ceph-mon[30859]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 61 B/s, 0 objects/s recovering 2024-09-11T00:01:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:03 smithi131 ceph-mon[35491]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:03 smithi131 ceph-mon[35491]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 61 B/s, 0 objects/s recovering 2024-09-11T00:01:05.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:05 smithi135 ceph-mon[35432]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 55 B/s, 0 objects/s recovering 2024-09-11T00:01:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:05 smithi019 ceph-mon[30859]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 55 B/s, 0 objects/s recovering 2024-09-11T00:01:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:05 smithi131 ceph-mon[35491]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 55 B/s, 0 objects/s recovering 2024-09-11T00:01:06.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:01:06.368 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.950+0000 7fa6abc99640 1 -- 172.21.15.19:0/387657551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a410d100 msgr2=0x7fa6a410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.950+0000 7fa6abc99640 1 --2- 172.21.15.19:0/387657551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a410d100 0x7fa6a410f560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009ca0 tx=0x7fa69c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.950+0000 7fa6abc99640 1 -- 172.21.15.19:0/387657551 shutdown_connections 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.950+0000 7fa6abc99640 1 --2- 172.21.15.19:0/387657551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a410d100 0x7fa6a410f560 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.950+0000 7fa6abc99640 1 --2- 172.21.15.19:0/387657551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a41045c0 0x7fa6a410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.950+0000 7fa6abc99640 1 --2- 172.21.15.19:0/387657551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a4103ca0 0x7fa6a4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.950+0000 7fa6abc99640 1 -- 172.21.15.19:0/387657551 >> 172.21.15.19:0/387657551 conn(0x7fa6a40fd700 msgr2=0x7fa6a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.951+0000 7fa6abc99640 1 -- 172.21.15.19:0/387657551 shutdown_connections 2024-09-11T00:01:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.951+0000 7fa6abc99640 1 -- 172.21.15.19:0/387657551 wait complete. 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.951+0000 7fa6abc99640 1 Processor -- start 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.951+0000 7fa6abc99640 1 -- start start 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.951+0000 7fa6abc99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a4103ca0 0x7fa6a41991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.951+0000 7fa6abc99640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a41045c0 0x7fa6a4199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.951+0000 7fa6abc99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a410d100 0x7fa6a419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6abc99640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4112d70 con 0x7fa6a4103ca0 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6abc99640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4112bf0 con 0x7fa6a41045c0 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6abc99640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4112ef0 con 0x7fa6a410d100 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a4103ca0 0x7fa6a41991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a4103ca0 0x7fa6a41991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41604/0 (socket says 172.21.15.19:41604) 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 -- 172.21.15.19:0/410299511 learned_addr learned my addr 172.21.15.19:0/410299511 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6aa236640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a410d100 0x7fa6a419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9234640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a41045c0 0x7fa6a4199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 -- 172.21.15.19:0/410299511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a410d100 msgr2=0x7fa6a419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a410d100 0x7fa6a419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 -- 172.21.15.19:0/410299511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a41045c0 msgr2=0x7fa6a4199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a41045c0 0x7fa6a4199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 -- 172.21.15.19:0/410299511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a419f290 con 0x7fa6a4103ca0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6a9a35640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a4103ca0 0x7fa6a41991e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c920 tx=0x7fa69800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa696ffd640 1 -- 172.21.15.19:0/410299511 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698007c70 con 0x7fa6a4103ca0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa696ffd640 1 -- 172.21.15.19:0/410299511 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa698007e10 con 0x7fa6a4103ca0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a419f580 con 0x7fa6a4103ca0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa696ffd640 1 -- 172.21.15.19:0/410299511 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698018820 con 0x7fa6a4103ca0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.952+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a41a5c40 con 0x7fa6a4103ca0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.953+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a4104080 con 0x7fa6a4103ca0 2024-09-11T00:01:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.955+0000 7fa696ffd640 1 -- 172.21.15.19:0/410299511 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa69800f450 con 0x7fa6a4103ca0 2024-09-11T00:01:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.956+0000 7fa696ffd640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa6900b53c0 0x7fa6900b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.956+0000 7fa6a9234640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa6900b53c0 0x7fa6900b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.956+0000 7fa696ffd640 1 -- 172.21.15.19:0/410299511 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa6980e6170 con 0x7fa6a4103ca0 2024-09-11T00:01:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.956+0000 7fa6a9234640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa6900b53c0 0x7fa6900b7880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40fff30 tx=0x7fa6a000b5f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:06.964+0000 7fa696ffd640 1 -- 172.21.15.19:0/410299511 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa698014030 con 0x7fa6a4103ca0 2024-09-11T00:01:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.153+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6a40ff310 con 0x7fa6900b53c0 2024-09-11T00:01:07.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.157+0000 7fa696ffd640 1 -- 172.21.15.19:0/410299511 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258964 (secure 0 0 0) 0x7fa6a40ff310 con 0x7fa6900b53c0 2024-09-11T00:01:07.161 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:01:07.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa6900b53c0 msgr2=0x7fa6900b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa6900b53c0 0x7fa6900b7880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40fff30 tx=0x7fa6a000b5f0 comp rx=0 tx=0).stop 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a4103ca0 msgr2=0x7fa6a41991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a4103ca0 0x7fa6a41991e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c920 tx=0x7fa69800cde0 comp rx=0 tx=0).stop 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 shutdown_connections 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a410d100 0x7fa6a419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a41045c0 0x7fa6a4199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa6900b53c0 0x7fa6900b7880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 --2- 172.21.15.19:0/410299511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6a4103ca0 0x7fa6a41991e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.161+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 >> 172.21.15.19:0/410299511 conn(0x7fa6a40fd700 msgr2=0x7fa6a410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.162+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 shutdown_connections 2024-09-11T00:01:07.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:07.162+0000 7fa6abc99640 1 -- 172.21.15.19:0/410299511 wait complete. 2024-09-11T00:01:07.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:07 smithi019 ceph-mon[30859]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 50 B/s, 0 objects/s recovering 2024-09-11T00:01:07.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:07 smithi019 ceph-mon[30859]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:07.901 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-11T00:01:06.495971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653812,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":249,"num_read_kb":219,"num_write":284,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363884,"kb_used_data":10416,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577940,"statfs":{"total":1151940427776,"available":1151567810560,"internally_reserved":0,"allocated":10665984,"data_stored":7019004,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12409,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":47,"num_write":10,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003240"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610528+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:00:53.610528+0000","last_peered":"2024-09-11T00:00:53.610528+0000","last_clean":"2024-09-11T00:00:53.610528+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:00:53.610528+0000","last_undegraded":"2024-09-11T00:00:53.610528+0000","last_fullsized":"2024-09-11T00:00:53.610528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607796+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:00:53.607796+0000","last_peered":"2024-09-11T00:00:53.607796+0000","last_clean":"2024-09-11T00:00:53.607796+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:00:53.607796+0000","last_undegraded":"2024-09-11T00:00:53.607796+0000","last_fullsized":"2024-09-11T00:00:53.607796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607548+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:00:53.607548+0000","last_peered":"2024-09-11T00:00:53.607548+0000","last_clean":"2024-09-11T00:00:53.607548+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:00:53.607548+0000","last_undegraded":"2024-09-11T00:00:53.607548+0000","last_fullsized":"2024-09-11T00:00:53.607548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:00:53.605506+0000","last_peered":"2024-09-11T00:00:53.605506+0000","last_clean":"2024-09-11T00:00:53.605506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:00:53.605506+0000","last_undegraded":"2024-09-11T00:00:53.605506+0000","last_fullsized":"2024-09-11T00:00:53.605506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607907+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:00:53.607907+0000","last_peered":"2024-09-11T00:00:53.607907+0000","last_clean":"2024-09-11T00:00:53.607907+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:00:53.607907+0000","last_undegraded":"2024-09-11T00:00:53.607907+0000","last_fullsized":"2024-09-11T00:00:53.607907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697868+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:00:53.697868+0000","last_peered":"2024-09-11T00:00:53.697868+0000","last_clean":"2024-09-11T00:00:53.697868+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:00:53.697868+0000","last_undegraded":"2024-09-11T00:00:53.697868+0000","last_fullsized":"2024-09-11T00:00:53.697868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607284+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:00:53.607284+0000","last_peered":"2024-09-11T00:00:53.607284+0000","last_clean":"2024-09-11T00:00:53.607284+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:00:53.607284+0000","last_undegraded":"2024-09-11T00:00:53.607284+0000","last_fullsized":"2024-09-11T00:00:53.607284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697403+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:00:53.697403+0000","last_peered":"2024-09-11T00:00:53.697403+0000","last_clean":"2024-09-11T00:00:53.697403+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:00:53.697403+0000","last_undegraded":"2024-09-11T00:00:53.697403+0000","last_fullsized":"2024-09-11T00:00:53.697403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698427+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:00:53.698427+0000","last_peered":"2024-09-11T00:00:53.698427+0000","last_clean":"2024-09-11T00:00:53.698427+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:00:53.698427+0000","last_undegraded":"2024-09-11T00:00:53.698427+0000","last_fullsized":"2024-09-11T00:00:53.698427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698160+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:00:53.698160+0000","last_peered":"2024-09-11T00:00:53.698160+0000","last_clean":"2024-09-11T00:00:53.698160+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:00:53.698160+0000","last_undegraded":"2024-09-11T00:00:53.698160+0000","last_fullsized":"2024-09-11T00:00:53.698160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607338+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:00:53.607338+0000","last_peered":"2024-09-11T00:00:53.607338+0000","last_clean":"2024-09-11T00:00:53.607338+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:00:53.607338+0000","last_undegraded":"2024-09-11T00:00:53.607338+0000","last_fullsized":"2024-09-11T00:00:53.607338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605630+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:00:53.605630+0000","last_peered":"2024-09-11T00:00:53.605630+0000","last_clean":"2024-09-11T00:00:53.605630+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:00:53.605630+0000","last_undegraded":"2024-09-11T00:00:53.605630+0000","last_fullsized":"2024-09-11T00:00:53.605630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608293+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:00:53.608293+0000","last_peered":"2024-09-11T00:00:53.608293+0000","last_clean":"2024-09-11T00:00:53.608293+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:00:53.608293+0000","last_undegraded":"2024-09-11T00:00:53.608293+0000","last_fullsized":"2024-09-11T00:00:53.608293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607421+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:00:53.607421+0000","last_peered":"2024-09-11T00:00:53.607421+0000","last_clean":"2024-09-11T00:00:53.607421+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:00:53.607421+0000","last_undegraded":"2024-09-11T00:00:53.607421+0000","last_fullsized":"2024-09-11T00:00:53.607421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607980+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:00:53.607980+0000","last_peered":"2024-09-11T00:00:53.607980+0000","last_clean":"2024-09-11T00:00:53.607980+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:00:53.607980+0000","last_undegraded":"2024-09-11T00:00:53.607980+0000","last_fullsized":"2024-09-11T00:00:53.607980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697447+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:00:53.697447+0000","last_peered":"2024-09-11T00:00:53.697447+0000","last_clean":"2024-09-11T00:00:53.697447+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:00:53.697447+0000","last_undegraded":"2024-09-11T00:00:53.697447+0000","last_fullsized":"2024-09-11T00:00:53.697447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610581+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:00:53.610581+0000","last_peered":"2024-09-11T00:00:53.610581+0000","last_clean":"2024-09-11T00:00:53.610581+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:00:53.610581+0000","last_undegraded":"2024-09-11T00:00:53.610581+0000","last_fullsized":"2024-09-11T00:00:53.610581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604702+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:00:53.604702+0000","last_peered":"2024-09-11T00:00:53.604702+0000","last_clean":"2024-09-11T00:00:53.604702+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:00:53.604702+0000","last_undegraded":"2024-09-11T00:00:53.604702+0000","last_fullsized":"2024-09-11T00:00:53.604702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608539+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:00:53.608539+0000","last_peered":"2024-09-11T00:00:53.608539+0000","last_clean":"2024-09-11T00:00:53.608539+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:00:53.608539+0000","last_undegraded":"2024-09-11T00:00:53.608539+0000","last_fullsized":"2024-09-11T00:00:53.608539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609167+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:00:53.609167+0000","last_peered":"2024-09-11T00:00:53.609167+0000","last_clean":"2024-09-11T00:00:53.609167+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:00:53.609167+0000","last_undegraded":"2024-09-11T00:00:53.609167+0000","last_fullsized":"2024-09-11T00:00:53.609167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608387+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:00:53.608387+0000","last_peered":"2024-09-11T00:00:53.608387+0000","last_clean":"2024-09-11T00:00:53.608387+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:00:53.608387+0000","last_undegraded":"2024-09-11T00:00:53.608387+0000","last_fullsized":"2024-09-11T00:00:53.608387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697829+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:00:53.697829+0000","last_peered":"2024-09-11T00:00:53.697829+0000","last_clean":"2024-09-11T00:00:53.697829+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:00:53.697829+0000","last_undegraded":"2024-09-11T00:00:53.697829+0000","last_fullsized":"2024-09-11T00:00:53.697829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697440+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:00:53.697440+0000","last_peered":"2024-09-11T00:00:53.697440+0000","last_clean":"2024-09-11T00:00:53.697440+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:00:53.697440+0000","last_undegraded":"2024-09-11T00:00:53.697440+0000","last_fullsized":"2024-09-11T00:00:53.697440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609524+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:00:53.609524+0000","last_peered":"2024-09-11T00:00:53.609524+0000","last_clean":"2024-09-11T00:00:53.609524+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:00:53.609524+0000","last_undegraded":"2024-09-11T00:00:53.609524+0000","last_fullsized":"2024-09-11T00:00:53.609524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697755+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:00:53.697755+0000","last_peered":"2024-09-11T00:00:53.697755+0000","last_clean":"2024-09-11T00:00:53.697755+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:00:53.697755+0000","last_undegraded":"2024-09-11T00:00:53.697755+0000","last_fullsized":"2024-09-11T00:00:53.697755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608401+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:00:53.608401+0000","last_peered":"2024-09-11T00:00:53.608401+0000","last_clean":"2024-09-11T00:00:53.608401+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:00:53.608401+0000","last_undegraded":"2024-09-11T00:00:53.608401+0000","last_fullsized":"2024-09-11T00:00:53.608401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609403+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:00:53.609403+0000","last_peered":"2024-09-11T00:00:53.609403+0000","last_clean":"2024-09-11T00:00:53.609403+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:00:53.609403+0000","last_undegraded":"2024-09-11T00:00:53.609403+0000","last_fullsized":"2024-09-11T00:00:53.609403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610028+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:00:53.610028+0000","last_peered":"2024-09-11T00:00:53.610028+0000","last_clean":"2024-09-11T00:00:53.610028+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:00:53.610028+0000","last_undegraded":"2024-09-11T00:00:53.610028+0000","last_fullsized":"2024-09-11T00:00:53.610028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608648+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:00:53.608648+0000","last_peered":"2024-09-11T00:00:53.608648+0000","last_clean":"2024-09-11T00:00:53.608648+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:00:53.608648+0000","last_undegraded":"2024-09-11T00:00:53.608648+0000","last_fullsized":"2024-09-11T00:00:53.608648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608123+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:00:53.608123+0000","last_peered":"2024-09-11T00:00:53.608123+0000","last_clean":"2024-09-11T00:00:53.608123+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:00:53.608123+0000","last_undegraded":"2024-09-11T00:00:53.608123+0000","last_fullsized":"2024-09-11T00:00:53.608123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607903+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:00:53.607903+0000","last_peered":"2024-09-11T00:00:53.607903+0000","last_clean":"2024-09-11T00:00:53.607903+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:00:53.607903+0000","last_undegraded":"2024-09-11T00:00:53.607903+0000","last_fullsized":"2024-09-11T00:00:53.607903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607733+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:00:53.607733+0000","last_peered":"2024-09-11T00:00:53.607733+0000","last_clean":"2024-09-11T00:00:53.607733+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:00:53.607733+0000","last_undegraded":"2024-09-11T00:00:53.607733+0000","last_fullsized":"2024-09-11T00:00:53.607733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608446+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:00:53.608446+0000","last_peered":"2024-09-11T00:00:53.608446+0000","last_clean":"2024-09-11T00:00:53.608446+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:00:53.608446+0000","last_undegraded":"2024-09-11T00:00:53.608446+0000","last_fullsized":"2024-09-11T00:00:53.608446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":54,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:01.340212+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:01:01.340212+0000","last_peered":"2024-09-11T00:01:01.340212+0000","last_clean":"2024-09-11T00:01:01.340212+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:01:01.340212+0000","last_undegraded":"2024-09-11T00:01:01.340212+0000","last_fullsized":"2024-09-11T00:01:01.340212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609036+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:00:53.609036+0000","last_peered":"2024-09-11T00:00:53.609036+0000","last_clean":"2024-09-11T00:00:53.609036+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:00:53.609036+0000","last_undegraded":"2024-09-11T00:00:53.609036+0000","last_fullsized":"2024-09-11T00:00:53.609036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697456+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:00:53.697456+0000","last_peered":"2024-09-11T00:00:53.697456+0000","last_clean":"2024-09-11T00:00:53.697456+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:00:53.697456+0000","last_undegraded":"2024-09-11T00:00:53.697456+0000","last_fullsized":"2024-09-11T00:00:53.697456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604331+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:00:53.604331+0000","last_peered":"2024-09-11T00:00:53.604331+0000","last_clean":"2024-09-11T00:00:53.604331+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:00:53.604331+0000","last_undegraded":"2024-09-11T00:00:53.604331+0000","last_fullsized":"2024-09-11T00:00:53.604331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":49,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:00.337910+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:01:00.337910+0000","last_peered":"2024-09-11T00:01:00.337910+0000","last_clean":"2024-09-11T00:01:00.337910+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:01:00.337910+0000","last_undegraded":"2024-09-11T00:01:00.337910+0000","last_fullsized":"2024-09-11T00:01:00.337910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697914+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:00:53.697914+0000","last_peered":"2024-09-11T00:00:53.697914+0000","last_clean":"2024-09-11T00:00:53.697914+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:00:53.697914+0000","last_undegraded":"2024-09-11T00:00:53.697914+0000","last_fullsized":"2024-09-11T00:00:53.697914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608380+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:00:53.608380+0000","last_peered":"2024-09-11T00:00:53.608380+0000","last_clean":"2024-09-11T00:00:53.608380+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:00:53.608380+0000","last_undegraded":"2024-09-11T00:00:53.608380+0000","last_fullsized":"2024-09-11T00:00:53.608380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697945+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:00:53.697945+0000","last_peered":"2024-09-11T00:00:53.697945+0000","last_clean":"2024-09-11T00:00:53.697945+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:00:53.697945+0000","last_undegraded":"2024-09-11T00:00:53.697945+0000","last_fullsized":"2024-09-11T00:00:53.697945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'26","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:01.340611+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:01:01.340611+0000","last_peered":"2024-09-11T00:01:01.340611+0000","last_clean":"2024-09-11T00:01:01.340611+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:01:01.340611+0000","last_undegraded":"2024-09-11T00:01:01.340611+0000","last_fullsized":"2024-09-11T00:01:01.340611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":84,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608809+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:00:53.608809+0000","last_peered":"2024-09-11T00:00:53.608809+0000","last_clean":"2024-09-11T00:00:53.608809+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:00:53.608809+0000","last_undegraded":"2024-09-11T00:00:53.608809+0000","last_fullsized":"2024-09-11T00:00:53.608809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607445+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:00:53.607445+0000","last_peered":"2024-09-11T00:00:53.607445+0000","last_clean":"2024-09-11T00:00:53.607445+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:00:53.607445+0000","last_undegraded":"2024-09-11T00:00:53.607445+0000","last_fullsized":"2024-09-11T00:00:53.607445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610837+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:00:53.610837+0000","last_peered":"2024-09-11T00:00:53.610837+0000","last_clean":"2024-09-11T00:00:53.610837+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:00:53.610837+0000","last_undegraded":"2024-09-11T00:00:53.610837+0000","last_fullsized":"2024-09-11T00:00:53.610837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":54,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:01.341305+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:01:01.341305+0000","last_peered":"2024-09-11T00:01:01.341305+0000","last_clean":"2024-09-11T00:01:01.341305+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:01:01.341305+0000","last_undegraded":"2024-09-11T00:01:01.341305+0000","last_fullsized":"2024-09-11T00:01:01.341305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607094+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:00:53.607094+0000","last_peered":"2024-09-11T00:00:53.607094+0000","last_clean":"2024-09-11T00:00:53.607094+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:00:53.607094+0000","last_undegraded":"2024-09-11T00:00:53.607094+0000","last_fullsized":"2024-09-11T00:00:53.607094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.699247+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:00:53.699247+0000","last_peered":"2024-09-11T00:00:53.699247+0000","last_clean":"2024-09-11T00:00:53.699247+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:00:53.699247+0000","last_undegraded":"2024-09-11T00:00:53.699247+0000","last_fullsized":"2024-09-11T00:00:53.699247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608145+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:00:53.608145+0000","last_peered":"2024-09-11T00:00:53.608145+0000","last_clean":"2024-09-11T00:00:53.608145+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:00:53.608145+0000","last_undegraded":"2024-09-11T00:00:53.608145+0000","last_fullsized":"2024-09-11T00:00:53.608145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607541+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:00:53.607541+0000","last_peered":"2024-09-11T00:00:53.607541+0000","last_clean":"2024-09-11T00:00:53.607541+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:00:53.607541+0000","last_undegraded":"2024-09-11T00:00:53.607541+0000","last_fullsized":"2024-09-11T00:00:53.607541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607290+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:00:53.607290+0000","last_peered":"2024-09-11T00:00:53.607290+0000","last_clean":"2024-09-11T00:00:53.607290+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:00:53.607290+0000","last_undegraded":"2024-09-11T00:00:53.607290+0000","last_fullsized":"2024-09-11T00:00:53.607290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607628+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:00:53.607628+0000","last_peered":"2024-09-11T00:00:53.607628+0000","last_clean":"2024-09-11T00:00:53.607628+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:00:53.607628+0000","last_undegraded":"2024-09-11T00:00:53.607628+0000","last_fullsized":"2024-09-11T00:00:53.607628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607354+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607354+0000","last_peered":"2024-09-11T00:00:53.607354+0000","last_clean":"2024-09-11T00:00:53.607354+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607354+0000","last_undegraded":"2024-09-11T00:00:53.607354+0000","last_fullsized":"2024-09-11T00:00:53.607354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605463+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605463+0000","last_peered":"2024-09-11T00:00:53.605463+0000","last_clean":"2024-09-11T00:00:53.605463+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605463+0000","last_undegraded":"2024-09-11T00:00:53.605463+0000","last_fullsized":"2024-09-11T00:00:53.605463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697601+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:00:53.697601+0000","last_peered":"2024-09-11T00:00:53.697601+0000","last_clean":"2024-09-11T00:00:53.697601+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:00:53.697601+0000","last_undegraded":"2024-09-11T00:00:53.697601+0000","last_fullsized":"2024-09-11T00:00:53.697601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607224+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607224+0000","last_peered":"2024-09-11T00:00:53.607224+0000","last_clean":"2024-09-11T00:00:53.607224+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607224+0000","last_undegraded":"2024-09-11T00:00:53.607224+0000","last_fullsized":"2024-09-11T00:00:53.607224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607136+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:00:53.607136+0000","last_peered":"2024-09-11T00:00:53.607136+0000","last_clean":"2024-09-11T00:00:53.607136+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:00:53.607136+0000","last_undegraded":"2024-09-11T00:00:53.607136+0000","last_fullsized":"2024-09-11T00:00:53.607136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":53,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:03.343645+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:01:03.343645+0000","last_peered":"2024-09-11T00:01:03.343645+0000","last_clean":"2024-09-11T00:01:03.343645+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:01:03.343645+0000","last_undegraded":"2024-09-11T00:01:03.343645+0000","last_fullsized":"2024-09-11T00:01:03.343645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612423+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:00:53.612423+0000","last_peered":"2024-09-11T00:00:53.612423+0000","last_clean":"2024-09-11T00:00:53.612423+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:00:53.612423+0000","last_undegraded":"2024-09-11T00:00:53.612423+0000","last_fullsized":"2024-09-11T00:00:53.612423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607808+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607808+0000","last_peered":"2024-09-11T00:00:53.607808+0000","last_clean":"2024-09-11T00:00:53.607808+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607808+0000","last_undegraded":"2024-09-11T00:00:53.607808+0000","last_fullsized":"2024-09-11T00:00:53.607808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697889+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:00:53.697889+0000","last_peered":"2024-09-11T00:00:53.697889+0000","last_clean":"2024-09-11T00:00:53.697889+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:00:53.697889+0000","last_undegraded":"2024-09-11T00:00:53.697889+0000","last_fullsized":"2024-09-11T00:00:53.697889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.611825+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.611825+0000","last_peered":"2024-09-11T00:00:53.611825+0000","last_clean":"2024-09-11T00:00:53.611825+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.611825+0000","last_undegraded":"2024-09-11T00:00:53.611825+0000","last_fullsized":"2024-09-11T00:00:53.611825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697988+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:00:53.697988+0000","last_peered":"2024-09-11T00:00:53.697988+0000","last_clean":"2024-09-11T00:00:53.697988+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:00:53.697988+0000","last_undegraded":"2024-09-11T00:00:53.697988+0000","last_fullsized":"2024-09-11T00:00:53.697988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607608+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:00:53.607608+0000","last_peered":"2024-09-11T00:00:53.607608+0000","last_clean":"2024-09-11T00:00:53.607608+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:00:53.607608+0000","last_undegraded":"2024-09-11T00:00:53.607608+0000","last_fullsized":"2024-09-11T00:00:53.607608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:54.250572+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:00:54.250572+0000","last_peered":"2024-09-11T00:00:54.250572+0000","last_clean":"2024-09-11T00:00:54.250572+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:00:54.250572+0000","last_undegraded":"2024-09-11T00:00:54.250572+0000","last_fullsized":"2024-09-11T00:00:54.250572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697866+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:00:53.697866+0000","last_peered":"2024-09-11T00:00:53.697866+0000","last_clean":"2024-09-11T00:00:53.697866+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:00:53.697866+0000","last_undegraded":"2024-09-11T00:00:53.697866+0000","last_fullsized":"2024-09-11T00:00:53.697866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607896+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:00:53.607896+0000","last_peered":"2024-09-11T00:00:53.607896+0000","last_clean":"2024-09-11T00:00:53.607896+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:00:53.607896+0000","last_undegraded":"2024-09-11T00:00:53.607896+0000","last_fullsized":"2024-09-11T00:00:53.607896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607559+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:00:53.607559+0000","last_peered":"2024-09-11T00:00:53.607559+0000","last_clean":"2024-09-11T00:00:53.607559+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:00:53.607559+0000","last_undegraded":"2024-09-11T00:00:53.607559+0000","last_fullsized":"2024-09-11T00:00:53.607559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607830+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:00:53.607830+0000","last_peered":"2024-09-11T00:00:53.607830+0000","last_clean":"2024-09-11T00:00:53.607830+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:00:53.607830+0000","last_undegraded":"2024-09-11T00:00:53.607830+0000","last_fullsized":"2024-09-11T00:00:53.607830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697657+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:00:53.697657+0000","last_peered":"2024-09-11T00:00:53.697657+0000","last_clean":"2024-09-11T00:00:53.697657+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:00:53.697657+0000","last_undegraded":"2024-09-11T00:00:53.697657+0000","last_fullsized":"2024-09-11T00:00:53.697657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607530+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:00:53.607530+0000","last_peered":"2024-09-11T00:00:53.607530+0000","last_clean":"2024-09-11T00:00:53.607530+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:00:53.607530+0000","last_undegraded":"2024-09-11T00:00:53.607530+0000","last_fullsized":"2024-09-11T00:00:53.607530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609349+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:00:53.609349+0000","last_peered":"2024-09-11T00:00:53.609349+0000","last_clean":"2024-09-11T00:00:53.609349+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:00:53.609349+0000","last_undegraded":"2024-09-11T00:00:53.609349+0000","last_fullsized":"2024-09-11T00:00:53.609349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697588+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:00:53.697588+0000","last_peered":"2024-09-11T00:00:53.697588+0000","last_clean":"2024-09-11T00:00:53.697588+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:00:53.697588+0000","last_undegraded":"2024-09-11T00:00:53.697588+0000","last_fullsized":"2024-09-11T00:00:53.697588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608277+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:00:53.608277+0000","last_peered":"2024-09-11T00:00:53.608277+0000","last_clean":"2024-09-11T00:00:53.608277+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:00:53.608277+0000","last_undegraded":"2024-09-11T00:00:53.608277+0000","last_fullsized":"2024-09-11T00:00:53.608277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697953+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697953+0000","last_peered":"2024-09-11T00:00:53.697953+0000","last_clean":"2024-09-11T00:00:53.697953+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697953+0000","last_undegraded":"2024-09-11T00:00:53.697953+0000","last_fullsized":"2024-09-11T00:00:53.697953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697819+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:00:53.697819+0000","last_peered":"2024-09-11T00:00:53.697819+0000","last_clean":"2024-09-11T00:00:53.697819+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:00:53.697819+0000","last_undegraded":"2024-09-11T00:00:53.697819+0000","last_fullsized":"2024-09-11T00:00:53.697819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604729+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604729+0000","last_peered":"2024-09-11T00:00:53.604729+0000","last_clean":"2024-09-11T00:00:53.604729+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604729+0000","last_undegraded":"2024-09-11T00:00:53.604729+0000","last_fullsized":"2024-09-11T00:00:53.604729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63210,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":168,"num_read_kb":150,"num_write":159,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710740,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1073127,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070494,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266723,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":1014132,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626477,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822706,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":1013425,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953527,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":423081,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378691,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":481441,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":480673,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705741,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:01:07.905 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T00:01:07.906 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T00:01:07.906 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T00:01:07.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:07 smithi135 ceph-mon[35432]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 50 B/s, 0 objects/s recovering 2024-09-11T00:01:07.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:07 smithi135 ceph-mon[35432]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:07 smithi131 ceph-mon[35491]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 50 B/s, 0 objects/s recovering 2024-09-11T00:01:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:07 smithi131 ceph-mon[35491]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:08.168 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 -- 172.21.15.19:0/1010389096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 msgr2=0x7f279c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 --2- 172.21.15.19:0/1010389096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c107b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2790009900 tx=0x7f279002a410 comp rx=0 tx=0).stop 2024-09-11T00:01:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 -- 172.21.15.19:0/1010389096 shutdown_connections 2024-09-11T00:01:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 --2- 172.21.15.19:0/1010389096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f279c108060 0x7f279c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 --2- 172.21.15.19:0/1010389096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c107b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 --2- 172.21.15.19:0/1010389096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c101cd0 0x7f279c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 -- 172.21.15.19:0/1010389096 >> 172.21.15.19:0/1010389096 conn(0x7f279c0fd700 msgr2=0x7f279c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 -- 172.21.15.19:0/1010389096 shutdown_connections 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.669+0000 7f27a2b52640 1 -- 172.21.15.19:0/1010389096 wait complete. 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 Processor -- start 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 -- start start 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f279c101cd0 0x7f279c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c108060 0x7f279c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f279c111d20 con 0x7f279c1076e0 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f279c111ba0 con 0x7f279c101cd0 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a2b52640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f279c111ea0 con 0x7f279c108060 2024-09-11T00:01:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41608/0 (socket says 172.21.15.19:41608) 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 -- 172.21.15.19:0/4110751251 learned_addr learned my addr 172.21.15.19:0/4110751251 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a10ef640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c108060 0x7f279c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f27a08ee640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f279c101cd0 0x7f279c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 -- 172.21.15.19:0/4110751251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c108060 msgr2=0x7f279c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c108060 0x7f279c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 -- 172.21.15.19:0/4110751251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f279c101cd0 msgr2=0x7f279c19a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f279c101cd0 0x7f279c19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.670+0000 7f279bfff640 1 -- 172.21.15.19:0/4110751251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c1a54f0 con 0x7f279c1076e0 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.671+0000 7f279bfff640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c19a650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2790005940 tx=0x7f27900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.671+0000 7f2799ffb640 1 -- 172.21.15.19:0/4110751251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279003f030 con 0x7f279c1076e0 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.671+0000 7f2799ffb640 1 -- 172.21.15.19:0/4110751251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2790003cb0 con 0x7f279c1076e0 2024-09-11T00:01:08.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.671+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c1a5780 con 0x7f279c1076e0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.671+0000 7f2799ffb640 1 -- 172.21.15.19:0/4110751251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790035070 con 0x7f279c1076e0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.671+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c1a5d30 con 0x7f279c1076e0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.672+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c1020b0 con 0x7f279c1076e0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.674+0000 7f2799ffb640 1 -- 172.21.15.19:0/4110751251 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f279003bbf0 con 0x7f279c1076e0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.674+0000 7f2799ffb640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f27840b5440 0x7f27840b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.675+0000 7f27a08ee640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f27840b5440 0x7f27840b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.675+0000 7f2799ffb640 1 -- 172.21.15.19:0/4110751251 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2790106c90 con 0x7f279c1076e0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.675+0000 7f27a08ee640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f27840b5440 0x7f27840b7900 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f278c005fd0 tx=0x7f278c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:08.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.678+0000 7f2799ffb640 1 -- 172.21.15.19:0/4110751251 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f27900cd8f0 con 0x7f279c1076e0 2024-09-11T00:01:08.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.934+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f279c02e5c0 con 0x7f279c1076e0 2024-09-11T00:01:08.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.939+0000 7f2799ffb640 1 -- 172.21.15.19:0/4110751251 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f27900cd1f0 con 0x7f279c1076e0 2024-09-11T00:01:08.940 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-11T00:01:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDE3eBmHLLMNxAAt772H5DmsoZ1TWJsy5s5kw== 2024-09-11T00:01:08.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f27840b5440 msgr2=0x7f27840b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:08.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f27840b5440 0x7f27840b7900 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f278c005fd0 tx=0x7f278c005850 comp rx=0 tx=0).stop 2024-09-11T00:01:08.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 msgr2=0x7f279c19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c19a650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2790005940 tx=0x7f27900042f0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 shutdown_connections 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c108060 0x7f279c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f27840b5440 0x7f27840b7900 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f279c1076e0 0x7f279c19a650 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 --2- 172.21.15.19:0/4110751251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f279c101cd0 0x7f279c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 >> 172.21.15.19:0/4110751251 conn(0x7f279c0fd700 msgr2=0x7f279c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 shutdown_connections 2024-09-11T00:01:08.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:08.941+0000 7f27a2b52640 1 -- 172.21.15.19:0/4110751251 wait complete. 2024-09-11T00:01:09.785 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-11T00:01:09.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T00:01:09.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T00:01:09.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-11T00:01:09.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:09 smithi135 ceph-mon[35432]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 50 B/s, 0 objects/s recovering 2024-09-11T00:01:09.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:09 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4110751251' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T00:01:09.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:09 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4110751251' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:01:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:09 smithi019 ceph-mon[30859]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 50 B/s, 0 objects/s recovering 2024-09-11T00:01:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:09 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4110751251' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T00:01:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:09 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4110751251' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:01:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:09 smithi131 ceph-mon[35491]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 50 B/s, 0 objects/s recovering 2024-09-11T00:01:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:09 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4110751251' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T00:01:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:09 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4110751251' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:01:10.127 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 -- 172.21.15.19:0/1690725450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e81076a0 msgr2=0x7fa3e8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1690725450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e81076a0 0x7fa3e8107ae0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009900 tx=0x7fa3d802a410 comp rx=0 tx=0).stop 2024-09-11T00:01:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 -- 172.21.15.19:0/1690725450 shutdown_connections 2024-09-11T00:01:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1690725450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e8108020 0x7fa3e810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1690725450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e81076a0 0x7fa3e8107ae0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1690725450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 0x7fa3e8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 -- 172.21.15.19:0/1690725450 >> 172.21.15.19:0/1690725450 conn(0x7fa3e80fd700 msgr2=0x7fa3e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.627+0000 7fa3efb80640 1 -- 172.21.15.19:0/1690725450 shutdown_connections 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 -- 172.21.15.19:0/1690725450 wait complete. 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 Processor -- start 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 -- start start 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 0x7fa3e8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e81076a0 0x7fa3e8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e8108020 0x7fa3e819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e8112e00 con 0x7fa3e8108020 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e8112c80 con 0x7fa3e8101c90 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3efb80640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e8112f80 con 0x7fa3e81076a0 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3ee11d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e8108020 0x7fa3e819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.628+0000 7fa3ed91c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 0x7fa3e8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e8108020 0x7fa3e819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41618/0 (socket says 172.21.15.19:41618) 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 -- 172.21.15.19:0/1888458255 learned_addr learned my addr 172.21.15.19:0/1888458255 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ed91c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 0x7fa3e8199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:39852/0 (socket says 172.21.15.19:39852) 2024-09-11T00:01:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ed11b640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e81076a0 0x7fa3e8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 -- 172.21.15.19:0/1888458255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e81076a0 msgr2=0x7fa3e8199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e81076a0 0x7fa3e8199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 -- 172.21.15.19:0/1888458255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 msgr2=0x7fa3e8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 0x7fa3e8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 -- 172.21.15.19:0/1888458255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e819f2e0 con 0x7fa3e8108020 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ed91c640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 0x7fa3e8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ed11b640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e81076a0 0x7fa3e8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3ee11d640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e8108020 0x7fa3e819eb10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000cce0 tx=0x7fa3e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3deffd640 1 -- 172.21.15.19:0/1888458255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000f450 con 0x7fa3e8108020 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3deffd640 1 -- 172.21.15.19:0/1888458255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e000faa0 con 0x7fa3e8108020 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e819f5d0 con 0x7fa3e8108020 2024-09-11T00:01:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3deffd640 1 -- 172.21.15.19:0/1888458255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0018b70 con 0x7fa3e8108020 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.629+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e81a5c90 con 0x7fa3e8108020 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.630+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e8102070 con 0x7fa3e8108020 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.632+0000 7fa3deffd640 1 -- 172.21.15.19:0/1888458255 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa3e000f5f0 con 0x7fa3e8108020 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.632+0000 7fa3deffd640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.632+0000 7fa3ed91c640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.633+0000 7fa3deffd640 1 -- 172.21.15.19:0/1888458255 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa3e00e6670 con 0x7fa3e8108020 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.633+0000 7fa3ed91c640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009fc0 tx=0x7fa3e4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.635+0000 7fa3deffd640 1 -- 172.21.15.19:0/1888458255 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa3e0014030 con 0x7fa3e8108020 2024-09-11T00:01:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.823+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa3e81a6020 con 0x7fa3e8108020 2024-09-11T00:01:10.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.823+0000 7fa3deffd640 1 -- 172.21.15.19:0/1888458255 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7fa3e00ad3c0 con 0x7fa3e8108020 2024-09-11T00:01:10.825 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:10.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 msgr2=0x7fa3d40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009fc0 tx=0x7fa3e4005f90 comp rx=0 tx=0).stop 2024-09-11T00:01:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e8108020 msgr2=0x7fa3e819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e8108020 0x7fa3e819eb10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000cce0 tx=0x7fa3e000a620 comp rx=0 tx=0).stop 2024-09-11T00:01:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 shutdown_connections 2024-09-11T00:01:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3e8108020 0x7fa3e819eb10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e81076a0 0x7fa3e8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 --2- 172.21.15.19:0/1888458255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e8101c90 0x7fa3e8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 >> 172.21.15.19:0/1888458255 conn(0x7fa3e80fd700 msgr2=0x7fa3e80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.825+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 shutdown_connections 2024-09-11T00:01:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:10.826+0000 7fa3efb80640 1 -- 172.21.15.19:0/1888458255 wait complete. 2024-09-11T00:01:11.472 INFO:teuthology.orchestra.run.smithi019.stdout:[{"version":54,"timestamp":"2024-09-11T00:00:20.172621+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-11T00:01:11.473 INFO:tasks.ceph_manager:config epoch is 54 2024-09-11T00:01:11.473 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T00:01:11.473 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T00:01:11.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T00:01:11.733 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:11.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:11 smithi019 ceph-mon[30859]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-11T00:01:11.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:11 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1888458255' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T00:01:11.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:11 smithi135 ceph-mon[35432]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-11T00:01:11.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:11 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1888458255' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T00:01:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:11 smithi131 ceph-mon[35491]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-11T00:01:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:11 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1888458255' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T00:01:12.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 -- 172.21.15.19:0/4045715126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 msgr2=0x7f6024101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:12.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 --2- 172.21.15.19:0/4045715126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f6024101bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6014009900 tx=0x7f601402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 -- 172.21.15.19:0/4045715126 shutdown_connections 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 --2- 172.21.15.19:0/4045715126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f602410d250 0x7f602410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 --2- 172.21.15.19:0/4045715126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f602410a920 0x7f602410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 --2- 172.21.15.19:0/4045715126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f6024101bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 -- 172.21.15.19:0/4045715126 >> 172.21.15.19:0/4045715126 conn(0x7f6024076f50 msgr2=0x7f6024077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 -- 172.21.15.19:0/4045715126 shutdown_connections 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 -- 172.21.15.19:0/4045715126 wait complete. 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.209+0000 7f602a344640 1 Processor -- start 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f602a344640 1 -- start start 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f602a344640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f602419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f602a344640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f602410a920 0x7f602419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f602a344640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f602410d250 0x7f60241a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f602a344640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6024112e80 con 0x7f6024101810 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f602a344640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6024112d00 con 0x7f602410d250 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f602a344640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6024113000 con 0x7f602410a920 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f602419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f602419b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49302/0 (socket says 172.21.15.19:49302) 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 -- 172.21.15.19:0/939189961 learned_addr learned my addr 172.21.15.19:0/939189961 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f601bfff640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f602410a920 0x7f602419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 -- 172.21.15.19:0/939189961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f602410a920 msgr2=0x7f602419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f602410a920 0x7f602419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 -- 172.21.15.19:0/939189961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f602410d250 msgr2=0x7f60241a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f602410d250 0x7f60241a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 -- 172.21.15.19:0/939189961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60241a16c0 con 0x7f6024101810 2024-09-11T00:01:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6023fff640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f602419b610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6014005ab0 tx=0x7f6014003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.210+0000 7f6021ffb640 1 -- 172.21.15.19:0/939189961 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601403f070 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.211+0000 7f6021ffb640 1 -- 172.21.15.19:0/939189961 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6014031d60 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.211+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60241a1950 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.211+0000 7f6021ffb640 1 -- 172.21.15.19:0/939189961 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014035030 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.211+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60241a8070 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.212+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6024101c70 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.213+0000 7f6021ffb640 1 -- 172.21.15.19:0/939189961 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f601403b4f0 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.214+0000 7f6021ffb640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f60100b5440 0x7f60100b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.214+0000 7f601bfff640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f60100b5440 0x7f60100b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.214+0000 7f6021ffb640 1 -- 172.21.15.19:0/939189961 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6014106b10 con 0x7f6024101810 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.214+0000 7f601bfff640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f60100b5440 0x7f60100b7900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f602410c620 tx=0x7f600c009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.218+0000 7f6021ffb640 1 -- 172.21.15.19:0/939189961 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f60140cd7d0 con 0x7f6024101810 2024-09-11T00:01:12.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.452+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f60241a83c0 con 0x7f6024101810 2024-09-11T00:01:12.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.457+0000 7f6021ffb640 1 -- 172.21.15.19:0/939189961 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+294232 (secure 0 0 0) 0x7f60140cd0d0 con 0x7f6024101810 2024-09-11T00:01:12.462 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f60100b5440 msgr2=0x7f60100b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f60100b5440 0x7f60100b7900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f602410c620 tx=0x7f600c009110 comp rx=0 tx=0).stop 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 msgr2=0x7f602419b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f602419b610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6014005ab0 tx=0x7f6014003d50 comp rx=0 tx=0).stop 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 shutdown_connections 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f602410d250 0x7f60241a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f602410a920 0x7f602419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f60100b5440 0x7f60100b7900 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 --2- 172.21.15.19:0/939189961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6024101810 0x7f602419b610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 >> 172.21.15.19:0/939189961 conn(0x7f6024076f50 msgr2=0x7f6024108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:12.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 shutdown_connections 2024-09-11T00:01:12.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:12.462+0000 7f602a344640 1 -- 172.21.15.19:0/939189961 wait complete. 2024-09-11T00:01:12.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:12 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/939189961' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T00:01:12.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:12 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/939189961' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T00:01:13.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:12 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/939189961' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T00:01:13.165 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"flags":0,"active_gid":14220,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":1170299416},{"type":"v1","addr":"172.21.15.19:6801","nonce":1170299416}]},"active_addr":"172.21.15.19:6801/1170299416","active_change":"2024-09-10T23:53:52.390776+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24136,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24146,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.19:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":4080365482}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3646443247}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3646002506}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":4002228917}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1516985488}]}]} 2024-09-11T00:01:13.172 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T00:01:13.172 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T00:01:13.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:01:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:13.888 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:13 smithi019 ceph-mon[30859]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:01:13.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:13 smithi135 ceph-mon[35432]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:01:13.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.968+0000 7f2e9f584640 1 -- 172.21.15.19:0/2202431607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 msgr2=0x7f2e9810e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.968+0000 7f2e9f584640 1 --2- 172.21.15.19:0/2202431607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e9810e840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009900 tx=0x7f2e9002a410 comp rx=0 tx=0).stop 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.968+0000 7f2e9f584640 1 -- 172.21.15.19:0/2202431607 shutdown_connections 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.968+0000 7f2e9f584640 1 --2- 172.21.15.19:0/2202431607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e9810e840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.968+0000 7f2e9f584640 1 --2- 172.21.15.19:0/2202431607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e981076c0 0x7f2e98107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.968+0000 7f2e9f584640 1 --2- 172.21.15.19:0/2202431607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e98101cb0 0x7f2e98102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.968+0000 7f2e9f584640 1 -- 172.21.15.19:0/2202431607 >> 172.21.15.19:0/2202431607 conn(0x7f2e980fd700 msgr2=0x7f2e980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.969+0000 7f2e9f584640 1 -- 172.21.15.19:0/2202431607 shutdown_connections 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.969+0000 7f2e9f584640 1 -- 172.21.15.19:0/2202431607 wait complete. 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.969+0000 7f2e9f584640 1 Processor -- start 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.969+0000 7f2e9f584640 1 -- start start 2024-09-11T00:01:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9f584640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e98101cb0 0x7f2e9819b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9f584640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e981076c0 0x7f2e9819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9f584640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e981a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9f584640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98111d40 con 0x7f2e98108040 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9f584640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98111bc0 con 0x7f2e981076c0 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9f584640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98111ec0 con 0x7f2e98101cb0 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e981a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9d320640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e98101cb0 0x7f2e9819b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e981a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49320/0 (socket says 172.21.15.19:49320) 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 -- 172.21.15.19:0/1043951642 learned_addr learned my addr 172.21.15.19:0/1043951642 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9cb1f640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e981076c0 0x7f2e9819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 -- 172.21.15.19:0/1043951642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e98101cb0 msgr2=0x7f2e9819b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e98101cb0 0x7f2e9819b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 -- 172.21.15.19:0/1043951642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e981076c0 msgr2=0x7f2e9819baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e981076c0 0x7f2e9819baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 -- 172.21.15.19:0/1043951642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e981a1660 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.970+0000 7f2e9db21640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e981a0e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009a20 tx=0x7f2e90004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.971+0000 7f2e967fc640 1 -- 172.21.15.19:0/1043951642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9003f030 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.971+0000 7f2e967fc640 1 -- 172.21.15.19:0/1043951642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e90003aa0 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.971+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e981a18f0 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.971+0000 7f2e967fc640 1 -- 172.21.15.19:0/1043951642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90035070 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.971+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e981a8010 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.972+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e98102110 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.973+0000 7f2e967fc640 1 -- 172.21.15.19:0/1043951642 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f2e900035f0 con 0x7f2e98108040 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.974+0000 7f2e967fc640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e800b53c0 0x7f2e800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.974+0000 7f2e9d320640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e800b53c0 0x7f2e800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.974+0000 7f2e967fc640 1 -- 172.21.15.19:0/1043951642 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2e90106b40 con 0x7f2e98108040 2024-09-11T00:01:13.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.974+0000 7f2e9d320640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e800b53c0 0x7f2e800b7880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800a400 tx=0x7f2e8800d040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:13.977+0000 7f2e967fc640 1 -- 172.21.15.19:0/1043951642 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2e900cd800 con 0x7f2e98108040 2024-09-11T00:01:14.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:13 smithi131 ceph-mon[35491]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:01:14.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.163+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e981a83e0 con 0x7f2e98108040 2024-09-11T00:01:14.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.164+0000 7f2e967fc640 1 -- 172.21.15.19:0/1043951642 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22967 (secure 0 0 0) 0x7f2e900cd100 con 0x7f2e98108040 2024-09-11T00:01:14.166 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:14.166 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:53.600623+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e800b53c0 msgr2=0x7f2e800b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e800b53c0 0x7f2e800b7880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800a400 tx=0x7f2e8800d040 comp rx=0 tx=0).stop 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 msgr2=0x7f2e981a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e981a0e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009a20 tx=0x7f2e90004270 comp rx=0 tx=0).stop 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 shutdown_connections 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e800b53c0 0x7f2e800b7880 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e98108040 0x7f2e981a0e90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:14.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e981076c0 0x7f2e9819baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:14.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 --2- 172.21.15.19:0/1043951642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e98101cb0 0x7f2e9819b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:14.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.166+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 >> 172.21.15.19:0/1043951642 conn(0x7f2e980fd700 msgr2=0x7f2e9806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:14.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.167+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 shutdown_connections 2024-09-11T00:01:14.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:14.167+0000 7f2e9f584640 1 -- 172.21.15.19:0/1043951642 wait complete. 2024-09-11T00:01:14.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:14 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1043951642' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:14.821 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T00:01:14.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:01:14.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:14 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1043951642' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:15.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:14 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1043951642' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:15.086 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:15.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 -- 172.21.15.19:0/2442010878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 msgr2=0x7f70e410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:15.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/2442010878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e410eee0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009900 tx=0x7f70d402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:15.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 -- 172.21.15.19:0/2442010878 shutdown_connections 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/2442010878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e410f420 0x7f70e4111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/2442010878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e410eee0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/2442010878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e4101870 0x7f70e4101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 -- 172.21.15.19:0/2442010878 >> 172.21.15.19:0/2442010878 conn(0x7f70e40fd700 msgr2=0x7f70e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 -- 172.21.15.19:0/2442010878 shutdown_connections 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 -- 172.21.15.19:0/2442010878 wait complete. 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 Processor -- start 2024-09-11T00:01:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 -- start start 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.572+0000 7f70eb5cb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e4101870 0x7f70e419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70eb5cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70eb5cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e410f420 0x7f70e41a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70eb5cb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70e4114f70 con 0x7f70e4102190 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70eb5cb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70e4114df0 con 0x7f70e4101870 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70eb5cb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70e41150f0 con 0x7f70e410f420 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49328/0 (socket says 172.21.15.19:49328) 2024-09-11T00:01:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 -- 172.21.15.19:0/17502030 learned_addr learned my addr 172.21.15.19:0/17502030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e9b68640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e410f420 0x7f70e41a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e9367640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e4101870 0x7f70e419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 -- 172.21.15.19:0/17502030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e410f420 msgr2=0x7f70e41a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e410f420 0x7f70e41a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 -- 172.21.15.19:0/17502030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e4101870 msgr2=0x7f70e419b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e4101870 0x7f70e419b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 -- 172.21.15.19:0/17502030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e41a1590 con 0x7f70e4102190 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e9b68640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e410f420 0x7f70e41a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70e8b66640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e419ba20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70d4005940 tx=0x7f70d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:15.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70da7fc640 1 -- 172.21.15.19:0/17502030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d403f030 con 0x7f70e4102190 2024-09-11T00:01:15.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70da7fc640 1 -- 172.21.15.19:0/17502030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d4003aa0 con 0x7f70e4102190 2024-09-11T00:01:15.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e41a1820 con 0x7f70e4102190 2024-09-11T00:01:15.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70da7fc640 1 -- 172.21.15.19:0/17502030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4035070 con 0x7f70e4102190 2024-09-11T00:01:15.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.573+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e41a7f40 con 0x7f70e4102190 2024-09-11T00:01:15.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.574+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e4101c50 con 0x7f70e4102190 2024-09-11T00:01:15.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.576+0000 7f70da7fc640 1 -- 172.21.15.19:0/17502030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f70d403bcc0 con 0x7f70e4102190 2024-09-11T00:01:15.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.576+0000 7f70da7fc640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70d00b53c0 0x7f70d00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:15.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.577+0000 7f70e9367640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70d00b53c0 0x7f70d00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:15.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.577+0000 7f70da7fc640 1 -- 172.21.15.19:0/17502030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f70d4106be0 con 0x7f70e4102190 2024-09-11T00:01:15.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.577+0000 7f70e9367640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70d00b53c0 0x7f70d00b7880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009b60 tx=0x7f70e0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:15.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.580+0000 7f70da7fc640 1 -- 172.21.15.19:0/17502030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f70d40cd840 con 0x7f70e4102190 2024-09-11T00:01:15.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.767+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70e41a81e0 con 0x7f70e4102190 2024-09-11T00:01:15.769 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:15 smithi019 ceph-mon[30859]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:15.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.769+0000 7f70da7fc640 1 -- 172.21.15.19:0/17502030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22967 (secure 0 0 0) 0x7f70d40cd140 con 0x7f70e4102190 2024-09-11T00:01:15.770 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:15.770 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:53.600623+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:01:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70d00b53c0 msgr2=0x7f70d00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70d00b53c0 0x7f70d00b7880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009b60 tx=0x7f70e0005f90 comp rx=0 tx=0).stop 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 msgr2=0x7f70e419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e419ba20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70d4005940 tx=0x7f70d4004270 comp rx=0 tx=0).stop 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 shutdown_connections 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70e410f420 0x7f70e41a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70d00b53c0 0x7f70d00b7880 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70e4102190 0x7f70e419ba20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 --2- 172.21.15.19:0/17502030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e4101870 0x7f70e419b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 >> 172.21.15.19:0/17502030 conn(0x7f70e40fd700 msgr2=0x7f70e40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 shutdown_connections 2024-09-11T00:01:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:15.771+0000 7f70eb5cb640 1 -- 172.21.15.19:0/17502030 wait complete. 2024-09-11T00:01:15.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:15 smithi135 ceph-mon[35432]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:16.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:15 smithi131 ceph-mon[35491]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:16.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T00:01:16.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T00:01:16.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T00:01:16.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T00:01:16.497 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T00:01:16.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T00:01:16.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T00:01:16.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T00:01:16.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T00:01:16.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T00:01:16.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T00:01:16.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T00:01:16.742 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:16 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/17502030' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:17.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:16 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/17502030' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:17.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:16 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/17502030' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.379 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.382 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.383 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.386 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.390 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.391 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.393 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.394 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:17.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:17 smithi019 ceph-mon[30859]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:17.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:17 smithi135 ceph-mon[35432]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:18.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:17 smithi131 ceph-mon[35491]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 -- 172.21.15.19:0/2023846058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102de0 msgr2=0x7f37041031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 --2- 172.21.15.19:0/2023846058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102de0 0x7f37041031c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009900 tx=0x7f36f402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 -- 172.21.15.19:0/2023846058 shutdown_connections 2024-09-11T00:01:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 --2- 172.21.15.19:0/2023846058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3704109170 0x7f370410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 --2- 172.21.15.19:0/2023846058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37041087f0 0x7f3704108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 --2- 172.21.15.19:0/2023846058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102de0 0x7f37041031c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 -- 172.21.15.19:0/2023846058 >> 172.21.15.19:0/2023846058 conn(0x7f37040fe830 msgr2=0x7f3704100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 -- 172.21.15.19:0/2023846058 shutdown_connections 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.305+0000 7f3709b6a640 1 -- 172.21.15.19:0/2023846058 wait complete. 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 Processor -- start 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 -- start start 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3704102de0 0x7f3704199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37041087f0 0x7f3704199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704109170 0x7f370419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3704112e30 con 0x7f37041087f0 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3704112cb0 con 0x7f3704109170 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3709b6a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3704112fb0 con 0x7f3704102de0 2024-09-11T00:01:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f36faffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37041087f0 0x7f3704199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f36faffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37041087f0 0x7f3704199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49358/0 (socket says 172.21.15.19:49358) 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f36faffd640 1 -- 172.21.15.19:0/942746720 learned_addr learned my addr 172.21.15.19:0/942746720 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f37037fe640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3704102de0 0x7f3704199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f3703fff640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704109170 0x7f370419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.306+0000 7f36faffd640 1 -- 172.21.15.19:0/942746720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3704102de0 msgr2=0x7f3704199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f36faffd640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3704102de0 0x7f3704199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f36faffd640 1 -- 172.21.15.19:0/942746720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704109170 msgr2=0x7f370419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f36faffd640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704109170 0x7f370419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f36faffd640 1 -- 172.21.15.19:0/942746720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370419f3b0 con 0x7f37041087f0 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f3703fff640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704109170 0x7f370419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f36faffd640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37041087f0 0x7f3704199840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00b4a0 tx=0x7f36ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec014070 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370419f6a0 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36ec010ac0 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec017c30 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.307+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041a5f30 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.308+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37040638e0 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.309+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f36ec010610 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.310+0000 7f37017fa640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36f00b53c0 0x7f36f00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f37037fe640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36f00b53c0 0x7f36f00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f36ec0e5860 con 0x7f37041087f0 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f37017fa640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] conn(0x7f36f00bf060 0x7f36f00c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 --> [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36ec011e50 con 0x7f36f00bf060 2024-09-11T00:01:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f36ec0e5c10 con 0x7f37041087f0 2024-09-11T00:01:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f37037fe640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36f00b53c0 0x7f36f00b7880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36f4031440 tx=0x7f36f4005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f3703fff640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] conn(0x7f36f00bf060 0x7f36f00c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.311+0000 7f3703fff640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] conn(0x7f36f00bf060 0x7f36f00c1500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.312+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== osd.3 v2:172.21.15.19:6810/1691087553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36ec011e50 con 0x7f36f00bf060 2024-09-11T00:01:18.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.326+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 --> [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3704063ce0 con 0x7f36f00bf060 2024-09-11T00:01:18.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f37017fa640 1 -- 172.21.15.19:0/942746720 <== osd.3 v2:172.21.15.19:6810/1691087553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3704063ce0 con 0x7f36f00bf060 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] conn(0x7f36f00bf060 msgr2=0x7f36f00c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] conn(0x7f36f00bf060 0x7f36f00c1500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36f00b53c0 msgr2=0x7f36f00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36f00b53c0 0x7f36f00b7880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36f4031440 tx=0x7f36f4005b50 comp rx=0 tx=0).stop 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37041087f0 msgr2=0x7f3704199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 --2- 172.21.15.19:0/942746720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37041087f0 0x7f3704199840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00b4a0 tx=0x7f36ec00b960 comp rx=0 tx=0).stop 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3703fff640 1 -- 172.21.15.19:0/942746720 reap_dead start 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 shutdown_connections 2024-09-11T00:01:18.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 >> 172.21.15.19:0/942746720 conn(0x7f37040fe830 msgr2=0x7f3704100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:18.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 shutdown_connections 2024-09-11T00:01:18.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:18.327+0000 7f3709b6a640 1 -- 172.21.15.19:0/942746720 wait complete. 2024-09-11T00:01:19.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:19 smithi019 ceph-mon[30859]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:19.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 -- 172.21.15.19:0/3939231405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc1045c0 msgr2=0x7fc5cc10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:19.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 --2- 172.21.15.19:0/3939231405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc1045c0 0x7fc5cc10cab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009900 tx=0x7fc5bc02a410 comp rx=0 tx=0).stop 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 -- 172.21.15.19:0/3939231405 shutdown_connections 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 --2- 172.21.15.19:0/3939231405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5cc10d100 0x7fc5cc10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 --2- 172.21.15.19:0/3939231405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc1045c0 0x7fc5cc10cab0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 --2- 172.21.15.19:0/3939231405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5cc103ca0 0x7fc5cc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 -- 172.21.15.19:0/3939231405 >> 172.21.15.19:0/3939231405 conn(0x7fc5cc0fd700 msgr2=0x7fc5cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 -- 172.21.15.19:0/3939231405 shutdown_connections 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.773+0000 7fc5d108e640 1 -- 172.21.15.19:0/3939231405 wait complete. 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 Processor -- start 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 -- start start 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5cc103ca0 0x7fc5cc101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5cc1045c0 0x7fc5cc101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc10d100 0x7fc5cc1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:19.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc112db0 con 0x7fc5cc10d100 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc112c30 con 0x7fc5cc1045c0 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.774+0000 7fc5d108e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc112f30 con 0x7fc5cc103ca0 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc10d100 0x7fc5cc1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc10d100 0x7fc5cc1023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49376/0 (socket says 172.21.15.19:49376) 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 -- 172.21.15.19:0/1474421841 learned_addr learned my addr 172.21.15.19:0/1474421841 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5ca59c640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5cc1045c0 0x7fc5cc101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cad9d640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5cc103ca0 0x7fc5cc101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 -- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5cc103ca0 msgr2=0x7fc5cc101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5cc103ca0 0x7fc5cc101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 -- 172.21.15.19:0/1474421841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5cc1045c0 msgr2=0x7fc5cc101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5cc1045c0 0x7fc5cc101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 -- 172.21.15.19:0/1474421841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc1a76e0 con 0x7fc5cc10d100 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5cb59e640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc10d100 0x7fc5cc1023d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c970 tx=0x7fc5b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4007bb0 con 0x7fc5cc10d100 2024-09-11T00:01:19.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b4007d50 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5cc1a79d0 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4018770 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.775+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5cc1a7f10 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.776+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5cc0ff660 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.778+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fc5b400f990 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.778+0000 7fc5c3fff640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc5ac0b53c0 0x7fc5ac0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5cad9d640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc5ac0b53c0 0x7fc5ac0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc5b40e62a0 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5c3fff640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] conn(0x7fc5ac0bf060 0x7fc5ac0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 --> [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5b4024ea0 con 0x7fc5ac0bf060 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fc5b40e66f0 con 0x7fc5cc10d100 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5cad9d640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc5ac0b53c0 0x7fc5ac0b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009f20 tx=0x7fc5c40094f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:19.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5ca59c640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] conn(0x7fc5ac0bf060 0x7fc5ac0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:19.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.779+0000 7fc5ca59c640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] conn(0x7fc5ac0bf060 0x7fc5ac0c1500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:19.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.780+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== osd.8 v2:172.21.15.135:6816/1258842145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5b4024ea0 con 0x7fc5ac0bf060 2024-09-11T00:01:19.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.794+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 --> [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5cc06b1b0 con 0x7fc5ac0bf060 2024-09-11T00:01:19.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.794+0000 7fc5c3fff640 1 -- 172.21.15.19:0/1474421841 <== osd.8 v2:172.21.15.135:6816/1258842145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc5cc06b1b0 con 0x7fc5ac0bf060 2024-09-11T00:01:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] conn(0x7fc5ac0bf060 msgr2=0x7fc5ac0c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] conn(0x7fc5ac0bf060 0x7fc5ac0c1500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc5ac0b53c0 msgr2=0x7fc5ac0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc5ac0b53c0 0x7fc5ac0b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009f20 tx=0x7fc5c40094f0 comp rx=0 tx=0).stop 2024-09-11T00:01:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc10d100 msgr2=0x7fc5cc1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 --2- 172.21.15.19:0/1474421841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5cc10d100 0x7fc5cc1023d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c970 tx=0x7fc5b400ce30 comp rx=0 tx=0).stop 2024-09-11T00:01:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5cb59e640 1 -- 172.21.15.19:0/1474421841 reap_dead start 2024-09-11T00:01:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 shutdown_connections 2024-09-11T00:01:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 >> 172.21.15.19:0/1474421841 conn(0x7fc5cc0fd700 msgr2=0x7fc5cc10f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 shutdown_connections 2024-09-11T00:01:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:19.795+0000 7fc5d108e640 1 -- 172.21.15.19:0/1474421841 wait complete. 2024-09-11T00:01:20.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:19 smithi131 ceph-mon[35491]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:20.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:19 smithi135 ceph-mon[35432]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:20.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 -- 172.21.15.19:0/2505154743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34101810 msgr2=0x7feb34101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 --2- 172.21.15.19:0/2505154743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34101810 0x7feb34101bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb24009900 tx=0x7feb2402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:20.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 -- 172.21.15.19:0/2505154743 shutdown_connections 2024-09-11T00:01:20.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 --2- 172.21.15.19:0/2505154743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb341077c0 0x7feb3410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 --2- 172.21.15.19:0/2505154743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb34106e40 0x7feb34107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 --2- 172.21.15.19:0/2505154743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34101810 0x7feb34101bf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 -- 172.21.15.19:0/2505154743 >> 172.21.15.19:0/2505154743 conn(0x7feb34076f50 msgr2=0x7feb34077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 -- 172.21.15.19:0/2505154743 shutdown_connections 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 -- 172.21.15.19:0/2505154743 wait complete. 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.379+0000 7feb3a29b640 1 Processor -- start 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb3a29b640 1 -- start start 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb3a29b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb34101810 0x7feb34199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb3a29b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34106e40 0x7feb341998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb3a29b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb341077c0 0x7feb3419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb3a29b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb34112df0 con 0x7feb34106e40 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb3a29b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb34112c70 con 0x7feb34101810 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb3a29b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb34112f70 con 0x7feb341077c0 2024-09-11T00:01:20.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34106e40 0x7feb341998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34106e40 0x7feb341998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49422/0 (socket says 172.21.15.19:49422) 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 -- 172.21.15.19:0/856525632 learned_addr learned my addr 172.21.15.19:0/856525632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb38838640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb341077c0 0x7feb3419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb33fff640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb34101810 0x7feb34199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 -- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb341077c0 msgr2=0x7feb3419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb341077c0 0x7feb3419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 -- 172.21.15.19:0/856525632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb34101810 msgr2=0x7feb34199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb34101810 0x7feb34199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 -- 172.21.15.19:0/856525632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3419f430 con 0x7feb34106e40 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.380+0000 7feb337fe640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34106e40 0x7feb341998c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c890 tx=0x7feb2800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.381+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28004220 con 0x7feb34106e40 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.381+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb280043c0 con 0x7feb34106e40 2024-09-11T00:01:20.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.381+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3419f720 con 0x7feb34106e40 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.381+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28004a00 con 0x7feb34106e40 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.381+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb341a5fb0 con 0x7feb34106e40 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.382+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb34063860 con 0x7feb34106e40 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.383+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7feb280079b0 con 0x7feb34106e40 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb317fa640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb1c0b5440 0x7feb1c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb33fff640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb1c0b5440 0x7feb1c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7feb280e6000 con 0x7feb34106e40 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb317fa640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] conn(0x7feb1c0bf0e0 0x7feb1c0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 --> [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb1c0c1c50 con 0x7feb1c0bf0e0 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7feb280e6450 con 0x7feb34106e40 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb33fff640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb1c0b5440 0x7feb1c0b7900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feb24031440 tx=0x7feb240095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:20.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.384+0000 7feb38838640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] conn(0x7feb1c0bf0e0 0x7feb1c0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.385+0000 7feb38838640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] conn(0x7feb1c0bf0e0 0x7feb1c0c1580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.386+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== osd.2 v2:172.21.15.135:6800/3850868245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb1c0c1c50 con 0x7feb1c0bf0e0 2024-09-11T00:01:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.399+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 --> [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb34063c60 con 0x7feb1c0bf0e0 2024-09-11T00:01:20.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb317fa640 1 -- 172.21.15.19:0/856525632 <== osd.2 v2:172.21.15.135:6800/3850868245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb34063c60 con 0x7feb1c0bf0e0 2024-09-11T00:01:20.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] conn(0x7feb1c0bf0e0 msgr2=0x7feb1c0c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] conn(0x7feb1c0bf0e0 0x7feb1c0c1580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb1c0b5440 msgr2=0x7feb1c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb1c0b5440 0x7feb1c0b7900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feb24031440 tx=0x7feb240095f0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34106e40 msgr2=0x7feb341998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 --2- 172.21.15.19:0/856525632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb34106e40 0x7feb341998c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c890 tx=0x7feb2800cd50 comp rx=0 tx=0).stop 2024-09-11T00:01:20.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb38838640 1 -- 172.21.15.19:0/856525632 reap_dead start 2024-09-11T00:01:20.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 shutdown_connections 2024-09-11T00:01:20.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 >> 172.21.15.19:0/856525632 conn(0x7feb34076f50 msgr2=0x7feb340ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:20.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 shutdown_connections 2024-09-11T00:01:20.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.400+0000 7feb3a29b640 1 -- 172.21.15.19:0/856525632 wait complete. 2024-09-11T00:01:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 -- 172.21.15.19:0/2145141995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 msgr2=0x7f294010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 --2- 172.21.15.19:0/2145141995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 0x7f294010f950 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2938009ca0 tx=0x7f293802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 -- 172.21.15.19:0/2145141995 shutdown_connections 2024-09-11T00:01:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 --2- 172.21.15.19:0/2145141995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 0x7f294010f950 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 --2- 172.21.15.19:0/2145141995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f2940108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 --2- 172.21.15.19:0/2145141995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940102dc0 0x7f29401031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 -- 172.21.15.19:0/2145141995 >> 172.21.15.19:0/2145141995 conn(0x7f29400fe870 msgr2=0x7f2940100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 -- 172.21.15.19:0/2145141995 shutdown_connections 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.255+0000 7f2947373640 1 -- 172.21.15.19:0/2145141995 wait complete. 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 Processor -- start 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 -- start start 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940102dc0 0x7f2940199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f2940199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 0x7f294019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2940112e10 con 0x7f2940109150 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2940112c90 con 0x7f29401087d0 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2947373640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2940112f90 con 0x7f2940102dc0 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 0x7f294019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 0x7f294019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49402/0 (socket says 172.21.15.19:49402) 2024-09-11T00:01:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 -- 172.21.15.19:0/41350635 learned_addr learned my addr 172.21.15.19:0/41350635 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f294490e640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f2940199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f294510f640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940102dc0 0x7f2940199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 -- 172.21.15.19:0/41350635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940102dc0 msgr2=0x7f2940199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940102dc0 0x7f2940199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 -- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 msgr2=0x7f2940199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f2940199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.256+0000 7f2945910640 1 -- 172.21.15.19:0/41350635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294019f2d0 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.257+0000 7f2945910640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 0x7f294019eb00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2938005cc0 tx=0x7f293802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.257+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938003bf0 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.257+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294019f560 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.257+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2938003d90 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.257+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293802fbc0 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.257+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29401a5c80 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.258+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29400638a0 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.259+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f2938004610 con 0x7f2940109150 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.260+0000 7f29367fc640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b53c0 0x7f292c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.260+0000 7f294510f640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b53c0 0x7f292c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.260+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f29381075c0 con 0x7f2940109150 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.260+0000 7f29367fc640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] conn(0x7f292c0bf060 0x7f292c0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.260+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 --> [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f292c0c1bd0 con 0x7f292c0bf060 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.260+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f2938107a10 con 0x7f2940109150 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.261+0000 7f294510f640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b53c0 0x7f292c0b7880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f293c005fd0 tx=0x7f293c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.261+0000 7f294490e640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] conn(0x7f292c0bf060 0x7f292c0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.261+0000 7f294490e640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] conn(0x7f292c0bf060 0x7f292c0c1500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.262+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== osd.4 v2:172.21.15.131:6808/250661719 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f292c0c1bd0 con 0x7f292c0bf060 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.276+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 --> [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2940063d20 con 0x7f292c0bf060 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.276+0000 7f29367fc640 1 -- 172.21.15.19:0/41350635 <== osd.4 v2:172.21.15.131:6808/250661719 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2940063d20 con 0x7f292c0bf060 2024-09-11T00:01:20.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.276+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] conn(0x7f292c0bf060 msgr2=0x7f292c0c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.276+0000 7f2947373640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] conn(0x7f292c0bf060 0x7f292c0c1500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b53c0 msgr2=0x7f292c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b53c0 0x7f292c0b7880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f293c005fd0 tx=0x7f293c005850 comp rx=0 tx=0).stop 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 msgr2=0x7f294019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 --2- 172.21.15.19:0/41350635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940109150 0x7f294019eb00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2938005cc0 tx=0x7f293802f380 comp rx=0 tx=0).stop 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2945910640 1 -- 172.21.15.19:0/41350635 reap_dead start 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 shutdown_connections 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 >> 172.21.15.19:0/41350635 conn(0x7f29400fe870 msgr2=0x7f2940100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 shutdown_connections 2024-09-11T00:01:20.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.277+0000 7f2947373640 1 -- 172.21.15.19:0/41350635 wait complete. 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 -- 172.21.15.19:0/2845857657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8102dc0 msgr2=0x7f36b81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 --2- 172.21.15.19:0/2845857657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8102dc0 0x7f36b81031a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009900 tx=0x7f36b402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 -- 172.21.15.19:0/2845857657 shutdown_connections 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 --2- 172.21.15.19:0/2845857657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36b8109150 0x7f36b810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 --2- 172.21.15.19:0/2845857657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b81087d0 0x7f36b8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 --2- 172.21.15.19:0/2845857657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8102dc0 0x7f36b81031a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 -- 172.21.15.19:0/2845857657 >> 172.21.15.19:0/2845857657 conn(0x7f36b80fe830 msgr2=0x7f36b8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:21.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 -- 172.21.15.19:0/2845857657 shutdown_connections 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.986+0000 7f36c06a4640 1 -- 172.21.15.19:0/2845857657 wait complete. 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 Processor -- start 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 -- start start 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b8102dc0 0x7f36b80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36b81087d0 0x7f36b80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8109150 0x7f36b8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f36b8112e10 con 0x7f36b8109150 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f36b8112c90 con 0x7f36b81087d0 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36c06a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36b8112f90 con 0x7f36b8102dc0 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36bec41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8109150 0x7f36b8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.987+0000 7f36bec41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8109150 0x7f36b8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49442/0 (socket says 172.21.15.19:49442) 2024-09-11T00:01:21.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bec41640 1 -- 172.21.15.19:0/703250887 learned_addr learned my addr 172.21.15.19:0/703250887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bdc3f640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36b81087d0 0x7f36b80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36be440640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b8102dc0 0x7f36b80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bec41640 1 -- 172.21.15.19:0/703250887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b8102dc0 msgr2=0x7f36b80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bec41640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b8102dc0 0x7f36b80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bec41640 1 -- 172.21.15.19:0/703250887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36b81087d0 msgr2=0x7f36b80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bec41640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36b81087d0 0x7f36b80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bec41640 1 -- 172.21.15.19:0/703250887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b81a76e0 con 0x7f36b8109150 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bdc3f640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36b81087d0 0x7f36b80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36be440640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b8102dc0 0x7f36b80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36bec41640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8109150 0x7f36b8075f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f36b000b970 tx=0x7f36b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0019070 con 0x7f36b8109150 2024-09-11T00:01:21.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36b0014440 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b00075d0 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b81a79d0 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.988+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b81a7f40 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.989+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36b80638e0 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.991+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f36b0026050 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.991+0000 7f36af7fe640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36a40b53c0 0x7f36a40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36be440640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36a40b53c0 0x7f36a40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f36b00e5bd0 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36af7fe640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] conn(0x7f36a40bf060 0x7f36a40c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 --> [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36b0009220 con 0x7f36a40bf060 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f36b00e6020 con 0x7f36b8109150 2024-09-11T00:01:21.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36bdc3f640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] conn(0x7f36a40bf060 0x7f36a40c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36be440640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36a40b53c0 0x7f36a40b7880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:21.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.992+0000 7f36bdc3f640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] conn(0x7f36a40bf060 0x7f36a40c1500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:21.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:20.993+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== osd.0 v2:172.21.15.19:6802/2233994763 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36b0009220 con 0x7f36a40bf060 2024-09-11T00:01:21.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.007+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 --> [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f36b8063d60 con 0x7f36a40bf060 2024-09-11T00:01:21.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.007+0000 7f36af7fe640 1 -- 172.21.15.19:0/703250887 <== osd.0 v2:172.21.15.19:6802/2233994763 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f36b8063d60 con 0x7f36a40bf060 2024-09-11T00:01:21.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] conn(0x7f36a40bf060 msgr2=0x7f36a40c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] conn(0x7f36a40bf060 0x7f36a40c1500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36a40b53c0 msgr2=0x7f36a40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f36a40b53c0 0x7f36a40b7880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4031400 comp rx=0 tx=0).stop 2024-09-11T00:01:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8109150 msgr2=0x7f36b8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 --2- 172.21.15.19:0/703250887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36b8109150 0x7f36b8075f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f36b000b970 tx=0x7f36b000be30 comp rx=0 tx=0).stop 2024-09-11T00:01:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36bec41640 1 -- 172.21.15.19:0/703250887 reap_dead start 2024-09-11T00:01:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 shutdown_connections 2024-09-11T00:01:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 >> 172.21.15.19:0/703250887 conn(0x7f36b80fe830 msgr2=0x7f36b8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 shutdown_connections 2024-09-11T00:01:21.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.008+0000 7f36c06a4640 1 -- 172.21.15.19:0/703250887 wait complete. 2024-09-11T00:01:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 -- 172.21.15.19:0/3945867432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 msgr2=0x7f5e141031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 --2- 172.21.15.19:0/3945867432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 0x7f5e141031a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009900 tx=0x7f5e1002a410 comp rx=0 tx=0).stop 2024-09-11T00:01:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 -- 172.21.15.19:0/3945867432 shutdown_connections 2024-09-11T00:01:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 --2- 172.21.15.19:0/3945867432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e14109150 0x7f5e1410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 --2- 172.21.15.19:0/3945867432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e141087d0 0x7f5e14108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 --2- 172.21.15.19:0/3945867432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 0x7f5e141031a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 -- 172.21.15.19:0/3945867432 >> 172.21.15.19:0/3945867432 conn(0x7f5e140fe830 msgr2=0x7f5e14100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 -- 172.21.15.19:0/3945867432 shutdown_connections 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 -- 172.21.15.19:0/3945867432 wait complete. 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.190+0000 7f5e1bf44640 1 Processor -- start 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e1bf44640 1 -- start start 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e1bf44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 0x7f5e141992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e1bf44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e141087d0 0x7f5e14199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e1bf44640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e14109150 0x7f5e1419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e1bf44640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14112e10 con 0x7f5e14102dc0 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e1bf44640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14112c90 con 0x7f5e14109150 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e1bf44640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14112f90 con 0x7f5e141087d0 2024-09-11T00:01:21.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 0x7f5e141992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 0x7f5e141992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49448/0 (socket says 172.21.15.19:49448) 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 -- 172.21.15.19:0/2685225984 learned_addr learned my addr 172.21.15.19:0/2685225984 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e194df640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e141087d0 0x7f5e14199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 -- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e141087d0 msgr2=0x7f5e14199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e141087d0 0x7f5e14199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 -- 172.21.15.19:0/2685225984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e14109150 msgr2=0x7f5e1419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e14109150 0x7f5e1419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 -- 172.21.15.19:0/2685225984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1419f370 con 0x7f5e14102dc0 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e194df640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e141087d0 0x7f5e14199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e19ce0640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 0x7f5e141992c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5e10005940 tx=0x7f5e100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.191+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1003f030 con 0x7f5e14102dc0 2024-09-11T00:01:21.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.192+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e10003cb0 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.192+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1419f600 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.192+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10035070 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.192+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e141a5d20 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.192+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e140638a0 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.194+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f5e1003bb50 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e0affd640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e000b53c0 0x7f5e000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e194df640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e000b53c0 0x7f5e000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5e10106d60 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e0affd640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] conn(0x7f5e000bf060 0x7f5e000c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 --> [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e10030e80 con 0x7f5e000bf060 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f5e101071b0 con 0x7f5e14102dc0 2024-09-11T00:01:21.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e194df640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e000b53c0 0x7f5e000b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005fd0 tx=0x7f5e04005ea0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:21.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.195+0000 7f5e1a4e1640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] conn(0x7f5e000bf060 0x7f5e000c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:21.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.196+0000 7f5e1a4e1640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] conn(0x7f5e000bf060 0x7f5e000c1500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:21.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.197+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== osd.5 v2:172.21.15.135:6808/1638601368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e10030e80 con 0x7f5e000bf060 2024-09-11T00:01:21.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.210+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 --> [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e14063d20 con 0x7f5e000bf060 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e0affd640 1 -- 172.21.15.19:0/2685225984 <== osd.5 v2:172.21.15.135:6808/1638601368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e14063d20 con 0x7f5e000bf060 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] conn(0x7f5e000bf060 msgr2=0x7f5e000c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] conn(0x7f5e000bf060 0x7f5e000c1500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e000b53c0 msgr2=0x7f5e000b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e000b53c0 0x7f5e000b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005fd0 tx=0x7f5e04005ea0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 msgr2=0x7f5e141992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 --2- 172.21.15.19:0/2685225984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e14102dc0 0x7f5e141992c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5e10005940 tx=0x7f5e100042f0 comp rx=0 tx=0).stop 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1a4e1640 1 -- 172.21.15.19:0/2685225984 reap_dead start 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 shutdown_connections 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 >> 172.21.15.19:0/2685225984 conn(0x7f5e140fe830 msgr2=0x7f5e14100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 shutdown_connections 2024-09-11T00:01:21.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:21.211+0000 7f5e1bf44640 1 -- 172.21.15.19:0/2685225984 wait complete. 2024-09-11T00:01:21.993 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:21 smithi019 ceph-mon[30859]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:22.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:21 smithi131 ceph-mon[35491]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:22.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:21 smithi135 ceph-mon[35432]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 -- 172.21.15.19:0/1305565679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c103ce0 msgr2=0x7f000c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 --2- 172.21.15.19:0/1305565679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c103ce0 0x7f000c1040c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efffc009900 tx=0x7efffc02a410 comp rx=0 tx=0).stop 2024-09-11T00:01:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 -- 172.21.15.19:0/1305565679 shutdown_connections 2024-09-11T00:01:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 --2- 172.21.15.19:0/1305565679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f000c10d140 0x7f000c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 --2- 172.21.15.19:0/1305565679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f000c104600 0x7f000c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 --2- 172.21.15.19:0/1305565679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c103ce0 0x7f000c1040c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 -- 172.21.15.19:0/1305565679 >> 172.21.15.19:0/1305565679 conn(0x7f000c0fd700 msgr2=0x7f000c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 -- 172.21.15.19:0/1305565679 shutdown_connections 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.280+0000 7f0012825640 1 -- 172.21.15.19:0/1305565679 wait complete. 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 Processor -- start 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 -- start start 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f000c103ce0 0x7f000c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f000c104600 0x7f000c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c10d140 0x7f000c1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f000c112db0 con 0x7f000c10d140 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f000c112c30 con 0x7f000c103ce0 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0012825640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f000c112f30 con 0x7f000c104600 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.281+0000 7f0010dc2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c10d140 0x7f000c1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f000bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f000c103ce0 0x7f000c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c10d140 0x7f000c1a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50714/0 (socket says 172.21.15.19:50714) 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 -- 172.21.15.19:0/3000328272 learned_addr learned my addr 172.21.15.19:0/3000328272 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f000b7fe640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f000c104600 0x7f000c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 -- 172.21.15.19:0/3000328272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f000c104600 msgr2=0x7f000c19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f000c104600 0x7f000c19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 -- 172.21.15.19:0/3000328272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f000c103ce0 msgr2=0x7f000c19b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f000c103ce0 0x7f000c19b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 -- 172.21.15.19:0/3000328272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c1a14f0 con 0x7f000c10d140 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0010dc2640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c10d140 0x7f000c1a0d20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f000400eaa0 tx=0x7f000400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000400cdb0 con 0x7f000c10d140 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c1a17e0 con 0x7f000c10d140 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0004005020 con 0x7f000c10d140 2024-09-11T00:01:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040116d0 con 0x7f000c10d140 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.282+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c1a7ea0 con 0x7f000c10d140 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.283+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f000c0ff660 con 0x7f000c10d140 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.285+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f000400f040 con 0x7f000c10d140 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.285+0000 7f00097fa640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efff40b5440 0x7efff40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.285+0000 7f000bfff640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efff40b5440 0x7efff40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.286+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f00040e5f80 con 0x7f000c10d140 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.286+0000 7f00097fa640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] conn(0x7efff40bf0d0 0x7efff40c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.286+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 --> [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0004014ec0 con 0x7efff40bf0d0 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.286+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f00040e63d0 con 0x7f000c10d140 2024-09-11T00:01:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.286+0000 7f000bfff640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efff40b5440 0x7efff40b7900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efffc031440 tx=0x7efffc005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:22.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.286+0000 7f000b7fe640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] conn(0x7efff40bf0d0 0x7efff40c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.286+0000 7f000b7fe640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] conn(0x7efff40bf0d0 0x7efff40c1570 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:22.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.287+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== osd.10 v2:172.21.15.131:6824/4074216082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0004014ec0 con 0x7efff40bf0d0 2024-09-11T00:01:22.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.301+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 --> [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f000c06bb90 con 0x7efff40bf0d0 2024-09-11T00:01:22.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.302+0000 7f00097fa640 1 -- 172.21.15.19:0/3000328272 <== osd.10 v2:172.21.15.131:6824/4074216082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f000c06bb90 con 0x7efff40bf0d0 2024-09-11T00:01:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 >> [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] conn(0x7efff40bf0d0 msgr2=0x7efff40c1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] conn(0x7efff40bf0d0 0x7efff40c1570 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efff40b5440 msgr2=0x7efff40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7efff40b5440 0x7efff40b7900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efffc031440 tx=0x7efffc005b50 comp rx=0 tx=0).stop 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c10d140 msgr2=0x7f000c1a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 --2- 172.21.15.19:0/3000328272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000c10d140 0x7f000c1a0d20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f000400eaa0 tx=0x7f000400ef60 comp rx=0 tx=0).stop 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0010dc2640 1 -- 172.21.15.19:0/3000328272 reap_dead start 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 shutdown_connections 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 >> 172.21.15.19:0/3000328272 conn(0x7f000c0fd700 msgr2=0x7f000c10f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 shutdown_connections 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:22.303+0000 7f0012825640 1 -- 172.21.15.19:0/3000328272 wait complete. 2024-09-11T00:01:22.773 INFO:teuthology.orchestra.run.smithi019.stdout:38654705745 2024-09-11T00:01:22.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T00:01:23.400 INFO:teuthology.orchestra.run.smithi019.stdout:227633266727 2024-09-11T00:01:23.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T00:01:23.945 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:23 smithi019 ceph-mon[30859]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:23 smithi131 ceph-mon[35491]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 -- 172.21.15.19:0/1153906206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8103ce0 msgr2=0x7fecb81040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 --2- 172.21.15.19:0/1153906206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8103ce0 0x7fecb81040c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feca8009900 tx=0x7feca802a410 comp rx=0 tx=0).stop 2024-09-11T00:01:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 -- 172.21.15.19:0/1153906206 shutdown_connections 2024-09-11T00:01:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 --2- 172.21.15.19:0/1153906206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb810d140 0x7fecb810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 --2- 172.21.15.19:0/1153906206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8104600 0x7fecb810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 --2- 172.21.15.19:0/1153906206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8103ce0 0x7fecb81040c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 -- 172.21.15.19:0/1153906206 >> 172.21.15.19:0/1153906206 conn(0x7fecb80fd700 msgr2=0x7fecb80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 -- 172.21.15.19:0/1153906206 shutdown_connections 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 -- 172.21.15.19:0/1153906206 wait complete. 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.944+0000 7fecbd701640 1 Processor -- start 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecbd701640 1 -- start start 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecbd701640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8103ce0 0x7fecb8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecbd701640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8104600 0x7fecb8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecbd701640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb810d140 0x7fecb819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecbd701640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8112df0 con 0x7fecb8104600 2024-09-11T00:01:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecbd701640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8112c70 con 0x7fecb810d140 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecbd701640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8112f70 con 0x7fecb8103ce0 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8104600 0x7fecb8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8104600 0x7fecb8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50732/0 (socket says 172.21.15.19:50732) 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 -- 172.21.15.19:0/120834062 learned_addr learned my addr 172.21.15.19:0/120834062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb77fe640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb810d140 0x7fecb819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb6ffd640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8103ce0 0x7fecb8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 -- 172.21.15.19:0/120834062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8103ce0 msgr2=0x7fecb8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8103ce0 0x7fecb8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 -- 172.21.15.19:0/120834062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb810d140 msgr2=0x7fecb819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecb810d140 0x7fecb819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 -- 172.21.15.19:0/120834062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb819f3b0 con 0x7fecb8104600 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb6ffd640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8103ce0 0x7fecb8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.945+0000 7fecb67fc640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8104600 0x7fecb8199840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fecac00d750 tx=0x7fecac00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.946+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac017070 con 0x7fecb8104600 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.946+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb819f6a0 con 0x7fecb8104600 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.946+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecac004020 con 0x7fecb8104600 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.946+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac003c00 con 0x7fecb8104600 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.946+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb8101ac0 con 0x7fecb8104600 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.947+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecb80ffd70 con 0x7fecb8104600 2024-09-11T00:01:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.948+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fecac009a30 con 0x7fecb8104600 2024-09-11T00:01:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fec9ffff640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feca00b53c0 0x7feca00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fecb6ffd640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feca00b53c0 0x7feca00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fecac0e5bd0 con 0x7fecb8104600 2024-09-11T00:01:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fec9ffff640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] conn(0x7feca00bf060 0x7feca00c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 --> [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecac01de50 con 0x7feca00bf060 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fecac0e5f80 con 0x7fecb8104600 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fecb77fe640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] conn(0x7feca00bf060 0x7feca00c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.949+0000 7fecb6ffd640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feca00b53c0 0x7feca00b7880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feca8031440 tx=0x7feca8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.950+0000 7fecb77fe640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] conn(0x7feca00bf060 0x7feca00c1500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.950+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== osd.6 v2:172.21.15.19:6818/912073333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecac01de50 con 0x7feca00bf060 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.964+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 --> [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fecb806bb90 con 0x7feca00bf060 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fec9ffff640 1 -- 172.21.15.19:0/120834062 <== osd.6 v2:172.21.15.19:6818/912073333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fecb806bb90 con 0x7feca00bf060 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] conn(0x7feca00bf060 msgr2=0x7feca00c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] conn(0x7feca00bf060 0x7feca00c1500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feca00b53c0 msgr2=0x7feca00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feca00b53c0 0x7feca00b7880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feca8031440 tx=0x7feca8005a20 comp rx=0 tx=0).stop 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8104600 msgr2=0x7fecb8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 --2- 172.21.15.19:0/120834062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecb8104600 0x7fecb8199840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fecac00d750 tx=0x7fecac00dc10 comp rx=0 tx=0).stop 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecb77fe640 1 -- 172.21.15.19:0/120834062 reap_dead start 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 shutdown_connections 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 >> 172.21.15.19:0/120834062 conn(0x7fecb80fd700 msgr2=0x7fecb80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 shutdown_connections 2024-09-11T00:01:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:23.965+0000 7fecbd701640 1 -- 172.21.15.19:0/120834062 wait complete. 2024-09-11T00:01:24.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:23 smithi135 ceph-mon[35432]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:24.777 INFO:teuthology.orchestra.run.smithi019.stdout:154618822710 2024-09-11T00:01:24.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 -- 172.21.15.19:0/1547007315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10109150 msgr2=0x7f1c1010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 --2- 172.21.15.19:0/1547007315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10109150 0x7f1c1010f950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009ca0 tx=0x7f1c0802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 -- 172.21.15.19:0/1547007315 shutdown_connections 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 --2- 172.21.15.19:0/1547007315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10109150 0x7f1c1010f950 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 --2- 172.21.15.19:0/1547007315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c101087d0 0x7f1c10108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 --2- 172.21.15.19:0/1547007315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c10102dc0 0x7f1c101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 -- 172.21.15.19:0/1547007315 >> 172.21.15.19:0/1547007315 conn(0x7f1c100fe830 msgr2=0x7f1c10100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 -- 172.21.15.19:0/1547007315 shutdown_connections 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.032+0000 7f1c156b1640 1 -- 172.21.15.19:0/1547007315 wait complete. 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 Processor -- start 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 -- start start 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10102dc0 0x7f1c101992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c101087d0 0x7f1c10199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c10109150 0x7f1c1019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10112dd0 con 0x7f1c10102dc0 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10112c50 con 0x7f1c101087d0 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c156b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10112f50 con 0x7f1c10109150 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c0effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10102dc0 0x7f1c101992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c0effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10102dc0 0x7f1c101992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50754/0 (socket says 172.21.15.19:50754) 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.033+0000 7f1c0effd640 1 -- 172.21.15.19:0/4212384117 learned_addr learned my addr 172.21.15.19:0/4212384117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c067fc640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c101087d0 0x7f1c10199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0f7fe640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c10109150 0x7f1c1019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0effd640 1 -- 172.21.15.19:0/4212384117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c10109150 msgr2=0x7f1c1019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0effd640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c10109150 0x7f1c1019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0effd640 1 -- 172.21.15.19:0/4212384117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c101087d0 msgr2=0x7f1c10199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0effd640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c101087d0 0x7f1c10199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0effd640 1 -- 172.21.15.19:0/4212384117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1019f390 con 0x7f1c10102dc0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0effd640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10102dc0 0x7f1c101992e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000d770 tx=0x7f1c0000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00017070 con 0x7f1c10102dc0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c000054d0 con 0x7f1c10102dc0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00004c30 con 0x7f1c10102dc0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1019f680 con 0x7f1c10102dc0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.034+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c101a5d40 con 0x7f1c10102dc0 2024-09-11T00:01:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.035+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c100638e0 con 0x7f1c10102dc0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.037+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f1c00023060 con 0x7f1c10102dc0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.038+0000 7f1c0cff9640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1bfc0b53c0 0x7f1bfc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.038+0000 7f1c067fc640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1bfc0b53c0 0x7f1bfc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.038+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f1c000e5710 con 0x7f1c10102dc0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.038+0000 7f1c0cff9640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] conn(0x7f1bfc0bf060 0x7f1bfc0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.038+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 --> [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c00021e70 con 0x7f1bfc0bf060 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.038+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f1c000e5ac0 con 0x7f1c10102dc0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.039+0000 7f1c0f7fe640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] conn(0x7f1bfc0bf060 0x7f1bfc0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.039+0000 7f1c067fc640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1bfc0b53c0 0x7f1bfc0b7880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1c10104f80 tx=0x7f1bf800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.039+0000 7f1c0f7fe640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] conn(0x7f1bfc0bf060 0x7f1bfc0c1500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.040+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== osd.9 v2:172.21.15.19:6826/1472748928 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c00021e70 con 0x7f1bfc0bf060 2024-09-11T00:01:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.053+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 --> [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c10063ce0 con 0x7f1bfc0bf060 2024-09-11T00:01:25.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.054+0000 7f1c0cff9640 1 -- 172.21.15.19:0/4212384117 <== osd.9 v2:172.21.15.19:6826/1472748928 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1c10063ce0 con 0x7f1bfc0bf060 2024-09-11T00:01:25.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] conn(0x7f1bfc0bf060 msgr2=0x7f1bfc0c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] conn(0x7f1bfc0bf060 0x7f1bfc0c1500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1bfc0b53c0 msgr2=0x7f1bfc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1bfc0b53c0 0x7f1bfc0b7880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1c10104f80 tx=0x7f1bf800a2d0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10102dc0 msgr2=0x7f1c101992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 --2- 172.21.15.19:0/4212384117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c10102dc0 0x7f1c101992e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000d770 tx=0x7f1c0000dc30 comp rx=0 tx=0).stop 2024-09-11T00:01:25.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c0f7fe640 1 -- 172.21.15.19:0/4212384117 reap_dead start 2024-09-11T00:01:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 shutdown_connections 2024-09-11T00:01:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 >> 172.21.15.19:0/4212384117 conn(0x7f1c100fe830 msgr2=0x7f1c100ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 shutdown_connections 2024-09-11T00:01:25.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.055+0000 7f1c156b1640 1 -- 172.21.15.19:0/4212384117 wait complete. 2024-09-11T00:01:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.372+0000 7fa3f2b64640 1 -- 172.21.15.19:0/1531940530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 msgr2=0x7fa3ec1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.372+0000 7fa3f2b64640 1 --2- 172.21.15.19:0/1531940530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 0x7fa3ec1031a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009900 tx=0x7fa3dc02a410 comp rx=0 tx=0).stop 2024-09-11T00:01:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.372+0000 7fa3f2b64640 1 -- 172.21.15.19:0/1531940530 shutdown_connections 2024-09-11T00:01:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.372+0000 7fa3f2b64640 1 --2- 172.21.15.19:0/1531940530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec109150 0x7fa3ec10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.372+0000 7fa3f2b64640 1 --2- 172.21.15.19:0/1531940530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3ec1087d0 0x7fa3ec108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.372+0000 7fa3f2b64640 1 --2- 172.21.15.19:0/1531940530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 0x7fa3ec1031a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.372+0000 7fa3f2b64640 1 -- 172.21.15.19:0/1531940530 >> 172.21.15.19:0/1531940530 conn(0x7fa3ec0fe830 msgr2=0x7fa3ec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 -- 172.21.15.19:0/1531940530 shutdown_connections 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 -- 172.21.15.19:0/1531940530 wait complete. 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 Processor -- start 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 -- start start 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 0x7fa3ec199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3ec1087d0 0x7fa3ec1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec109150 0x7fa3ec19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec112e10 con 0x7fa3ec102dc0 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec112c90 con 0x7fa3ec1087d0 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f2b64640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec112f90 con 0x7fa3ec109150 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.373+0000 7fa3f0900640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 0x7fa3ec199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 0x7fa3ec199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50780/0 (socket says 172.21.15.19:50780) 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 -- 172.21.15.19:0/965363990 learned_addr learned my addr 172.21.15.19:0/965363990 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3ebfff640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3ec1087d0 0x7fa3ec1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f1101640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec109150 0x7fa3ec19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 -- 172.21.15.19:0/965363990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec109150 msgr2=0x7fa3ec19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec109150 0x7fa3ec19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 -- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3ec1087d0 msgr2=0x7fa3ec1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3ec1087d0 0x7fa3ec1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 -- 172.21.15.19:0/965363990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec19f310 con 0x7fa3ec102dc0 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f0900640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 0x7fa3ec199260 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006010 tx=0x7fa3dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc03f030 con 0x7fa3ec102dc0 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec19f5a0 con 0x7fa3ec102dc0 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3dc003800 con 0x7fa3ec102dc0 2024-09-11T00:01:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.374+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc035070 con 0x7fa3ec102dc0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.375+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec1a5cc0 con 0x7fa3ec102dc0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.376+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3ec0638e0 con 0x7fa3ec102dc0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.377+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa3dc003cb0 con 0x7fa3ec102dc0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.378+0000 7fa3e9ffb640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.378+0000 7fa3ebfff640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.378+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa3dc106de0 con 0x7fa3ec102dc0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.378+0000 7fa3e9ffb640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] conn(0x7fa3d40bf060 0x7fa3d40c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.378+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 --> [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3dc03be50 con 0x7fa3d40bf060 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.378+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fa3dc107230 con 0x7fa3ec102dc0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.379+0000 7fa3ebfff640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec102120 tx=0x7fa3e000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.379+0000 7fa3f1101640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] conn(0x7fa3d40bf060 0x7fa3d40c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.379+0000 7fa3f1101640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] conn(0x7fa3d40bf060 0x7fa3d40c1500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.380+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== osd.1 v2:172.21.15.131:6800/832175696 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa3dc03be50 con 0x7fa3d40bf060 2024-09-11T00:01:25.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.394+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 --> [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa3ec063d60 con 0x7fa3d40bf060 2024-09-11T00:01:25.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3e9ffb640 1 -- 172.21.15.19:0/965363990 <== osd.1 v2:172.21.15.131:6800/832175696 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa3ec063d60 con 0x7fa3d40bf060 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] conn(0x7fa3d40bf060 msgr2=0x7fa3d40c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] conn(0x7fa3d40bf060 0x7fa3d40c1500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 msgr2=0x7fa3d40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa3d40b53c0 0x7fa3d40b7880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec102120 tx=0x7fa3e000a2d0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 msgr2=0x7fa3ec199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 --2- 172.21.15.19:0/965363990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ec102dc0 0x7fa3ec199260 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006010 tx=0x7fa3dc0042f0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f1101640 1 -- 172.21.15.19:0/965363990 reap_dead start 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 shutdown_connections 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 >> 172.21.15.19:0/965363990 conn(0x7fa3ec0fe830 msgr2=0x7fa3ec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 shutdown_connections 2024-09-11T00:01:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:25.395+0000 7fa3f2b64640 1 -- 172.21.15.19:0/965363990 wait complete. 2024-09-11T00:01:25.841 INFO:teuthology.orchestra.run.smithi019.stdout:111669149759 2024-09-11T00:01:25.870 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T00:01:25.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:25 smithi019 ceph-mon[30859]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:01:26.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:25 smithi131 ceph-mon[35491]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:01:26.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:25 smithi135 ceph-mon[35432]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:01:26.493 INFO:teuthology.orchestra.run.smithi019.stdout:253403070499 2024-09-11T00:01:26.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T00:01:26.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 -- 172.21.15.19:0/209949374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c101c90 msgr2=0x7fb07c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:26.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 --2- 172.21.15.19:0/209949374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c101c90 0x7fb07c102070 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb078009900 tx=0x7fb07802a410 comp rx=0 tx=0).stop 2024-09-11T00:01:26.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 -- 172.21.15.19:0/209949374 shutdown_connections 2024-09-11T00:01:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 --2- 172.21.15.19:0/209949374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb07c108020 0x7fb07c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 --2- 172.21.15.19:0/209949374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c1076a0 0x7fb07c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 --2- 172.21.15.19:0/209949374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c101c90 0x7fb07c102070 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 -- 172.21.15.19:0/209949374 >> 172.21.15.19:0/209949374 conn(0x7fb07c0fd700 msgr2=0x7fb07c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 -- 172.21.15.19:0/209949374 shutdown_connections 2024-09-11T00:01:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.646+0000 7fb083721640 1 -- 172.21.15.19:0/209949374 wait complete. 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 Processor -- start 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 -- start start 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c101c90 0x7fb07c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c1076a0 0x7fb07c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb07c108020 0x7fb07c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c111ce0 con 0x7fb07c1076a0 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c111b60 con 0x7fb07c101c90 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb083721640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c111e60 con 0x7fb07c108020 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb080cbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c1076a0 0x7fb07c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb080cbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c1076a0 0x7fb07c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50792/0 (socket says 172.21.15.19:50792) 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb080cbc640 1 -- 172.21.15.19:0/3881450047 learned_addr learned my addr 172.21.15.19:0/3881450047 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.647+0000 7fb0814bd640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c101c90 0x7fb07c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb080cbc640 1 -- 172.21.15.19:0/3881450047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb07c108020 msgr2=0x7fb07c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb080cbc640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb07c108020 0x7fb07c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb080cbc640 1 -- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c101c90 msgr2=0x7fb07c19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb080cbc640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c101c90 0x7fb07c19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb080cbc640 1 -- 172.21.15.19:0/3881450047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c1a54d0 con 0x7fb07c1076a0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb080cbc640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c1076a0 0x7fb07c19a630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00e9f0 tx=0x7fb06c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00cd80 con 0x7fb07c1076a0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c1a57c0 con 0x7fb07c1076a0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb06c0108e0 con 0x7fb07c1076a0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c018980 con 0x7fb07c1076a0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.648+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c1a5d50 con 0x7fb07c1076a0 2024-09-11T00:01:26.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.649+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb07c0638e0 con 0x7fb07c1076a0 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.651+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb06c010430 con 0x7fb07c1076a0 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.652+0000 7fb0727fc640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0680b53c0 0x7fb0680b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.652+0000 7fb0814bd640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0680b53c0 0x7fb0680b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.653+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb06c0e69d0 con 0x7fb07c1076a0 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.653+0000 7fb0727fc640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] conn(0x7fb0680bf060 0x7fb0680c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.653+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 --> [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb06c015e80 con 0x7fb0680bf060 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.653+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb06c0e6d80 con 0x7fb07c1076a0 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.653+0000 7fb0814bd640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0680b53c0 0x7fb0680b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb078031440 tx=0x7fb078005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:26.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.653+0000 7fb081cbe640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] conn(0x7fb0680bf060 0x7fb0680c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:26.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.654+0000 7fb081cbe640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] conn(0x7fb0680bf060 0x7fb0680c1500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:26.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.654+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== osd.7 v2:172.21.15.131:6816/844665956 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb06c015e80 con 0x7fb0680bf060 2024-09-11T00:01:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 --> [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb07c063ce0 con 0x7fb0680bf060 2024-09-11T00:01:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb0727fc640 1 -- 172.21.15.19:0/3881450047 <== osd.7 v2:172.21.15.131:6816/844665956 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb07c063ce0 con 0x7fb0680bf060 2024-09-11T00:01:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] conn(0x7fb0680bf060 msgr2=0x7fb0680c1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb083721640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] conn(0x7fb0680bf060 0x7fb0680c1500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0680b53c0 msgr2=0x7fb0680b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb083721640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0680b53c0 0x7fb0680b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb078031440 tx=0x7fb078005b50 comp rx=0 tx=0).stop 2024-09-11T00:01:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c1076a0 msgr2=0x7fb07c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.669+0000 7fb083721640 1 --2- 172.21.15.19:0/3881450047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb07c1076a0 0x7fb07c19a630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00e9f0 tx=0x7fb06c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:01:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.670+0000 7fb081cbe640 1 -- 172.21.15.19:0/3881450047 reap_dead start 2024-09-11T00:01:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.670+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 shutdown_connections 2024-09-11T00:01:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.670+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 >> 172.21.15.19:0/3881450047 conn(0x7fb07c0fd700 msgr2=0x7fb07c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.670+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 shutdown_connections 2024-09-11T00:01:26.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:26.670+0000 7fb083721640 1 -- 172.21.15.19:0/3881450047 wait complete. 2024-09-11T00:01:26.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:26 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:01:27.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:26 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:01:27.090 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:26 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:01:27.610 INFO:teuthology.orchestra.run.smithi019.stdout:60129542220 2024-09-11T00:01:27.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T00:01:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 -- 172.21.15.19:0/1176669667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a4103ca0 msgr2=0x7f15a4104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 --2- 172.21.15.19:0/1176669667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a4103ca0 0x7f15a4104080 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f158c009900 tx=0x7f158c02a410 comp rx=0 tx=0).stop 2024-09-11T00:01:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 -- 172.21.15.19:0/1176669667 shutdown_connections 2024-09-11T00:01:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 --2- 172.21.15.19:0/1176669667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a410d100 0x7f15a410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 --2- 172.21.15.19:0/1176669667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a41045c0 0x7f15a410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 --2- 172.21.15.19:0/1176669667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a4103ca0 0x7f15a4104080 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 -- 172.21.15.19:0/1176669667 >> 172.21.15.19:0/1176669667 conn(0x7f15a40fd700 msgr2=0x7f15a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 -- 172.21.15.19:0/1176669667 shutdown_connections 2024-09-11T00:01:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.936+0000 7f15aa22c640 1 -- 172.21.15.19:0/1176669667 wait complete. 2024-09-11T00:01:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 Processor -- start 2024-09-11T00:01:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 -- start start 2024-09-11T00:01:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4103ca0 0x7f15a4199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a41045c0 0x7f15a4199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a410d100 0x7f15a419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f15a4112d70 con 0x7f15a41045c0 2024-09-11T00:01:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f15a4112bf0 con 0x7f15a410d100 2024-09-11T00:01:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15aa22c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15a4112ef0 con 0x7f15a4103ca0 2024-09-11T00:01:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a41045c0 0x7f15a4199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a41045c0 0x7f15a4199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50740/0 (socket says 172.21.15.19:50740) 2024-09-11T00:01:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.937+0000 7f15a2ffd640 1 -- 172.21.15.19:0/2876440133 learned_addr learned my addr 172.21.15.19:0/2876440133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a3fff640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a410d100 0x7f15a419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a37fe640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4103ca0 0x7f15a4199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a2ffd640 1 -- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4103ca0 msgr2=0x7f15a4199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a2ffd640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4103ca0 0x7f15a4199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a2ffd640 1 -- 172.21.15.19:0/2876440133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a410d100 msgr2=0x7f15a419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a2ffd640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a410d100 0x7f15a419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a2ffd640 1 -- 172.21.15.19:0/2876440133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a419f2b0 con 0x7f15a41045c0 2024-09-11T00:01:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a3fff640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a410d100 0x7f15a419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a2ffd640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a41045c0 0x7f15a4199740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f159400d750 tx=0x7f159400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594017070 con 0x7f15a41045c0 2024-09-11T00:01:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1594004020 con 0x7f15a41045c0 2024-09-11T00:01:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594003c00 con 0x7f15a41045c0 2024-09-11T00:01:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a419f5a0 con 0x7f15a41045c0 2024-09-11T00:01:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.938+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a41a5e30 con 0x7f15a41045c0 2024-09-11T00:01:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.939+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15a40ff660 con 0x7f15a41045c0 2024-09-11T00:01:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.941+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f1594009a30 con 0x7f15a41045c0 2024-09-11T00:01:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.941+0000 7f15a0ff9640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f15900b5440 0x7f15900b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.942+0000 7f15a37fe640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f15900b5440 0x7f15900b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.942+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f15940e5770 con 0x7f15a41045c0 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.942+0000 7f15a0ff9640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] conn(0x7f15900bf0e0 0x7f15900c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.942+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 --> [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1594023e50 con 0x7f15900bf0e0 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.942+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f15940ec050 con 0x7f15a41045c0 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.942+0000 7f15a37fe640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f15900b5440 0x7f15900b7900 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f158c006010 tx=0x7f158c000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.942+0000 7f15a3fff640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] conn(0x7f15900bf0e0 0x7f15900c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.943+0000 7f15a3fff640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] conn(0x7f15900bf0e0 0x7f15900c1580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.944+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== osd.11 v2:172.21.15.135:6824/555413250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1594023e50 con 0x7f15900bf0e0 2024-09-11T00:01:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.959+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 --> [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f15a406b1b0 con 0x7f15900bf0e0 2024-09-11T00:01:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.959+0000 7f15a0ff9640 1 -- 172.21.15.19:0/2876440133 <== osd.11 v2:172.21.15.135:6824/555413250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f15a406b1b0 con 0x7f15900bf0e0 2024-09-11T00:01:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] conn(0x7f15900bf0e0 msgr2=0x7f15900c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] conn(0x7f15900bf0e0 0x7f15900c1580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f15900b5440 msgr2=0x7f15900b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f15900b5440 0x7f15900b7900 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f158c006010 tx=0x7f158c000bc0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a41045c0 msgr2=0x7f15a4199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 --2- 172.21.15.19:0/2876440133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a41045c0 0x7f15a4199740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f159400d750 tx=0x7f159400dc10 comp rx=0 tx=0).stop 2024-09-11T00:01:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15a3fff640 1 -- 172.21.15.19:0/2876440133 reap_dead start 2024-09-11T00:01:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 shutdown_connections 2024-09-11T00:01:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 >> 172.21.15.19:0/2876440133 conn(0x7f15a40fd700 msgr2=0x7f15a410f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 shutdown_connections 2024-09-11T00:01:27.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:24.960+0000 7f15aa22c640 1 -- 172.21.15.19:0/2876440133 wait complete. 2024-09-11T00:01:27.838 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:27 smithi019 ceph-mon[30859]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:28.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:27 smithi131 ceph-mon[35491]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:27 smithi135 ceph-mon[35432]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:28.300 INFO:teuthology.orchestra.run.smithi019.stdout:300647710745 2024-09-11T00:01:28.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T00:01:28.788 INFO:teuthology.orchestra.run.smithi019.stdout:180388626481 2024-09-11T00:01:28.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T00:01:29.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:28 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:28 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.216 INFO:teuthology.orchestra.run.smithi019.stdout:201863462958 2024-09-11T00:01:29.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T00:01:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:29.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:28 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:30.004 INFO:teuthology.orchestra.run.smithi019.stdout:137438953531 2024-09-11T00:01:30.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T00:01:30.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:29 smithi019 ceph-mon[30859]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:29 smithi131 ceph-mon[35491]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:29 smithi135 ceph-mon[35432]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:30.641 INFO:teuthology.orchestra.run.smithi019.stdout:81604378694 2024-09-11T00:01:30.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T00:01:31.193 INFO:teuthology.orchestra.run.smithi019.stdout:274877906974 2024-09-11T00:01:31.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T00:01:31.490 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.543 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.545 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.769 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.773 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:31.773 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 -- 172.21.15.19:0/2908206618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0109150 msgr2=0x7fbae010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 --2- 172.21.15.19:0/2908206618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0109150 0x7fbae010f950 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009ca0 tx=0x7fbad802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 -- 172.21.15.19:0/2908206618 shutdown_connections 2024-09-11T00:01:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 --2- 172.21.15.19:0/2908206618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0109150 0x7fbae010f950 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 --2- 172.21.15.19:0/2908206618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbae01087d0 0x7fbae0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 --2- 172.21.15.19:0/2908206618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae0102dc0 0x7fbae01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 -- 172.21.15.19:0/2908206618 >> 172.21.15.19:0/2908206618 conn(0x7fbae00fe830 msgr2=0x7fbae0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 -- 172.21.15.19:0/2908206618 shutdown_connections 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.024+0000 7fbae8771640 1 -- 172.21.15.19:0/2908206618 wait complete. 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 Processor -- start 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 -- start start 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0102dc0 0x7fbae0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbae01087d0 0x7fbae0199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae0109150 0x7fbae019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0112e10 con 0x7fbae0102dc0 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0112c90 con 0x7fbae01087d0 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae8771640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0112f90 con 0x7fbae0109150 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae650d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0102dc0 0x7fbae0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae650d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0102dc0 0x7fbae0199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47784/0 (socket says 172.21.15.19:47784) 2024-09-11T00:01:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.025+0000 7fbae650d640 1 -- 172.21.15.19:0/1793595759 learned_addr learned my addr 172.21.15.19:0/1793595759 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae5d0c640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbae01087d0 0x7fbae0199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae6d0e640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae0109150 0x7fbae019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae650d640 1 -- 172.21.15.19:0/1793595759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae0109150 msgr2=0x7fbae019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae650d640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae0109150 0x7fbae019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae650d640 1 -- 172.21.15.19:0/1793595759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbae01087d0 msgr2=0x7fbae0199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae650d640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbae01087d0 0x7fbae0199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae650d640 1 -- 172.21.15.19:0/1793595759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae019f2b0 con 0x7fbae0102dc0 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae6d0e640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae0109150 0x7fbae019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae5d0c640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbae01087d0 0x7fbae0199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae650d640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0102dc0 0x7fbae0199200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00d770 tx=0x7fbadc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbad77fe640 1 -- 172.21.15.19:0/1793595759 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc017070 con 0x7fbae0102dc0 2024-09-11T00:01:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbad77fe640 1 -- 172.21.15.19:0/1793595759 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbadc0054d0 con 0x7fbae0102dc0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae019f5a0 con 0x7fbae0102dc0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbad77fe640 1 -- 172.21.15.19:0/1793595759 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc004c30 con 0x7fbae0102dc0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.026+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae01a5c60 con 0x7fbae0102dc0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.027+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae01031a0 con 0x7fbae0102dc0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.030+0000 7fbad77fe640 1 -- 172.21.15.19:0/1793595759 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fbadc004dd0 con 0x7fbae0102dc0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.030+0000 7fbad77fe640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbacc0b5440 0x7fbacc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.030+0000 7fbae5d0c640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbacc0b5440 0x7fbacc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.030+0000 7fbad77fe640 1 -- 172.21.15.19:0/1793595759 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fbadc0e5d70 con 0x7fbae0102dc0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.031+0000 7fbae5d0c640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbacc0b5440 0x7fbacc0b7900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbae0100f60 tx=0x7fbad000a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.033+0000 7fbad77fe640 1 -- 172.21.15.19:0/1793595759 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbadc0acab0 con 0x7fbae0102dc0 2024-09-11T00:01:32.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.221+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbae01a6020 con 0x7fbae0102dc0 2024-09-11T00:01:32.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:31 smithi019 ceph-mon[30859]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.221+0000 7fbad77fe640 1 -- 172.21.15.19:0/1793595759 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbadc0ac3b0 con 0x7fbae0102dc0 2024-09-11T00:01:32.223 INFO:teuthology.orchestra.run.smithi019.stdout:154618822712 2024-09-11T00:01:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.223+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbacc0b5440 msgr2=0x7fbacc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.223+0000 7fbae8771640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbacc0b5440 0x7fbacc0b7900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbae0100f60 tx=0x7fbad000a5c0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.223+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0102dc0 msgr2=0x7fbae0199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.223+0000 7fbae8771640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0102dc0 0x7fbae0199200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00d770 tx=0x7fbadc00dc30 comp rx=0 tx=0).stop 2024-09-11T00:01:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.223+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 shutdown_connections 2024-09-11T00:01:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.223+0000 7fbae8771640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae0109150 0x7fbae019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.224+0000 7fbae8771640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbae01087d0 0x7fbae0199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.224+0000 7fbae8771640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbacc0b5440 0x7fbacc0b7900 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.224+0000 7fbae8771640 1 --2- 172.21.15.19:0/1793595759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbae0102dc0 0x7fbae0199200 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.224+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 >> 172.21.15.19:0/1793595759 conn(0x7fbae00fe830 msgr2=0x7fbae0101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.224+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 shutdown_connections 2024-09-11T00:01:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:32.224+0000 7fbae8771640 1 -- 172.21.15.19:0/1793595759 wait complete. 2024-09-11T00:01:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:31 smithi131 ceph-mon[35491]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:31 smithi135 ceph-mon[35432]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:33.080 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1793595759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T00:01:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 -- 172.21.15.19:0/3596940284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424075e60 msgr2=0x7f24241135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 --2- 172.21.15.19:0/3596940284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424075e60 0x7f24241135e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2414009900 tx=0x7f241402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 -- 172.21.15.19:0/3596940284 shutdown_connections 2024-09-11T00:01:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 --2- 172.21.15.19:0/3596940284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2424113b20 0x7f2424115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 --2- 172.21.15.19:0/3596940284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424075e60 0x7f24241135e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 --2- 172.21.15.19:0/3596940284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2424075540 0x7f2424075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 -- 172.21.15.19:0/3596940284 >> 172.21.15.19:0/3596940284 conn(0x7f24240fe830 msgr2=0x7f2424100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 -- 172.21.15.19:0/3596940284 shutdown_connections 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.078+0000 7f242b903640 1 -- 172.21.15.19:0/3596940284 wait complete. 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 Processor -- start 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 -- start start 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2424075540 0x7f242419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2424075e60 0x7f242419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424113b20 0x7f24241a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2424119400 con 0x7f2424113b20 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2424119280 con 0x7f2424075e60 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242b903640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2424119580 con 0x7f2424075540 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f2429ea0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424113b20 0x7f24241a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f2429ea0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424113b20 0x7f24241a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47800/0 (socket says 172.21.15.19:47800) 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f242969f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2424075540 0x7f242419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.079+0000 7f2429ea0640 1 -- 172.21.15.19:0/2498107045 learned_addr learned my addr 172.21.15.19:0/2498107045 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f2428e9e640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2424075e60 0x7f242419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f2429ea0640 1 -- 172.21.15.19:0/2498107045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2424075540 msgr2=0x7f242419f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f2429ea0640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2424075540 0x7f242419f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f2429ea0640 1 -- 172.21.15.19:0/2498107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2424075e60 msgr2=0x7f242419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f2429ea0640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2424075e60 0x7f242419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f2429ea0640 1 -- 172.21.15.19:0/2498107045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24241a5980 con 0x7f2424113b20 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f242969f640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2424075540 0x7f242419f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f2429ea0640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424113b20 0x7f24241a51b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f241c00e9d0 tx=0x7f241c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f241a7fc640 1 -- 172.21.15.19:0/2498107045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c00cd80 con 0x7f2424113b20 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24241a5c70 con 0x7f2424113b20 2024-09-11T00:01:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f241a7fc640 1 -- 172.21.15.19:0/2498107045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f241c005020 con 0x7f2424113b20 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f241a7fc640 1 -- 172.21.15.19:0/2498107045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c0116d0 con 0x7f2424113b20 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.080+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24241ac500 con 0x7f2424113b20 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.081+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2424075920 con 0x7f2424113b20 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.083+0000 7f241a7fc640 1 -- 172.21.15.19:0/2498107045 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f241c00f040 con 0x7f2424113b20 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.083+0000 7f241a7fc640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24100b53c0 0x7f24100b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.083+0000 7f242969f640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24100b53c0 0x7f24100b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.083+0000 7f241a7fc640 1 -- 172.21.15.19:0/2498107045 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f241c0e6000 con 0x7f2424113b20 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.084+0000 7f242969f640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24100b53c0 0x7f24100b7880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24200058c0 tx=0x7f242000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.087+0000 7f241a7fc640 1 -- 172.21.15.19:0/2498107045 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f241c016030 con 0x7f2424113b20 2024-09-11T00:01:33.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.276+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f24241ac6d0 con 0x7f2424113b20 2024-09-11T00:01:33.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.276+0000 7f241a7fc640 1 -- 172.21.15.19:0/2498107045 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f241c0ac670 con 0x7f2424113b20 2024-09-11T00:01:33.278 INFO:teuthology.orchestra.run.smithi019.stdout:60129542221 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24100b53c0 msgr2=0x7f24100b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24100b53c0 0x7f24100b7880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24200058c0 tx=0x7f242000a2d0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424113b20 msgr2=0x7f24241a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424113b20 0x7f24241a51b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f241c00e9d0 tx=0x7f241c00ee90 comp rx=0 tx=0).stop 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 shutdown_connections 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24100b53c0 0x7f24100b7880 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2424113b20 0x7f24241a51b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2424075e60 0x7f242419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 --2- 172.21.15.19:0/2498107045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2424075540 0x7f242419f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.278+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 >> 172.21.15.19:0/2498107045 conn(0x7f24240fe830 msgr2=0x7f24240ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:33.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.279+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 shutdown_connections 2024-09-11T00:01:33.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.279+0000 7f242b903640 1 -- 172.21.15.19:0/2498107045 wait complete. 2024-09-11T00:01:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1793595759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 -- 172.21.15.19:0/1562567520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d8102dc0 msgr2=0x7fb0d81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 --2- 172.21.15.19:0/1562567520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d8102dc0 0x7fb0d81031a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009900 tx=0x7fb0c802a410 comp rx=0 tx=0).stop 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 -- 172.21.15.19:0/1562567520 shutdown_connections 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 --2- 172.21.15.19:0/1562567520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d8109150 0x7fb0d810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 --2- 172.21.15.19:0/1562567520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d81087d0 0x7fb0d8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 --2- 172.21.15.19:0/1562567520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d8102dc0 0x7fb0d81031a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 -- 172.21.15.19:0/1562567520 >> 172.21.15.19:0/1562567520 conn(0x7fb0d80fe830 msgr2=0x7fb0d8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 -- 172.21.15.19:0/1562567520 shutdown_connections 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.315+0000 7fb0de118640 1 -- 172.21.15.19:0/1562567520 wait complete. 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 Processor -- start 2024-09-11T00:01:33.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 -- start start 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d8102dc0 0x7fb0d8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d81087d0 0x7fb0d8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d8109150 0x7fb0d819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8112e10 con 0x7fb0d81087d0 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8112c90 con 0x7fb0d8102dc0 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0de118640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8112f90 con 0x7fb0d8109150 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0d6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d81087d0 0x7fb0d8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0d6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d81087d0 0x7fb0d8199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47818/0 (socket says 172.21.15.19:47818) 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.316+0000 7fb0d6ffd640 1 -- 172.21.15.19:0/3498243891 learned_addr learned my addr 172.21.15.19:0/3498243891 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d77fe640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d8102dc0 0x7fb0d8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d7fff640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d8109150 0x7fb0d819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d6ffd640 1 -- 172.21.15.19:0/3498243891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d8109150 msgr2=0x7fb0d819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d6ffd640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d8109150 0x7fb0d819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d6ffd640 1 -- 172.21.15.19:0/3498243891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d8102dc0 msgr2=0x7fb0d8199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d6ffd640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d8102dc0 0x7fb0d8199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d6ffd640 1 -- 172.21.15.19:0/3498243891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d819f3d0 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d7fff640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d8109150 0x7fb0d819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d6ffd640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d81087d0 0x7fb0d8199860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00d950 tx=0x7fb0cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d4ff9640 1 -- 172.21.15.19:0/3498243891 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc017070 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d819f6c0 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d4ff9640 1 -- 172.21.15.19:0/3498243891 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0cc009c30 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0d4ff9640 1 -- 172.21.15.19:0/3498243891 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00f620 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.317+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d81a5f50 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.318+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d81031a0 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.320+0000 7fb0d4ff9640 1 -- 172.21.15.19:0/3498243891 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb0cc010460 con 0x7fb0d81087d0 2024-09-11T00:01:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.320+0000 7fb0d4ff9640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0c00b53c0 0x7fb0c00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.320+0000 7fb0d77fe640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0c00b53c0 0x7fb0c00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.320+0000 7fb0d4ff9640 1 -- 172.21.15.19:0/3498243891 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb0cc0e5aa0 con 0x7fb0d81087d0 2024-09-11T00:01:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.321+0000 7fb0d77fe640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0c00b53c0 0x7fb0c00b7880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8031440 tx=0x7fb0c8005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.323+0000 7fb0d4ff9640 1 -- 172.21.15.19:0/3498243891 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb0cc0ac760 con 0x7fb0d81087d0 2024-09-11T00:01:33.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1793595759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T00:01:33.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.514+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb0d810af90 con 0x7fb0d81087d0 2024-09-11T00:01:33.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.515+0000 7fb0d4ff9640 1 -- 172.21.15.19:0/3498243891 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0cc009de0 con 0x7fb0d81087d0 2024-09-11T00:01:33.516 INFO:teuthology.orchestra.run.smithi019.stdout:81604378697 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0c00b53c0 msgr2=0x7fb0c00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0c00b53c0 0x7fb0c00b7880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8031440 tx=0x7fb0c8005b50 comp rx=0 tx=0).stop 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d81087d0 msgr2=0x7fb0d8199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d81087d0 0x7fb0d8199860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00d950 tx=0x7fb0cc00de10 comp rx=0 tx=0).stop 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 shutdown_connections 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d8109150 0x7fb0d819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb0c00b53c0 0x7fb0c00b7880 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0d81087d0 0x7fb0d8199860 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 --2- 172.21.15.19:0/3498243891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d8102dc0 0x7fb0d8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 >> 172.21.15.19:0/3498243891 conn(0x7fb0d80fe830 msgr2=0x7fb0d80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.517+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 shutdown_connections 2024-09-11T00:01:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:33.518+0000 7fb0de118640 1 -- 172.21.15.19:0/3498243891 wait complete. 2024-09-11T00:01:34.207 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:33 smithi019 ceph-mon[30859]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:34.207 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:33 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2498107045' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T00:01:34.207 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:33 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3498243891' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T00:01:34.238 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378694 got 81604378697 for osd.2 2024-09-11T00:01:34.238 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:33 smithi131 ceph-mon[35491]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:33 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2498107045' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T00:01:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:33 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3498243891' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T00:01:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:33 smithi135 ceph-mon[35432]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:33 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2498107045' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T00:01:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:33 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3498243891' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 -- 172.21.15.19:0/1070347152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 msgr2=0x7f2e1c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 --2- 172.21.15.19:0/1070347152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c10e860 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009ca0 tx=0x7f2e1402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 -- 172.21.15.19:0/1070347152 shutdown_connections 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 --2- 172.21.15.19:0/1070347152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c10e860 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 --2- 172.21.15.19:0/1070347152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e1c1076e0 0x7f2e1c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 --2- 172.21.15.19:0/1070347152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e1c101cd0 0x7f2e1c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 -- 172.21.15.19:0/1070347152 >> 172.21.15.19:0/1070347152 conn(0x7f2e1c0fd700 msgr2=0x7f2e1c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 -- 172.21.15.19:0/1070347152 shutdown_connections 2024-09-11T00:01:34.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.903+0000 7f2e23298640 1 -- 172.21.15.19:0/1070347152 wait complete. 2024-09-11T00:01:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 Processor -- start 2024-09-11T00:01:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 -- start start 2024-09-11T00:01:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e1c101cd0 0x7f2e1c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:34.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e1c1076e0 0x7f2e1c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c111d60 con 0x7f2e1c108060 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c111be0 con 0x7f2e1c101cd0 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e23298640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c111ee0 con 0x7f2e1c1076e0 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e21835640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e21835640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c0fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47834/0 (socket says 172.21.15.19:47834) 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e21835640 1 -- 172.21.15.19:0/2295706613 learned_addr learned my addr 172.21.15.19:0/2295706613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e20833640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e1c1076e0 0x7f2e1c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.904+0000 7f2e21034640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e1c101cd0 0x7f2e1c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e21835640 1 -- 172.21.15.19:0/2295706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e1c1076e0 msgr2=0x7f2e1c0fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e21835640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e1c1076e0 0x7f2e1c0fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e21835640 1 -- 172.21.15.19:0/2295706613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e1c101cd0 msgr2=0x7f2e1c0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:34.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e21835640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e1c101cd0 0x7f2e1c0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e21835640 1 -- 172.21.15.19:0/2295706613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c1a77f0 con 0x7f2e1c108060 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e21034640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e1c101cd0 0x7f2e1c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e21835640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c0fe680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e14005cc0 tx=0x7f2e1402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e127fc640 1 -- 172.21.15.19:0/2295706613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14003cf0 con 0x7f2e1c108060 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e127fc640 1 -- 172.21.15.19:0/2295706613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e140044f0 con 0x7f2e1c108060 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c1a7a80 con 0x7f2e1c108060 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e127fc640 1 -- 172.21.15.19:0/2295706613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1402fd10 con 0x7f2e1c108060 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.905+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c1a8040 con 0x7f2e1c108060 2024-09-11T00:01:34.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.906+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1c102130 con 0x7f2e1c108060 2024-09-11T00:01:34.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.908+0000 7f2e127fc640 1 -- 172.21.15.19:0/2295706613 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f2e14004040 con 0x7f2e1c108060 2024-09-11T00:01:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.909+0000 7f2e127fc640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e080b53c0 0x7f2e080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.909+0000 7f2e21034640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e080b53c0 0x7f2e080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.909+0000 7f2e127fc640 1 -- 172.21.15.19:0/2295706613 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2e14107700 con 0x7f2e1c108060 2024-09-11T00:01:34.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.910+0000 7f2e21034640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e080b53c0 0x7f2e080b7880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2e18006fd0 tx=0x7f2e18008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:34.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:34.912+0000 7f2e127fc640 1 -- 172.21.15.19:0/2295706613 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2e140ce3c0 con 0x7f2e1c108060 2024-09-11T00:01:35.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.108+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2e1c1a8420 con 0x7f2e1c108060 2024-09-11T00:01:35.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.108+0000 7f2e127fc640 1 -- 172.21.15.19:0/2295706613 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e140cdcc0 con 0x7f2e1c108060 2024-09-11T00:01:35.110 INFO:teuthology.orchestra.run.smithi019.stdout:38654705747 2024-09-11T00:01:35.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e080b53c0 msgr2=0x7f2e080b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:35.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e080b53c0 0x7f2e080b7880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2e18006fd0 tx=0x7f2e18008040 comp rx=0 tx=0).stop 2024-09-11T00:01:35.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 msgr2=0x7f2e1c0fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:35.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c0fe680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e14005cc0 tx=0x7f2e1402f470 comp rx=0 tx=0).stop 2024-09-11T00:01:35.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 shutdown_connections 2024-09-11T00:01:35.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e080b53c0 0x7f2e080b7880 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e1c108060 0x7f2e1c0fe680 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e1c1076e0 0x7f2e1c0fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 --2- 172.21.15.19:0/2295706613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e1c101cd0 0x7f2e1c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 >> 172.21.15.19:0/2295706613 conn(0x7f2e1c0fd700 msgr2=0x7f2e1c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:35.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 shutdown_connections 2024-09-11T00:01:35.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.111+0000 7f2e23298640 1 -- 172.21.15.19:0/2295706613 wait complete. 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 -- 172.21.15.19:0/1404380676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c102150 msgr2=0x7ff77c10eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 --2- 172.21.15.19:0/1404380676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c102150 0x7ff77c10eea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff764009900 tx=0x7ff76402a480 comp rx=0 tx=0).stop 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 -- 172.21.15.19:0/1404380676 shutdown_connections 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 --2- 172.21.15.19:0/1404380676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c10f3e0 0x7ff77c1117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 --2- 172.21.15.19:0/1404380676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c102150 0x7ff77c10eea0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 --2- 172.21.15.19:0/1404380676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff77c101830 0x7ff77c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 -- 172.21.15.19:0/1404380676 >> 172.21.15.19:0/1404380676 conn(0x7ff77c0fd700 msgr2=0x7ff77c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 -- 172.21.15.19:0/1404380676 shutdown_connections 2024-09-11T00:01:35.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 -- 172.21.15.19:0/1404380676 wait complete. 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 Processor -- start 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.239+0000 7ff78289b640 1 -- start start 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff78289b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c101830 0x7ff77c19b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff78289b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff77c102150 0x7ff77c19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff78289b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c10f3e0 0x7ff77c1a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff78289b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c114f40 con 0x7ff77c101830 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff78289b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c114dc0 con 0x7ff77c102150 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff78289b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1150c0 con 0x7ff77c10f3e0 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c101830 0x7ff77c19b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c101830 0x7ff77c19b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47860/0 (socket says 172.21.15.19:47860) 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 -- 172.21.15.19:0/1850701464 learned_addr learned my addr 172.21.15.19:0/1850701464 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:35.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff780e38640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c10f3e0 0x7ff77c1a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff773fff640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff77c102150 0x7ff77c19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 -- 172.21.15.19:0/1850701464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c10f3e0 msgr2=0x7ff77c1a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c10f3e0 0x7ff77c1a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 -- 172.21.15.19:0/1850701464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff77c102150 msgr2=0x7ff77c19b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff77c102150 0x7ff77c19b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 -- 172.21.15.19:0/1850701464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c1a1560 con 0x7ff77c101830 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff780e38640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c10f3e0 0x7ff77c1a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff773fff640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff77c102150 0x7ff77c19b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.240+0000 7ff77bfff640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c101830 0x7ff77c19b4b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00d950 tx=0x7ff76c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.241+0000 7ff779ffb640 1 -- 172.21.15.19:0/1850701464 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c017070 con 0x7ff77c101830 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.241+0000 7ff779ffb640 1 -- 172.21.15.19:0/1850701464 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76c009c30 con 0x7ff77c101830 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.241+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c1a1850 con 0x7ff77c101830 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.241+0000 7ff779ffb640 1 -- 172.21.15.19:0/1850701464 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00f620 con 0x7ff77c101830 2024-09-11T00:01:35.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.241+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c1a7f10 con 0x7ff77c101830 2024-09-11T00:01:35.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.242+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77c101c10 con 0x7ff77c101830 2024-09-11T00:01:35.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.244+0000 7ff779ffb640 1 -- 172.21.15.19:0/1850701464 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ff76c005030 con 0x7ff77c101830 2024-09-11T00:01:35.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.245+0000 7ff779ffb640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff7680b53c0 0x7ff7680b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:35.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.245+0000 7ff773fff640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff7680b53c0 0x7ff7680b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:35.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.245+0000 7ff779ffb640 1 -- 172.21.15.19:0/1850701464 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7ff76c0e5b90 con 0x7ff77c101830 2024-09-11T00:01:35.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.245+0000 7ff773fff640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff7680b53c0 0x7ff7680b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff764000c00 tx=0x7ff764031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:35.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.248+0000 7ff779ffb640 1 -- 172.21.15.19:0/1850701464 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff76c0ac7f0 con 0x7ff77c101830 2024-09-11T00:01:35.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.438+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff77c02e5c0 con 0x7ff77c101830 2024-09-11T00:01:35.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.438+0000 7ff779ffb640 1 -- 172.21.15.19:0/1850701464 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff76c009de0 con 0x7ff77c101830 2024-09-11T00:01:35.440 INFO:teuthology.orchestra.run.smithi019.stdout:137438953534 2024-09-11T00:01:35.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff7680b53c0 msgr2=0x7ff7680b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:35.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff7680b53c0 0x7ff7680b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff764000c00 tx=0x7ff764031400 comp rx=0 tx=0).stop 2024-09-11T00:01:35.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c101830 msgr2=0x7ff77c19b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:35.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c101830 0x7ff77c19b4b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00d950 tx=0x7ff76c00de10 comp rx=0 tx=0).stop 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 shutdown_connections 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c10f3e0 0x7ff77c1a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff77c102150 0x7ff77c19b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff7680b53c0 0x7ff7680b7880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 --2- 172.21.15.19:0/1850701464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff77c101830 0x7ff77c19b4b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 >> 172.21.15.19:0/1850701464 conn(0x7ff77c0fd700 msgr2=0x7ff77c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 shutdown_connections 2024-09-11T00:01:35.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:35.440+0000 7ff78289b640 1 -- 172.21.15.19:0/1850701464 wait complete. 2024-09-11T00:01:35.503 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:35.954 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542220 got 60129542221 for osd.1 2024-09-11T00:01:35.954 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:36.257 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:35 smithi019 ceph-mon[30859]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:36.257 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:35 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2295706613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T00:01:36.257 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:35 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1850701464' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T00:01:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:35 smithi131 ceph-mon[35491]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:35 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2295706613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T00:01:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:35 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1850701464' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T00:01:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:35 smithi135 ceph-mon[35432]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:35 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2295706613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T00:01:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:35 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1850701464' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T00:01:36.829 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822710 got 154618822712 for osd.5 2024-09-11T00:01:36.830 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 -- 172.21.15.19:0/1281962799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8108020 msgr2=0x7fcbf810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/1281962799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8108020 0x7fcbf810e820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009ca0 tx=0x7fcbf002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 -- 172.21.15.19:0/1281962799 shutdown_connections 2024-09-11T00:01:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/1281962799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8108020 0x7fcbf810e820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/1281962799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf81076a0 0x7fcbf8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/1281962799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf8101c90 0x7fcbf8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 -- 172.21.15.19:0/1281962799 >> 172.21.15.19:0/1281962799 conn(0x7fcbf80fd700 msgr2=0x7fcbf80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 -- 172.21.15.19:0/1281962799 shutdown_connections 2024-09-11T00:01:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.069+0000 7fcbfcf14640 1 -- 172.21.15.19:0/1281962799 wait complete. 2024-09-11T00:01:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 Processor -- start 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 -- start start 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8101c90 0x7fcbf8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf81076a0 0x7fcbf8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf8108020 0x7fcbf819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8111ce0 con 0x7fcbf8101c90 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8111b60 con 0x7fcbf81076a0 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbfcf14640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8111e60 con 0x7fcbf8108020 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8101c90 0x7fcbf8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8101c90 0x7fcbf8199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47904/0 (socket says 172.21.15.19:47904) 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 -- 172.21.15.19:0/2207532359 learned_addr learned my addr 172.21.15.19:0/2207532359 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf6d9d640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf8108020 0x7fcbf819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbeffff640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf81076a0 0x7fcbf8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 -- 172.21.15.19:0/2207532359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf8108020 msgr2=0x7fcbf819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf8108020 0x7fcbf819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 -- 172.21.15.19:0/2207532359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf81076a0 msgr2=0x7fcbf8199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf81076a0 0x7fcbf8199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.070+0000 7fcbf659c640 1 -- 172.21.15.19:0/2207532359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf819f3d0 con 0x7fcbf8101c90 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.071+0000 7fcbf659c640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8101c90 0x7fcbf8199320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b4a0 tx=0x7fcbe800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.071+0000 7fcbef7fe640 1 -- 172.21.15.19:0/2207532359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8014070 con 0x7fcbf8101c90 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.071+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf819f6c0 con 0x7fcbf8101c90 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.071+0000 7fcbef7fe640 1 -- 172.21.15.19:0/2207532359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbe8010ac0 con 0x7fcbf8101c90 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.071+0000 7fcbef7fe640 1 -- 172.21.15.19:0/2207532359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8017c30 con 0x7fcbf8101c90 2024-09-11T00:01:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.071+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf81a5f50 con 0x7fcbf8101c90 2024-09-11T00:01:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.072+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf8102070 con 0x7fcbf8101c90 2024-09-11T00:01:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.074+0000 7fcbef7fe640 1 -- 172.21.15.19:0/2207532359 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fcbe8010610 con 0x7fcbf8101c90 2024-09-11T00:01:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.075+0000 7fcbef7fe640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcbe40b53c0 0x7fcbe40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.075+0000 7fcbeffff640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcbe40b53c0 0x7fcbe40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.075+0000 7fcbef7fe640 1 -- 172.21.15.19:0/2207532359 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fcbe80e5730 con 0x7fcbf8101c90 2024-09-11T00:01:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.076+0000 7fcbeffff640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcbe40b53c0 0x7fcbe40b7880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8103e50 tx=0x7fcbe000a4c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.078+0000 7fcbef7fe640 1 -- 172.21.15.19:0/2207532359 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcbe80ac3f0 con 0x7fcbf8101c90 2024-09-11T00:01:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.268+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fcbf81a6120 con 0x7fcbf8101c90 2024-09-11T00:01:37.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.269+0000 7fcbef7fe640 1 -- 172.21.15.19:0/2207532359 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcbe80abcf0 con 0x7fcbf8101c90 2024-09-11T00:01:37.270 INFO:teuthology.orchestra.run.smithi019.stdout:300647710747 2024-09-11T00:01:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcbe40b53c0 msgr2=0x7fcbe40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcbe40b53c0 0x7fcbe40b7880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8103e50 tx=0x7fcbe000a4c0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8101c90 msgr2=0x7fcbf8199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8101c90 0x7fcbf8199320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b4a0 tx=0x7fcbe800b960 comp rx=0 tx=0).stop 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 shutdown_connections 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf8108020 0x7fcbf819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf81076a0 0x7fcbf8199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcbe40b53c0 0x7fcbe40b7880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 --2- 172.21.15.19:0/2207532359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf8101c90 0x7fcbf8199320 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 >> 172.21.15.19:0/2207532359 conn(0x7fcbf80fd700 msgr2=0x7fcbf8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 shutdown_connections 2024-09-11T00:01:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.271+0000 7fcbfcf14640 1 -- 172.21.15.19:0/2207532359 wait complete. 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.480+0000 7fb646d72640 1 -- 172.21.15.19:0/1051818640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640102dc0 msgr2=0x7fb6401031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.480+0000 7fb646d72640 1 --2- 172.21.15.19:0/1051818640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640102dc0 0x7fb6401031a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb634009900 tx=0x7fb63402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.480+0000 7fb646d72640 1 -- 172.21.15.19:0/1051818640 shutdown_connections 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.480+0000 7fb646d72640 1 --2- 172.21.15.19:0/1051818640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb640109150 0x7fb64010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.480+0000 7fb646d72640 1 --2- 172.21.15.19:0/1051818640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401087d0 0x7fb640108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.480+0000 7fb646d72640 1 --2- 172.21.15.19:0/1051818640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640102dc0 0x7fb6401031a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.480+0000 7fb646d72640 1 -- 172.21.15.19:0/1051818640 >> 172.21.15.19:0/1051818640 conn(0x7fb6400fe830 msgr2=0x7fb640100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.481+0000 7fb646d72640 1 -- 172.21.15.19:0/1051818640 shutdown_connections 2024-09-11T00:01:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.481+0000 7fb646d72640 1 -- 172.21.15.19:0/1051818640 wait complete. 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.481+0000 7fb646d72640 1 Processor -- start 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.481+0000 7fb646d72640 1 -- start start 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb646d72640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb640102dc0 0x7fb640199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb646d72640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401087d0 0x7fb640199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb646d72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640109150 0x7fb64019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb646d72640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb640112e10 con 0x7fb640109150 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb646d72640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb640112c90 con 0x7fb6401087d0 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb646d72640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb640112f90 con 0x7fb640102dc0 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640109150 0x7fb64019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640109150 0x7fb64019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47922/0 (socket says 172.21.15.19:47922) 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 -- 172.21.15.19:0/3891000814 learned_addr learned my addr 172.21.15.19:0/3891000814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:37.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb644b0e640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb640102dc0 0x7fb640199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb63ffff640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401087d0 0x7fb640199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 -- 172.21.15.19:0/3891000814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb640102dc0 msgr2=0x7fb640199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb640102dc0 0x7fb640199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 -- 172.21.15.19:0/3891000814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401087d0 msgr2=0x7fb640199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401087d0 0x7fb640199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 -- 172.21.15.19:0/3891000814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64019f3b0 con 0x7fb640109150 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.482+0000 7fb64530f640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640109150 0x7fb64019ebe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb63800eaa0 tx=0x7fb63800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.483+0000 7fb63dffb640 1 -- 172.21.15.19:0/3891000814 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638004d20 con 0x7fb640109150 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.483+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64019f6a0 con 0x7fb640109150 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.483+0000 7fb63dffb640 1 -- 172.21.15.19:0/3891000814 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb638005020 con 0x7fb640109150 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.483+0000 7fb63dffb640 1 -- 172.21.15.19:0/3891000814 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6380116d0 con 0x7fb640109150 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.483+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6401a5f30 con 0x7fb640109150 2024-09-11T00:01:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.484+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6401031a0 con 0x7fb640109150 2024-09-11T00:01:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.485+0000 7fb63dffb640 1 -- 172.21.15.19:0/3891000814 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb63800f040 con 0x7fb640109150 2024-09-11T00:01:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.487+0000 7fb63dffb640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb6300b53c0 0x7fb6300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.487+0000 7fb644b0e640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb6300b53c0 0x7fb6300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.487+0000 7fb63dffb640 1 -- 172.21.15.19:0/3891000814 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb6380e5fe0 con 0x7fb640109150 2024-09-11T00:01:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.487+0000 7fb644b0e640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb6300b53c0 0x7fb6300b7880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb634031440 tx=0x7fb634005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.490+0000 7fb63dffb640 1 -- 172.21.15.19:0/3891000814 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb638016030 con 0x7fb640109150 2024-09-11T00:01:37.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.678+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb64010a9a0 con 0x7fb640109150 2024-09-11T00:01:37.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.679+0000 7fb63dffb640 1 -- 172.21.15.19:0/3891000814 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb6380acca0 con 0x7fb640109150 2024-09-11T00:01:37.680 INFO:teuthology.orchestra.run.smithi019.stdout:180388626484 2024-09-11T00:01:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb6300b53c0 msgr2=0x7fb6300b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb6300b53c0 0x7fb6300b7880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb634031440 tx=0x7fb634005b50 comp rx=0 tx=0).stop 2024-09-11T00:01:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640109150 msgr2=0x7fb64019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640109150 0x7fb64019ebe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb63800eaa0 tx=0x7fb63800eea0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 shutdown_connections 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb6300b53c0 0x7fb6300b7880 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb640109150 0x7fb64019ebe0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6401087d0 0x7fb640199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 --2- 172.21.15.19:0/3891000814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb640102dc0 0x7fb640199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 >> 172.21.15.19:0/3891000814 conn(0x7fb6400fe830 msgr2=0x7fb640100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 shutdown_connections 2024-09-11T00:01:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.681+0000 7fb646d72640 1 -- 172.21.15.19:0/3891000814 wait complete. 2024-09-11T00:01:38.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:37 smithi019 ceph-mon[30859]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T00:01:38.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:37 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3386748187' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T00:01:38.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:37 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2207532359' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T00:01:38.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:37 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3891000814' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T00:01:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:37 smithi131 ceph-mon[35491]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T00:01:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:37 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3386748187' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T00:01:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:37 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2207532359' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T00:01:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:37 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3891000814' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T00:01:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:37 smithi135 ceph-mon[35432]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T00:01:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:37 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3386748187' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T00:01:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:37 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2207532359' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T00:01:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:37 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3891000814' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 -- 172.21.15.19:0/2281152392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc101cd0 msgr2=0x7fe1cc1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 --2- 172.21.15.19:0/2281152392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc101cd0 0x7fe1cc1020b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009900 tx=0x7fe1bc02a410 comp rx=0 tx=0).stop 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 -- 172.21.15.19:0/2281152392 shutdown_connections 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 --2- 172.21.15.19:0/2281152392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc108060 0x7fe1cc10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 --2- 172.21.15.19:0/2281152392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1cc1076e0 0x7fe1cc107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 --2- 172.21.15.19:0/2281152392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc101cd0 0x7fe1cc1020b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 -- 172.21.15.19:0/2281152392 >> 172.21.15.19:0/2281152392 conn(0x7fe1cc0fd700 msgr2=0x7fe1cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:38.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 -- 172.21.15.19:0/2281152392 shutdown_connections 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 -- 172.21.15.19:0/2281152392 wait complete. 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.968+0000 7fe1d154d640 1 Processor -- start 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1d154d640 1 -- start start 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1d154d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc101cd0 0x7fe1cc0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1d154d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1cc1076e0 0x7fe1cc0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1d154d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc108060 0x7fe1cc0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1d154d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc111d20 con 0x7fe1cc108060 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1d154d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc111ba0 con 0x7fe1cc1076e0 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1d154d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc111ea0 con 0x7fe1cc101cd0 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc108060 0x7fe1cc0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc108060 0x7fe1cc0fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47878/0 (socket says 172.21.15.19:47878) 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 -- 172.21.15.19:0/3386748187 learned_addr learned my addr 172.21.15.19:0/3386748187 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1caffd640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc101cd0 0x7fe1cc0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 -- 172.21.15.19:0/3386748187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc101cd0 msgr2=0x7fe1cc0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc101cd0 0x7fe1cc0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 -- 172.21.15.19:0/3386748187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1cc1076e0 msgr2=0x7fe1cc0fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1cc1076e0 0x7fe1cc0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 -- 172.21.15.19:0/3386748187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc1a76d0 con 0x7fe1cc108060 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1cb7fe640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc108060 0x7fe1cc0fe680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400eaa0 tx=0x7fe1c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stdout:253403070501 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.969+0000 7fe1c8ff9640 1 -- 172.21.15.19:0/3386748187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400cdb0 con 0x7fe1cc108060 2024-09-11T00:01:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.970+0000 7fe1c8ff9640 1 -- 172.21.15.19:0/3386748187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c4005020 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.970+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc1a79c0 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.970+0000 7fe1c8ff9640 1 -- 172.21.15.19:0/3386748187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40116d0 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.970+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc1a7fd0 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.971+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc1020b0 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.972+0000 7fe1c8ff9640 1 -- 172.21.15.19:0/3386748187 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fe1c400f040 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.973+0000 7fe1c8ff9640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1b80b5440 0x7fe1b80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.973+0000 7fe1caffd640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1b80b5440 0x7fe1b80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.973+0000 7fe1c8ff9640 1 -- 172.21.15.19:0/3386748187 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe1c40e5c10 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.973+0000 7fe1caffd640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1b80b5440 0x7fe1b80b7900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc031440 tx=0x7fe1bc005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:36.977+0000 7fe1c8ff9640 1 -- 172.21.15.19:0/3386748187 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe1c4016030 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.171+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe1cc02e5c0 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.171+0000 7fe1c8ff9640 1 -- 172.21.15.19:0/3386748187 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe1c40ac8d0 con 0x7fe1cc108060 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1b80b5440 msgr2=0x7fe1b80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:38.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1b80b5440 0x7fe1b80b7900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc031440 tx=0x7fe1bc005b50 comp rx=0 tx=0).stop 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc108060 msgr2=0x7fe1cc0fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc108060 0x7fe1cc0fe680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400eaa0 tx=0x7fe1c400ef60 comp rx=0 tx=0).stop 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 shutdown_connections 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1b80b5440 0x7fe1b80b7900 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1cc108060 0x7fe1cc0fe680 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1cc1076e0 0x7fe1cc0fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 --2- 172.21.15.19:0/3386748187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc101cd0 0x7fe1cc0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.173+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 >> 172.21.15.19:0/3386748187 conn(0x7fe1cc0fd700 msgr2=0x7fe1cc06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.174+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 shutdown_connections 2024-09-11T00:01:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:37.174+0000 7fe1d154d640 1 -- 172.21.15.19:0/3386748187 wait complete. 2024-09-11T00:01:39.536 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705745 got 38654705747 for osd.0 2024-09-11T00:01:39.536 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 -- 172.21.15.19:0/1648341163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db01076e0 msgr2=0x7f6db0107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 --2- 172.21.15.19:0/1648341163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db01076e0 0x7f6db0107b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009900 tx=0x7f6da002a410 comp rx=0 tx=0).stop 2024-09-11T00:01:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 -- 172.21.15.19:0/1648341163 shutdown_connections 2024-09-11T00:01:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 --2- 172.21.15.19:0/1648341163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6db0108060 0x7f6db010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 --2- 172.21.15.19:0/1648341163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db01076e0 0x7f6db0107b20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 --2- 172.21.15.19:0/1648341163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db0101cd0 0x7f6db01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 -- 172.21.15.19:0/1648341163 >> 172.21.15.19:0/1648341163 conn(0x7f6db00fd700 msgr2=0x7f6db00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 -- 172.21.15.19:0/1648341163 shutdown_connections 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.169+0000 7f6db8013640 1 -- 172.21.15.19:0/1648341163 wait complete. 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 Processor -- start 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 -- start start 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db0101cd0 0x7f6db019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6db01076e0 0x7f6db019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db0108060 0x7f6db019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6db0111d20 con 0x7f6db0101cd0 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6db0111ba0 con 0x7f6db01076e0 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db8013640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6db0111ea0 con 0x7f6db0108060 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db5daf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db0101cd0 0x7f6db019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:39.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db5daf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db0101cd0 0x7f6db019a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47940/0 (socket says 172.21.15.19:47940) 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db5daf640 1 -- 172.21.15.19:0/4294747318 learned_addr learned my addr 172.21.15.19:0/4294747318 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.170+0000 7f6db55ae640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6db01076e0 0x7f6db019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db65b0640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db0108060 0x7f6db019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db5daf640 1 -- 172.21.15.19:0/4294747318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db0108060 msgr2=0x7f6db019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db5daf640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db0108060 0x7f6db019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db5daf640 1 -- 172.21.15.19:0/4294747318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6db01076e0 msgr2=0x7f6db019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db5daf640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6db01076e0 0x7f6db019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db5daf640 1 -- 172.21.15.19:0/4294747318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db01a54d0 con 0x7f6db0101cd0 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db65b0640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db0108060 0x7f6db019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db5daf640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db0101cd0 0x7f6db019a0f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00b4a0 tx=0x7f6dac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6da6ffd640 1 -- 172.21.15.19:0/4294747318 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac014070 con 0x7f6db0101cd0 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6da6ffd640 1 -- 172.21.15.19:0/4294747318 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dac010ac0 con 0x7f6db0101cd0 2024-09-11T00:01:39.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db01a57c0 con 0x7f6db0101cd0 2024-09-11T00:01:39.621 INFO:teuthology.orchestra.run.smithi019.stdout:111669149763 2024-09-11T00:01:39.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6da6ffd640 1 -- 172.21.15.19:0/4294747318 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac017c30 con 0x7f6db0101cd0 2024-09-11T00:01:39.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.171+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db01a5d50 con 0x7f6db0101cd0 2024-09-11T00:01:39.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.172+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db01020b0 con 0x7f6db0101cd0 2024-09-11T00:01:39.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.173+0000 7f6da6ffd640 1 -- 172.21.15.19:0/4294747318 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f6dac010610 con 0x7f6db0101cd0 2024-09-11T00:01:39.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.174+0000 7f6da6ffd640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6d9c0b53c0 0x7f6d9c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:39.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.174+0000 7f6db55ae640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6d9c0b53c0 0x7f6d9c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.174+0000 7f6da6ffd640 1 -- 172.21.15.19:0/4294747318 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6dac0e57e0 con 0x7f6db0101cd0 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.175+0000 7f6db55ae640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6d9c0b53c0 0x7f6d9c0b7880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6da0031440 tx=0x7f6da00095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.178+0000 7f6da6ffd640 1 -- 172.21.15.19:0/4294747318 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6dac0ac4a0 con 0x7f6db0101cd0 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.366+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6db006b8a0 con 0x7f6db0101cd0 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.367+0000 7f6da6ffd640 1 -- 172.21.15.19:0/4294747318 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6dac0abda0 con 0x7f6db0101cd0 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6d9c0b53c0 msgr2=0x7f6d9c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6d9c0b53c0 0x7f6d9c0b7880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6da0031440 tx=0x7f6da00095f0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db0101cd0 msgr2=0x7f6db019a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db0101cd0 0x7f6db019a0f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00b4a0 tx=0x7f6dac00b960 comp rx=0 tx=0).stop 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 shutdown_connections 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6db0108060 0x7f6db019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6db01076e0 0x7f6db019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6d9c0b53c0 0x7f6d9c0b7880 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 --2- 172.21.15.19:0/4294747318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6db0101cd0 0x7f6db019a0f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:39.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 >> 172.21.15.19:0/4294747318 conn(0x7f6db00fd700 msgr2=0x7f6db00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:39.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 shutdown_connections 2024-09-11T00:01:39.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:39.369+0000 7f6db8013640 1 -- 172.21.15.19:0/4294747318 wait complete. 2024-09-11T00:01:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:40.102 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:40.207 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:39 smithi019 ceph-mon[30859]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:40.207 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:39 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4294747318' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T00:01:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:39 smithi131 ceph-mon[35491]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:39 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4294747318' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T00:01:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:39 smithi135 ceph-mon[35432]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:39 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4294747318' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T00:01:40.605 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626481 got 180388626484 for osd.6 2024-09-11T00:01:40.605 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:41.094 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953531 got 137438953534 for osd.4 2024-09-11T00:01:41.094 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:41.527 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070499 got 253403070501 for osd.9 2024-09-11T00:01:41.527 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:42.018 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710745 got 300647710747 for osd.11 2024-09-11T00:01:42.018 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:41 smithi019 ceph-mon[30859]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:41 smithi131 ceph-mon[35491]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:41 smithi135 ceph-mon[35432]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:42.498 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149759 got 111669149763 for osd.3 2024-09-11T00:01:42.498 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:43.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3530504784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4141045b0 msgr2=0x7fc41410cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3530504784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4141045b0 0x7fc41410cb90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc408009900 tx=0x7fc40802a410 comp rx=0 tx=0).stop 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3530504784 shutdown_connections 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3530504784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41410d160 0x7fc41410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3530504784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4141045b0 0x7fc41410cb90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3530504784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc414103bb0 0x7fc414103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3530504784 >> 172.21.15.19:0/3530504784 conn(0x7fc4140fd700 msgr2=0x7fc4140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3530504784 shutdown_connections 2024-09-11T00:01:43.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.201+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3530504784 wait complete. 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 Processor -- start 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 -- start start 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc414103bb0 0x7fc414199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4141045b0 0x7fc4141998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41410d160 0x7fc41419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc414112e00 con 0x7fc414103bb0 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc414112c80 con 0x7fc41410d160 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc41a1d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc414112f80 con 0x7fc4141045b0 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc414103bb0 0x7fc414199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc414103bb0 0x7fc414199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49924/0 (socket says 172.21.15.19:49924) 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 -- 172.21.15.19:0/3250791276 learned_addr learned my addr 172.21.15.19:0/3250791276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:43.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc413fff640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41410d160 0x7fc41419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 -- 172.21.15.19:0/3250791276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4141045b0 msgr2=0x7fc4141998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4141045b0 0x7fc4141998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 -- 172.21.15.19:0/3250791276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41410d160 msgr2=0x7fc41419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41410d160 0x7fc41419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc4137fe640 1 -- 172.21.15.19:0/3250791276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41419f430 con 0x7fc414103bb0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.202+0000 7fc413fff640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41410d160 0x7fc41419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.203+0000 7fc4137fe640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc414103bb0 0x7fc414199380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc40400b4a0 tx=0x7fc40400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.203+0000 7fc410ff9640 1 -- 172.21.15.19:0/3250791276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404014070 con 0x7fc414103bb0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.203+0000 7fc410ff9640 1 -- 172.21.15.19:0/3250791276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc404010ac0 con 0x7fc414103bb0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.203+0000 7fc410ff9640 1 -- 172.21.15.19:0/3250791276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404017c30 con 0x7fc414103bb0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.203+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41419f720 con 0x7fc414103bb0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.203+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141a5de0 con 0x7fc414103bb0 2024-09-11T00:01:43.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.204+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc414103f90 con 0x7fc414103bb0 2024-09-11T00:01:43.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.205+0000 7fc410ff9640 1 -- 172.21.15.19:0/3250791276 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fc404010610 con 0x7fc414103bb0 2024-09-11T00:01:43.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.206+0000 7fc410ff9640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b53c0 0x7fc3fc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.206+0000 7fc412ffd640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b53c0 0x7fc3fc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:43.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.206+0000 7fc410ff9640 1 -- 172.21.15.19:0/3250791276 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc4040e57e0 con 0x7fc414103bb0 2024-09-11T00:01:43.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.207+0000 7fc412ffd640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b53c0 0x7fc3fc0b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4080096c0 tx=0x7fc408031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:43.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.209+0000 7fc410ff9640 1 -- 172.21.15.19:0/3250791276 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc4040ac4a0 con 0x7fc414103bb0 2024-09-11T00:01:43.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.399+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc41402e5c0 con 0x7fc414103bb0 2024-09-11T00:01:43.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.399+0000 7fc410ff9640 1 -- 172.21.15.19:0/3250791276 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc4040abda0 con 0x7fc414103bb0 2024-09-11T00:01:43.401 INFO:teuthology.orchestra.run.smithi019.stdout:227633266731 2024-09-11T00:01:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b53c0 msgr2=0x7fc3fc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b53c0 0x7fc3fc0b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4080096c0 tx=0x7fc408031400 comp rx=0 tx=0).stop 2024-09-11T00:01:43.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc414103bb0 msgr2=0x7fc414199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc414103bb0 0x7fc414199380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc40400b4a0 tx=0x7fc40400b960 comp rx=0 tx=0).stop 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 shutdown_connections 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41410d160 0x7fc41419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4141045b0 0x7fc4141998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b53c0 0x7fc3fc0b7880 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 --2- 172.21.15.19:0/3250791276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc414103bb0 0x7fc414199380 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 >> 172.21.15.19:0/3250791276 conn(0x7fc4140fd700 msgr2=0x7fc4140fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 shutdown_connections 2024-09-11T00:01:43.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.403+0000 7fc41a1d0640 1 -- 172.21.15.19:0/3250791276 wait complete. 2024-09-11T00:01:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 -- 172.21.15.19:0/3392992071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1104101c90 msgr2=0x7f1104102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 --2- 172.21.15.19:0/3392992071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1104101c90 0x7f1104102070 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009900 tx=0x7f10f402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 -- 172.21.15.19:0/3392992071 shutdown_connections 2024-09-11T00:01:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 --2- 172.21.15.19:0/3392992071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1104108020 0x7f110410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 --2- 172.21.15.19:0/3392992071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11041076a0 0x7f1104107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 --2- 172.21.15.19:0/3392992071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1104101c90 0x7f1104102070 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 -- 172.21.15.19:0/3392992071 >> 172.21.15.19:0/3392992071 conn(0x7f11040fd700 msgr2=0x7f11040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 -- 172.21.15.19:0/3392992071 shutdown_connections 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.450+0000 7f1109585640 1 -- 172.21.15.19:0/3392992071 wait complete. 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 Processor -- start 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 -- start start 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1104101c90 0x7f11040fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11041076a0 0x7f11040fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1104108020 0x7f11040fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1104111d30 con 0x7f11041076a0 2024-09-11T00:01:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1104111bb0 con 0x7f1104101c90 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1109585640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1104111eb0 con 0x7f1104108020 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11041076a0 0x7f11040fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11041076a0 0x7f11040fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49944/0 (socket says 172.21.15.19:49944) 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 -- 172.21.15.19:0/3605771565 learned_addr learned my addr 172.21.15.19:0/3605771565 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1102ffd640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1104101c90 0x7f11040fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 -- 172.21.15.19:0/3605771565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1104108020 msgr2=0x7f11040fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1104108020 0x7f11040fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 -- 172.21.15.19:0/3605771565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1104101c90 msgr2=0x7f11040fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1104101c90 0x7f11040fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f11027fc640 1 -- 172.21.15.19:0/3605771565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11041a7630 con 0x7f11041076a0 2024-09-11T00:01:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.451+0000 7f1102ffd640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1104101c90 0x7f11040fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.452+0000 7f11027fc640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11041076a0 0x7f11040fe140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f10f800c920 tx=0x7f10f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.452+0000 7f10ebfff640 1 -- 172.21.15.19:0/3605771565 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8007c70 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.452+0000 7f10ebfff640 1 -- 172.21.15.19:0/3605771565 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10f8007e10 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.452+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11041a7920 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.452+0000 7f10ebfff640 1 -- 172.21.15.19:0/3605771565 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8018820 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.452+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11041a7eb0 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.453+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1104102070 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.455+0000 7f10ebfff640 1 -- 172.21.15.19:0/3605771565 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f10f800f450 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.455+0000 7f10ebfff640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10ec0b5440 0x7f10ec0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.455+0000 7f1102ffd640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10ec0b5440 0x7f10ec0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.455+0000 7f10ebfff640 1 -- 172.21.15.19:0/3605771565 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f10f80e6230 con 0x7f11041076a0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.456+0000 7f1102ffd640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10ec0b5440 0x7f10ec0b7900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10f4000c00 tx=0x7f10f4005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.458+0000 7f10ebfff640 1 -- 172.21.15.19:0/3605771565 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10f8014030 con 0x7f11041076a0 2024-09-11T00:01:43.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.651+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f110402e5c0 con 0x7f11041076a0 2024-09-11T00:01:43.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.651+0000 7f10ebfff640 1 -- 172.21.15.19:0/3605771565 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f10f80ad000 con 0x7f11041076a0 2024-09-11T00:01:43.653 INFO:teuthology.orchestra.run.smithi019.stdout:201863462961 2024-09-11T00:01:43.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10ec0b5440 msgr2=0x7f10ec0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10ec0b5440 0x7f10ec0b7900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10f4000c00 tx=0x7f10f4005a20 comp rx=0 tx=0).stop 2024-09-11T00:01:43.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11041076a0 msgr2=0x7f11040fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11041076a0 0x7f11040fe140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f10f800c920 tx=0x7f10f800cde0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 shutdown_connections 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1104108020 0x7f11040fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10ec0b5440 0x7f10ec0b7900 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11041076a0 0x7f11040fe140 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 --2- 172.21.15.19:0/3605771565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1104101c90 0x7f11040fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 >> 172.21.15.19:0/3605771565 conn(0x7f11040fd700 msgr2=0x7f110406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 shutdown_connections 2024-09-11T00:01:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:43.654+0000 7f1109585640 1 -- 172.21.15.19:0/3605771565 wait complete. 2024-09-11T00:01:44.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:43 smithi019 ceph-mon[30859]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:44.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:43 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3250791276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T00:01:44.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:43 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3605771565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T00:01:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:43 smithi131 ceph-mon[35491]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:43 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3250791276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T00:01:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:43 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3605771565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T00:01:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:43 smithi135 ceph-mon[35432]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:43 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3250791276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T00:01:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:43 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3605771565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T00:01:44.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266727 got 227633266731 for osd.8 2024-09-11T00:01:44.475 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:45.169 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462958 got 201863462961 for osd.7 2024-09-11T00:01:45.170 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 -- 172.21.15.19:0/707795221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 msgr2=0x7f0754108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 --2- 172.21.15.19:0/707795221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754108c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0748009900 tx=0x7f074802a410 comp rx=0 tx=0).stop 2024-09-11T00:01:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 -- 172.21.15.19:0/707795221 shutdown_connections 2024-09-11T00:01:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 --2- 172.21.15.19:0/707795221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754109150 0x7f075410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 --2- 172.21.15.19:0/707795221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754108c10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 --2- 172.21.15.19:0/707795221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0754102dc0 0x7f07541031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 -- 172.21.15.19:0/707795221 >> 172.21.15.19:0/707795221 conn(0x7f07540fe830 msgr2=0x7f0754100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.359+0000 7f075999f640 1 -- 172.21.15.19:0/707795221 shutdown_connections 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.360+0000 7f075999f640 1 -- 172.21.15.19:0/707795221 wait complete. 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.360+0000 7f075999f640 1 Processor -- start 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.360+0000 7f075999f640 1 -- start start 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.360+0000 7f075999f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102dc0 0x7f0754199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.360+0000 7f075999f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075999f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0754109150 0x7f075419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075999f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0754112e10 con 0x7f07541087d0 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075999f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0754112c90 con 0x7f0754109150 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075999f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0754112f90 con 0x7f0754102dc0 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49966/0 (socket says 172.21.15.19:49966) 2024-09-11T00:01:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 -- 172.21.15.19:0/1075028404 learned_addr learned my addr 172.21.15.19:0/1075028404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f0752ffd640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102dc0 0x7f0754199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07537fe640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0754109150 0x7f075419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 -- 172.21.15.19:0/1075028404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102dc0 msgr2=0x7f0754199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102dc0 0x7f0754199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 -- 172.21.15.19:0/1075028404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0754109150 msgr2=0x7f075419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0754109150 0x7f075419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 -- 172.21.15.19:0/1075028404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075419f3b0 con 0x7f07541087d0 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07537fe640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0754109150 0x7f075419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f0752ffd640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102dc0 0x7f0754199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f07527fc640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754199840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0748005940 tx=0x7f07480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075899d640 1 -- 172.21.15.19:0/1075028404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074803f030 con 0x7f07541087d0 2024-09-11T00:01:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075899d640 1 -- 172.21.15.19:0/1075028404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0748003cb0 con 0x7f07541087d0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075419f640 con 0x7f07541087d0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075899d640 1 -- 172.21.15.19:0/1075028404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748035070 con 0x7f07541087d0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.361+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07541a5d60 con 0x7f07541087d0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.362+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07541031a0 con 0x7f07541087d0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.365+0000 7f075899d640 1 -- 172.21.15.19:0/1075028404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f074803bb50 con 0x7f07541087d0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.365+0000 7f075899d640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f073c0b53c0 0x7f073c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.365+0000 7f0752ffd640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f073c0b53c0 0x7f073c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.366+0000 7f075899d640 1 -- 172.21.15.19:0/1075028404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f0748106d20 con 0x7f07541087d0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.366+0000 7f0752ffd640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f073c0b53c0 0x7f073c0b7880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07440058c0 tx=0x7f0744005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.369+0000 7f075899d640 1 -- 172.21.15.19:0/1075028404 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07480cd9e0 con 0x7f07541087d0 2024-09-11T00:01:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.561+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f075419a430 con 0x7f07541087d0 2024-09-11T00:01:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.561+0000 7f075899d640 1 -- 172.21.15.19:0/1075028404 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f07480cd2e0 con 0x7f07541087d0 2024-09-11T00:01:45.563 INFO:teuthology.orchestra.run.smithi019.stdout:274877906978 2024-09-11T00:01:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f073c0b53c0 msgr2=0x7f073c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f073c0b53c0 0x7f073c0b7880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07440058c0 tx=0x7f0744005850 comp rx=0 tx=0).stop 2024-09-11T00:01:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 msgr2=0x7f0754199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754199840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0748005940 tx=0x7f07480042f0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 shutdown_connections 2024-09-11T00:01:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0754109150 0x7f075419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f073c0b53c0 0x7f073c0b7880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07541087d0 0x7f0754199840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 --2- 172.21.15.19:0/1075028404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102dc0 0x7f0754199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 >> 172.21.15.19:0/1075028404 conn(0x7f07540fe830 msgr2=0x7f0754100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 shutdown_connections 2024-09-11T00:01:45.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:45.564+0000 7f075999f640 1 -- 172.21.15.19:0/1075028404 wait complete. 2024-09-11T00:01:46.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:45 smithi019 ceph-mon[30859]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:46.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:45 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1075028404' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T00:01:46.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:46.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:45 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:46.255 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906974 got 274877906978 for osd.10 2024-09-11T00:01:46.256 DEBUG:teuthology.parallel:result is None 2024-09-11T00:01:46.256 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T00:01:46.256 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:01:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:45 smithi131 ceph-mon[35491]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:45 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1075028404' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T00:01:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:45 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:45 smithi135 ceph-mon[35432]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:01:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:45 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1075028404' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T00:01:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:46.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:45 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:46.521 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 -- 172.21.15.19:0/198187275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f941087d0 msgr2=0x7f0f94108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 --2- 172.21.15.19:0/198187275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f941087d0 0x7f0f94108c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009900 tx=0x7f0f8802a410 comp rx=0 tx=0).stop 2024-09-11T00:01:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 -- 172.21.15.19:0/198187275 shutdown_connections 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 --2- 172.21.15.19:0/198187275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f94109150 0x7f0f9410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 --2- 172.21.15.19:0/198187275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f941087d0 0x7f0f94108c10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 --2- 172.21.15.19:0/198187275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f94102dc0 0x7f0f941031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 -- 172.21.15.19:0/198187275 >> 172.21.15.19:0/198187275 conn(0x7f0f940fe830 msgr2=0x7f0f94100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 -- 172.21.15.19:0/198187275 shutdown_connections 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 -- 172.21.15.19:0/198187275 wait complete. 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.055+0000 7f0f99535640 1 Processor -- start 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f99535640 1 -- start start 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f99535640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f94102dc0 0x7f0f941994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f99535640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f941087d0 0x7f0f94199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f99535640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f94109150 0x7f0f9419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f99535640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f94112e50 con 0x7f0f94102dc0 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f99535640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f94112cd0 con 0x7f0f94109150 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f99535640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f94112fd0 con 0x7f0f941087d0 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f92ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f94102dc0 0x7f0f941994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f92ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f94102dc0 0x7f0f941994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49982/0 (socket says 172.21.15.19:49982) 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f92ffd640 1 -- 172.21.15.19:0/2631263251 learned_addr learned my addr 172.21.15.19:0/2631263251 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f92ffd640 1 -- 172.21.15.19:0/2631263251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f941087d0 msgr2=0x7f0f94199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f92ffd640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f941087d0 0x7f0f94199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f92ffd640 1 -- 172.21.15.19:0/2631263251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f94109150 msgr2=0x7f0f9419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f937fe640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f94109150 0x7f0f9419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.056+0000 7f0f92ffd640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f94109150 0x7f0f9419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f92ffd640 1 -- 172.21.15.19:0/2631263251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9419f5a0 con 0x7f0f94102dc0 2024-09-11T00:01:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f937fe640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f94109150 0x7f0f9419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f92ffd640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f94102dc0 0x7f0f941994f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400b4a0 tx=0x7f0f8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f7bfff640 1 -- 172.21.15.19:0/2631263251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84014070 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9419f890 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f7bfff640 1 -- 172.21.15.19:0/2631263251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f84010ac0 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f7bfff640 1 -- 172.21.15.19:0/2631263251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84017c30 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.057+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f941a5f50 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.058+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f94103220 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.059+0000 7f0f7bfff640 1 -- 172.21.15.19:0/2631263251 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f0f84010610 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.060+0000 7f0f7bfff640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f7c0b53c0 0x7f0f7c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.060+0000 7f0f927fc640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f7c0b53c0 0x7f0f7c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.060+0000 7f0f7bfff640 1 -- 172.21.15.19:0/2631263251 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f0f840e57d0 con 0x7f0f94102dc0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.061+0000 7f0f927fc640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f7c0b53c0 0x7f0f7c0b7880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f880096c0 tx=0x7f0f88031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.064+0000 7f0f7bfff640 1 -- 172.21.15.19:0/2631263251 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f840ac490 con 0x7f0f94102dc0 2024-09-11T00:01:47.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.246+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f94063590 con 0x7f0f7c0b53c0 2024-09-11T00:01:47.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:01:47.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:01:47.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:46 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.250+0000 7f0f7bfff640 1 -- 172.21.15.19:0/2631263251 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258955 (secure 0 0 0) 0x7f0f94063590 con 0x7f0f7c0b53c0 2024-09-11T00:01:47.254 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:47.255 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:01:47.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f7c0b53c0 msgr2=0x7f0f7c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:47.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f7c0b53c0 0x7f0f7c0b7880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f880096c0 tx=0x7f0f88031400 comp rx=0 tx=0).stop 2024-09-11T00:01:47.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f94102dc0 msgr2=0x7f0f941994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:47.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f94102dc0 0x7f0f941994f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400b4a0 tx=0x7f0f8400b960 comp rx=0 tx=0).stop 2024-09-11T00:01:47.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 shutdown_connections 2024-09-11T00:01:47.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f94109150 0x7f0f9419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f941087d0 0x7f0f94199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f7c0b53c0 0x7f0f7c0b7880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 --2- 172.21.15.19:0/2631263251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f94102dc0 0x7f0f941994f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:47.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 >> 172.21.15.19:0/2631263251 conn(0x7f0f940fe830 msgr2=0x7f0f94100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:47.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 shutdown_connections 2024-09-11T00:01:47.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:47.253+0000 7f0f99535640 1 -- 172.21.15.19:0/2631263251 wait complete. 2024-09-11T00:01:47.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:01:47.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:01:47.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:46 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:01:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:01:47.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:46 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:01:47.933 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-11T00:01:46.507476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653812,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":489,"num_read_kb":339,"num_write":284,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363884,"kb_used_data":10416,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577940,"statfs":{"total":1151940427776,"available":1151567810560,"internally_reserved":0,"allocated":10665984,"data_stored":7019004,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003272"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610528+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:00:53.610528+0000","last_peered":"2024-09-11T00:00:53.610528+0000","last_clean":"2024-09-11T00:00:53.610528+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:00:53.610528+0000","last_undegraded":"2024-09-11T00:00:53.610528+0000","last_fullsized":"2024-09-11T00:00:53.610528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607796+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:00:53.607796+0000","last_peered":"2024-09-11T00:00:53.607796+0000","last_clean":"2024-09-11T00:00:53.607796+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:00:53.607796+0000","last_undegraded":"2024-09-11T00:00:53.607796+0000","last_fullsized":"2024-09-11T00:00:53.607796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607548+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:00:53.607548+0000","last_peered":"2024-09-11T00:00:53.607548+0000","last_clean":"2024-09-11T00:00:53.607548+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:00:53.607548+0000","last_undegraded":"2024-09-11T00:00:53.607548+0000","last_fullsized":"2024-09-11T00:00:53.607548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:00:53.605506+0000","last_peered":"2024-09-11T00:00:53.605506+0000","last_clean":"2024-09-11T00:00:53.605506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:00:53.605506+0000","last_undegraded":"2024-09-11T00:00:53.605506+0000","last_fullsized":"2024-09-11T00:00:53.605506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607907+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:00:53.607907+0000","last_peered":"2024-09-11T00:00:53.607907+0000","last_clean":"2024-09-11T00:00:53.607907+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:00:53.607907+0000","last_undegraded":"2024-09-11T00:00:53.607907+0000","last_fullsized":"2024-09-11T00:00:53.607907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697868+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:00:53.697868+0000","last_peered":"2024-09-11T00:00:53.697868+0000","last_clean":"2024-09-11T00:00:53.697868+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:00:53.697868+0000","last_undegraded":"2024-09-11T00:00:53.697868+0000","last_fullsized":"2024-09-11T00:00:53.697868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607284+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:00:53.607284+0000","last_peered":"2024-09-11T00:00:53.607284+0000","last_clean":"2024-09-11T00:00:53.607284+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:00:53.607284+0000","last_undegraded":"2024-09-11T00:00:53.607284+0000","last_fullsized":"2024-09-11T00:00:53.607284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697403+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:00:53.697403+0000","last_peered":"2024-09-11T00:00:53.697403+0000","last_clean":"2024-09-11T00:00:53.697403+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:00:53.697403+0000","last_undegraded":"2024-09-11T00:00:53.697403+0000","last_fullsized":"2024-09-11T00:00:53.697403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698427+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:00:53.698427+0000","last_peered":"2024-09-11T00:00:53.698427+0000","last_clean":"2024-09-11T00:00:53.698427+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:00:53.698427+0000","last_undegraded":"2024-09-11T00:00:53.698427+0000","last_fullsized":"2024-09-11T00:00:53.698427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698160+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:00:53.698160+0000","last_peered":"2024-09-11T00:00:53.698160+0000","last_clean":"2024-09-11T00:00:53.698160+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:00:53.698160+0000","last_undegraded":"2024-09-11T00:00:53.698160+0000","last_fullsized":"2024-09-11T00:00:53.698160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607338+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:00:53.607338+0000","last_peered":"2024-09-11T00:00:53.607338+0000","last_clean":"2024-09-11T00:00:53.607338+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:00:53.607338+0000","last_undegraded":"2024-09-11T00:00:53.607338+0000","last_fullsized":"2024-09-11T00:00:53.607338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605630+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:00:53.605630+0000","last_peered":"2024-09-11T00:00:53.605630+0000","last_clean":"2024-09-11T00:00:53.605630+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:00:53.605630+0000","last_undegraded":"2024-09-11T00:00:53.605630+0000","last_fullsized":"2024-09-11T00:00:53.605630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608293+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:00:53.608293+0000","last_peered":"2024-09-11T00:00:53.608293+0000","last_clean":"2024-09-11T00:00:53.608293+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:00:53.608293+0000","last_undegraded":"2024-09-11T00:00:53.608293+0000","last_fullsized":"2024-09-11T00:00:53.608293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607421+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:00:53.607421+0000","last_peered":"2024-09-11T00:00:53.607421+0000","last_clean":"2024-09-11T00:00:53.607421+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:00:53.607421+0000","last_undegraded":"2024-09-11T00:00:53.607421+0000","last_fullsized":"2024-09-11T00:00:53.607421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607980+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:00:53.607980+0000","last_peered":"2024-09-11T00:00:53.607980+0000","last_clean":"2024-09-11T00:00:53.607980+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:00:53.607980+0000","last_undegraded":"2024-09-11T00:00:53.607980+0000","last_fullsized":"2024-09-11T00:00:53.607980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697447+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:00:53.697447+0000","last_peered":"2024-09-11T00:00:53.697447+0000","last_clean":"2024-09-11T00:00:53.697447+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:00:53.697447+0000","last_undegraded":"2024-09-11T00:00:53.697447+0000","last_fullsized":"2024-09-11T00:00:53.697447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610581+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:00:53.610581+0000","last_peered":"2024-09-11T00:00:53.610581+0000","last_clean":"2024-09-11T00:00:53.610581+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:00:53.610581+0000","last_undegraded":"2024-09-11T00:00:53.610581+0000","last_fullsized":"2024-09-11T00:00:53.610581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604702+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:00:53.604702+0000","last_peered":"2024-09-11T00:00:53.604702+0000","last_clean":"2024-09-11T00:00:53.604702+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:00:53.604702+0000","last_undegraded":"2024-09-11T00:00:53.604702+0000","last_fullsized":"2024-09-11T00:00:53.604702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608539+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:00:53.608539+0000","last_peered":"2024-09-11T00:00:53.608539+0000","last_clean":"2024-09-11T00:00:53.608539+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:00:53.608539+0000","last_undegraded":"2024-09-11T00:00:53.608539+0000","last_fullsized":"2024-09-11T00:00:53.608539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609167+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:00:53.609167+0000","last_peered":"2024-09-11T00:00:53.609167+0000","last_clean":"2024-09-11T00:00:53.609167+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:00:53.609167+0000","last_undegraded":"2024-09-11T00:00:53.609167+0000","last_fullsized":"2024-09-11T00:00:53.609167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608387+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:00:53.608387+0000","last_peered":"2024-09-11T00:00:53.608387+0000","last_clean":"2024-09-11T00:00:53.608387+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:00:53.608387+0000","last_undegraded":"2024-09-11T00:00:53.608387+0000","last_fullsized":"2024-09-11T00:00:53.608387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697829+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:00:53.697829+0000","last_peered":"2024-09-11T00:00:53.697829+0000","last_clean":"2024-09-11T00:00:53.697829+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:00:53.697829+0000","last_undegraded":"2024-09-11T00:00:53.697829+0000","last_fullsized":"2024-09-11T00:00:53.697829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697440+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:00:53.697440+0000","last_peered":"2024-09-11T00:00:53.697440+0000","last_clean":"2024-09-11T00:00:53.697440+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:00:53.697440+0000","last_undegraded":"2024-09-11T00:00:53.697440+0000","last_fullsized":"2024-09-11T00:00:53.697440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609524+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:00:53.609524+0000","last_peered":"2024-09-11T00:00:53.609524+0000","last_clean":"2024-09-11T00:00:53.609524+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:00:53.609524+0000","last_undegraded":"2024-09-11T00:00:53.609524+0000","last_fullsized":"2024-09-11T00:00:53.609524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697755+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:00:53.697755+0000","last_peered":"2024-09-11T00:00:53.697755+0000","last_clean":"2024-09-11T00:00:53.697755+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:00:53.697755+0000","last_undegraded":"2024-09-11T00:00:53.697755+0000","last_fullsized":"2024-09-11T00:00:53.697755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608401+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:00:53.608401+0000","last_peered":"2024-09-11T00:00:53.608401+0000","last_clean":"2024-09-11T00:00:53.608401+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:00:53.608401+0000","last_undegraded":"2024-09-11T00:00:53.608401+0000","last_fullsized":"2024-09-11T00:00:53.608401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609403+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:00:53.609403+0000","last_peered":"2024-09-11T00:00:53.609403+0000","last_clean":"2024-09-11T00:00:53.609403+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:00:53.609403+0000","last_undegraded":"2024-09-11T00:00:53.609403+0000","last_fullsized":"2024-09-11T00:00:53.609403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610028+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:00:53.610028+0000","last_peered":"2024-09-11T00:00:53.610028+0000","last_clean":"2024-09-11T00:00:53.610028+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:00:53.610028+0000","last_undegraded":"2024-09-11T00:00:53.610028+0000","last_fullsized":"2024-09-11T00:00:53.610028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608648+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:00:53.608648+0000","last_peered":"2024-09-11T00:00:53.608648+0000","last_clean":"2024-09-11T00:00:53.608648+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:00:53.608648+0000","last_undegraded":"2024-09-11T00:00:53.608648+0000","last_fullsized":"2024-09-11T00:00:53.608648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608123+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:00:53.608123+0000","last_peered":"2024-09-11T00:00:53.608123+0000","last_clean":"2024-09-11T00:00:53.608123+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:00:53.608123+0000","last_undegraded":"2024-09-11T00:00:53.608123+0000","last_fullsized":"2024-09-11T00:00:53.608123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607903+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:00:53.607903+0000","last_peered":"2024-09-11T00:00:53.607903+0000","last_clean":"2024-09-11T00:00:53.607903+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:00:53.607903+0000","last_undegraded":"2024-09-11T00:00:53.607903+0000","last_fullsized":"2024-09-11T00:00:53.607903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607733+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:00:53.607733+0000","last_peered":"2024-09-11T00:00:53.607733+0000","last_clean":"2024-09-11T00:00:53.607733+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:00:53.607733+0000","last_undegraded":"2024-09-11T00:00:53.607733+0000","last_fullsized":"2024-09-11T00:00:53.607733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608446+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:00:53.608446+0000","last_peered":"2024-09-11T00:00:53.608446+0000","last_clean":"2024-09-11T00:00:53.608446+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:00:53.608446+0000","last_undegraded":"2024-09-11T00:00:53.608446+0000","last_fullsized":"2024-09-11T00:00:53.608446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":94,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:41.396213+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:01:41.396213+0000","last_peered":"2024-09-11T00:01:41.396213+0000","last_clean":"2024-09-11T00:01:41.396213+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:01:41.396213+0000","last_undegraded":"2024-09-11T00:01:41.396213+0000","last_fullsized":"2024-09-11T00:01:41.396213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609036+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:00:53.609036+0000","last_peered":"2024-09-11T00:00:53.609036+0000","last_clean":"2024-09-11T00:00:53.609036+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:00:53.609036+0000","last_undegraded":"2024-09-11T00:00:53.609036+0000","last_fullsized":"2024-09-11T00:00:53.609036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697456+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:00:53.697456+0000","last_peered":"2024-09-11T00:00:53.697456+0000","last_clean":"2024-09-11T00:00:53.697456+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:00:53.697456+0000","last_undegraded":"2024-09-11T00:00:53.697456+0000","last_fullsized":"2024-09-11T00:00:53.697456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604331+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:00:53.604331+0000","last_peered":"2024-09-11T00:00:53.604331+0000","last_clean":"2024-09-11T00:00:53.604331+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:00:53.604331+0000","last_undegraded":"2024-09-11T00:00:53.604331+0000","last_fullsized":"2024-09-11T00:00:53.604331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":89,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:40.394223+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:01:40.394223+0000","last_peered":"2024-09-11T00:01:40.394223+0000","last_clean":"2024-09-11T00:01:40.394223+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:01:40.394223+0000","last_undegraded":"2024-09-11T00:01:40.394223+0000","last_fullsized":"2024-09-11T00:01:40.394223+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697914+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:00:53.697914+0000","last_peered":"2024-09-11T00:00:53.697914+0000","last_clean":"2024-09-11T00:00:53.697914+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:00:53.697914+0000","last_undegraded":"2024-09-11T00:00:53.697914+0000","last_fullsized":"2024-09-11T00:00:53.697914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608380+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:00:53.608380+0000","last_peered":"2024-09-11T00:00:53.608380+0000","last_clean":"2024-09-11T00:00:53.608380+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:00:53.608380+0000","last_undegraded":"2024-09-11T00:00:53.608380+0000","last_fullsized":"2024-09-11T00:00:53.608380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697945+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:00:53.697945+0000","last_peered":"2024-09-11T00:00:53.697945+0000","last_clean":"2024-09-11T00:00:53.697945+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:00:53.697945+0000","last_undegraded":"2024-09-11T00:00:53.697945+0000","last_fullsized":"2024-09-11T00:00:53.697945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'26","reported_seq":183,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:41.395659+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:01:41.395659+0000","last_peered":"2024-09-11T00:01:41.395659+0000","last_clean":"2024-09-11T00:01:41.395659+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:01:41.395659+0000","last_undegraded":"2024-09-11T00:01:41.395659+0000","last_fullsized":"2024-09-11T00:01:41.395659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608809+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:00:53.608809+0000","last_peered":"2024-09-11T00:00:53.608809+0000","last_clean":"2024-09-11T00:00:53.608809+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:00:53.608809+0000","last_undegraded":"2024-09-11T00:00:53.608809+0000","last_fullsized":"2024-09-11T00:00:53.608809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607445+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:00:53.607445+0000","last_peered":"2024-09-11T00:00:53.607445+0000","last_clean":"2024-09-11T00:00:53.607445+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:00:53.607445+0000","last_undegraded":"2024-09-11T00:00:53.607445+0000","last_fullsized":"2024-09-11T00:00:53.607445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610837+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:00:53.610837+0000","last_peered":"2024-09-11T00:00:53.610837+0000","last_clean":"2024-09-11T00:00:53.610837+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:00:53.610837+0000","last_undegraded":"2024-09-11T00:00:53.610837+0000","last_fullsized":"2024-09-11T00:00:53.610837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":94,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:41.396505+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:01:41.396505+0000","last_peered":"2024-09-11T00:01:41.396505+0000","last_clean":"2024-09-11T00:01:41.396505+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:01:41.396505+0000","last_undegraded":"2024-09-11T00:01:41.396505+0000","last_fullsized":"2024-09-11T00:01:41.396505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607094+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:00:53.607094+0000","last_peered":"2024-09-11T00:00:53.607094+0000","last_clean":"2024-09-11T00:00:53.607094+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:00:53.607094+0000","last_undegraded":"2024-09-11T00:00:53.607094+0000","last_fullsized":"2024-09-11T00:00:53.607094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.699247+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:00:53.699247+0000","last_peered":"2024-09-11T00:00:53.699247+0000","last_clean":"2024-09-11T00:00:53.699247+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:00:53.699247+0000","last_undegraded":"2024-09-11T00:00:53.699247+0000","last_fullsized":"2024-09-11T00:00:53.699247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608145+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:00:53.608145+0000","last_peered":"2024-09-11T00:00:53.608145+0000","last_clean":"2024-09-11T00:00:53.608145+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:00:53.608145+0000","last_undegraded":"2024-09-11T00:00:53.608145+0000","last_fullsized":"2024-09-11T00:00:53.608145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607541+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:00:53.607541+0000","last_peered":"2024-09-11T00:00:53.607541+0000","last_clean":"2024-09-11T00:00:53.607541+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:00:53.607541+0000","last_undegraded":"2024-09-11T00:00:53.607541+0000","last_fullsized":"2024-09-11T00:00:53.607541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607290+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:00:53.607290+0000","last_peered":"2024-09-11T00:00:53.607290+0000","last_clean":"2024-09-11T00:00:53.607290+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:00:53.607290+0000","last_undegraded":"2024-09-11T00:00:53.607290+0000","last_fullsized":"2024-09-11T00:00:53.607290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607628+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:00:53.607628+0000","last_peered":"2024-09-11T00:00:53.607628+0000","last_clean":"2024-09-11T00:00:53.607628+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:00:53.607628+0000","last_undegraded":"2024-09-11T00:00:53.607628+0000","last_fullsized":"2024-09-11T00:00:53.607628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607354+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607354+0000","last_peered":"2024-09-11T00:00:53.607354+0000","last_clean":"2024-09-11T00:00:53.607354+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607354+0000","last_undegraded":"2024-09-11T00:00:53.607354+0000","last_fullsized":"2024-09-11T00:00:53.607354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605463+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605463+0000","last_peered":"2024-09-11T00:00:53.605463+0000","last_clean":"2024-09-11T00:00:53.605463+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605463+0000","last_undegraded":"2024-09-11T00:00:53.605463+0000","last_fullsized":"2024-09-11T00:00:53.605463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697601+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:00:53.697601+0000","last_peered":"2024-09-11T00:00:53.697601+0000","last_clean":"2024-09-11T00:00:53.697601+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:00:53.697601+0000","last_undegraded":"2024-09-11T00:00:53.697601+0000","last_fullsized":"2024-09-11T00:00:53.697601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607224+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607224+0000","last_peered":"2024-09-11T00:00:53.607224+0000","last_clean":"2024-09-11T00:00:53.607224+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607224+0000","last_undegraded":"2024-09-11T00:00:53.607224+0000","last_fullsized":"2024-09-11T00:00:53.607224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607136+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:00:53.607136+0000","last_peered":"2024-09-11T00:00:53.607136+0000","last_clean":"2024-09-11T00:00:53.607136+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:00:53.607136+0000","last_undegraded":"2024-09-11T00:00:53.607136+0000","last_fullsized":"2024-09-11T00:00:53.607136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":93,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:43.398849+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:01:43.398849+0000","last_peered":"2024-09-11T00:01:43.398849+0000","last_clean":"2024-09-11T00:01:43.398849+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:01:43.398849+0000","last_undegraded":"2024-09-11T00:01:43.398849+0000","last_fullsized":"2024-09-11T00:01:43.398849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612423+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:00:53.612423+0000","last_peered":"2024-09-11T00:00:53.612423+0000","last_clean":"2024-09-11T00:00:53.612423+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:00:53.612423+0000","last_undegraded":"2024-09-11T00:00:53.612423+0000","last_fullsized":"2024-09-11T00:00:53.612423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607808+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607808+0000","last_peered":"2024-09-11T00:00:53.607808+0000","last_clean":"2024-09-11T00:00:53.607808+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607808+0000","last_undegraded":"2024-09-11T00:00:53.607808+0000","last_fullsized":"2024-09-11T00:00:53.607808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697889+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:00:53.697889+0000","last_peered":"2024-09-11T00:00:53.697889+0000","last_clean":"2024-09-11T00:00:53.697889+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:00:53.697889+0000","last_undegraded":"2024-09-11T00:00:53.697889+0000","last_fullsized":"2024-09-11T00:00:53.697889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.611825+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.611825+0000","last_peered":"2024-09-11T00:00:53.611825+0000","last_clean":"2024-09-11T00:00:53.611825+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.611825+0000","last_undegraded":"2024-09-11T00:00:53.611825+0000","last_fullsized":"2024-09-11T00:00:53.611825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697988+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:00:53.697988+0000","last_peered":"2024-09-11T00:00:53.697988+0000","last_clean":"2024-09-11T00:00:53.697988+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:00:53.697988+0000","last_undegraded":"2024-09-11T00:00:53.697988+0000","last_fullsized":"2024-09-11T00:00:53.697988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607608+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:00:53.607608+0000","last_peered":"2024-09-11T00:00:53.607608+0000","last_clean":"2024-09-11T00:00:53.607608+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:00:53.607608+0000","last_undegraded":"2024-09-11T00:00:53.607608+0000","last_fullsized":"2024-09-11T00:00:53.607608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:54.250572+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:00:54.250572+0000","last_peered":"2024-09-11T00:00:54.250572+0000","last_clean":"2024-09-11T00:00:54.250572+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:00:54.250572+0000","last_undegraded":"2024-09-11T00:00:54.250572+0000","last_fullsized":"2024-09-11T00:00:54.250572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697866+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:00:53.697866+0000","last_peered":"2024-09-11T00:00:53.697866+0000","last_clean":"2024-09-11T00:00:53.697866+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:00:53.697866+0000","last_undegraded":"2024-09-11T00:00:53.697866+0000","last_fullsized":"2024-09-11T00:00:53.697866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607896+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:00:53.607896+0000","last_peered":"2024-09-11T00:00:53.607896+0000","last_clean":"2024-09-11T00:00:53.607896+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:00:53.607896+0000","last_undegraded":"2024-09-11T00:00:53.607896+0000","last_fullsized":"2024-09-11T00:00:53.607896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607559+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:00:53.607559+0000","last_peered":"2024-09-11T00:00:53.607559+0000","last_clean":"2024-09-11T00:00:53.607559+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:00:53.607559+0000","last_undegraded":"2024-09-11T00:00:53.607559+0000","last_fullsized":"2024-09-11T00:00:53.607559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607830+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:00:53.607830+0000","last_peered":"2024-09-11T00:00:53.607830+0000","last_clean":"2024-09-11T00:00:53.607830+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:00:53.607830+0000","last_undegraded":"2024-09-11T00:00:53.607830+0000","last_fullsized":"2024-09-11T00:00:53.607830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697657+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:00:53.697657+0000","last_peered":"2024-09-11T00:00:53.697657+0000","last_clean":"2024-09-11T00:00:53.697657+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:00:53.697657+0000","last_undegraded":"2024-09-11T00:00:53.697657+0000","last_fullsized":"2024-09-11T00:00:53.697657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607530+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:00:53.607530+0000","last_peered":"2024-09-11T00:00:53.607530+0000","last_clean":"2024-09-11T00:00:53.607530+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:00:53.607530+0000","last_undegraded":"2024-09-11T00:00:53.607530+0000","last_fullsized":"2024-09-11T00:00:53.607530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609349+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:00:53.609349+0000","last_peered":"2024-09-11T00:00:53.609349+0000","last_clean":"2024-09-11T00:00:53.609349+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:00:53.609349+0000","last_undegraded":"2024-09-11T00:00:53.609349+0000","last_fullsized":"2024-09-11T00:00:53.609349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697588+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:00:53.697588+0000","last_peered":"2024-09-11T00:00:53.697588+0000","last_clean":"2024-09-11T00:00:53.697588+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:00:53.697588+0000","last_undegraded":"2024-09-11T00:00:53.697588+0000","last_fullsized":"2024-09-11T00:00:53.697588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608277+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:00:53.608277+0000","last_peered":"2024-09-11T00:00:53.608277+0000","last_clean":"2024-09-11T00:00:53.608277+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:00:53.608277+0000","last_undegraded":"2024-09-11T00:00:53.608277+0000","last_fullsized":"2024-09-11T00:00:53.608277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697953+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697953+0000","last_peered":"2024-09-11T00:00:53.697953+0000","last_clean":"2024-09-11T00:00:53.697953+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697953+0000","last_undegraded":"2024-09-11T00:00:53.697953+0000","last_fullsized":"2024-09-11T00:00:53.697953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697819+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:00:53.697819+0000","last_peered":"2024-09-11T00:00:53.697819+0000","last_clean":"2024-09-11T00:00:53.697819+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:00:53.697819+0000","last_undegraded":"2024-09-11T00:00:53.697819+0000","last_fullsized":"2024-09-11T00:00:53.697819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604729+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604729+0000","last_peered":"2024-09-11T00:00:53.604729+0000","last_clean":"2024-09-11T00:00:53.604729+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604729+0000","last_undegraded":"2024-09-11T00:00:53.604729+0000","last_fullsized":"2024-09-11T00:00:53.604729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63210,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":408,"num_read_kb":270,"num_write":159,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710749,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1073127,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070503,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266732,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462962,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":1014132,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":1013425,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953536,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":423081,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149765,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378700,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":481441,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542224,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":480673,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:01:47.938 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:01:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:48.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:47 smithi019 ceph-mon[30859]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:48.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:47 smithi019 ceph-mon[30859]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:47 smithi131 ceph-mon[35491]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:47 smithi131 ceph-mon[35491]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:47 smithi135 ceph-mon[35432]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:47 smithi135 ceph-mon[35432]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 -- 172.21.15.19:0/816598019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 msgr2=0x7f43dc10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 --2- 172.21.15.19:0/816598019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc10f560 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009900 tx=0x7f43d402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 -- 172.21.15.19:0/816598019 shutdown_connections 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 --2- 172.21.15.19:0/816598019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc10f560 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 --2- 172.21.15.19:0/816598019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc1045c0 0x7f43dc10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 --2- 172.21.15.19:0/816598019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc103ca0 0x7f43dc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 -- 172.21.15.19:0/816598019 >> 172.21.15.19:0/816598019 conn(0x7f43dc0fd700 msgr2=0x7f43dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 -- 172.21.15.19:0/816598019 shutdown_connections 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 -- 172.21.15.19:0/816598019 wait complete. 2024-09-11T00:01:48.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 Processor -- start 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.737+0000 7f43e2fde640 1 -- start start 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e2fde640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc103ca0 0x7f43dc101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e2fde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc1045c0 0x7f43dc101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e2fde640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e2fde640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112d70 con 0x7f43dc10d100 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e2fde640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112bf0 con 0x7f43dc103ca0 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e2fde640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112ef0 con 0x7f43dc1045c0 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc1023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50002/0 (socket says 172.21.15.19:50002) 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 -- 172.21.15.19:0/3140215196 learned_addr learned my addr 172.21.15.19:0/3140215196 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e0d7a640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc103ca0 0x7f43dc101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43dbfff640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc1045c0 0x7f43dc101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:48.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 -- 172.21.15.19:0/3140215196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc1045c0 msgr2=0x7f43dc101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc1045c0 0x7f43dc101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 -- 172.21.15.19:0/3140215196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc103ca0 msgr2=0x7f43dc101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc103ca0 0x7f43dc101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 -- 172.21.15.19:0/3140215196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1a7640 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.738+0000 7f43e157b640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc1023d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43d4004770 tx=0x7f43d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.739+0000 7f43d9ffb640 1 -- 172.21.15.19:0/3140215196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d403f030 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.739+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1a78d0 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.739+0000 7f43d9ffb640 1 -- 172.21.15.19:0/3140215196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43d4003aa0 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.739+0000 7f43d9ffb640 1 -- 172.21.15.19:0/3140215196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4035070 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.739+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1a7e00 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.740+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc104080 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.741+0000 7f43d9ffb640 1 -- 172.21.15.19:0/3140215196 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f43d403bb10 con 0x7f43dc10d100 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.742+0000 7f43d9ffb640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f43c80b53c0 0x7f43c80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:48.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.742+0000 7f43e0d7a640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f43c80b53c0 0x7f43c80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:48.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.742+0000 7f43d9ffb640 1 -- 172.21.15.19:0/3140215196 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f43d4106ac0 con 0x7f43dc10d100 2024-09-11T00:01:48.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.742+0000 7f43e0d7a640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f43c80b53c0 0x7f43c80b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43cc005fd0 tx=0x7f43cc009760 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:48.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.745+0000 7f43d9ffb640 1 -- 172.21.15.19:0/3140215196 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43d40cd780 con 0x7f43dc10d100 2024-09-11T00:01:48.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.927+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43dc0ffa20 con 0x7f43c80b53c0 2024-09-11T00:01:48.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.931+0000 7f43d9ffb640 1 -- 172.21.15.19:0/3140215196 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258955 (secure 0 0 0) 0x7f43dc0ffa20 con 0x7f43c80b53c0 2024-09-11T00:01:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:48.936 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:01:48.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f43c80b53c0 msgr2=0x7f43c80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:48.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f43c80b53c0 0x7f43c80b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43cc005fd0 tx=0x7f43cc009760 comp rx=0 tx=0).stop 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 msgr2=0x7f43dc1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc1023d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43d4004770 tx=0x7f43d4004270 comp rx=0 tx=0).stop 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 shutdown_connections 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f43c80b53c0 0x7f43c80b7880 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43dc10d100 0x7f43dc1023d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc1045c0 0x7f43dc101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 --2- 172.21.15.19:0/3140215196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc103ca0 0x7f43dc101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 >> 172.21.15.19:0/3140215196 conn(0x7f43dc0fd700 msgr2=0x7f43dc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 shutdown_connections 2024-09-11T00:01:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:48.935+0000 7f43e2fde640 1 -- 172.21.15.19:0/3140215196 wait complete. 2024-09-11T00:01:49.650 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-11T00:01:48.507920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653812,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":284,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363884,"kb_used_data":10416,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577940,"statfs":{"total":1151940427776,"available":1151567810560,"internally_reserved":0,"allocated":10665984,"data_stored":7019004,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003289"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610528+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:00:53.610528+0000","last_peered":"2024-09-11T00:00:53.610528+0000","last_clean":"2024-09-11T00:00:53.610528+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:00:53.610528+0000","last_undegraded":"2024-09-11T00:00:53.610528+0000","last_fullsized":"2024-09-11T00:00:53.610528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607796+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:00:53.607796+0000","last_peered":"2024-09-11T00:00:53.607796+0000","last_clean":"2024-09-11T00:00:53.607796+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:00:53.607796+0000","last_undegraded":"2024-09-11T00:00:53.607796+0000","last_fullsized":"2024-09-11T00:00:53.607796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607548+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:00:53.607548+0000","last_peered":"2024-09-11T00:00:53.607548+0000","last_clean":"2024-09-11T00:00:53.607548+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:00:53.607548+0000","last_undegraded":"2024-09-11T00:00:53.607548+0000","last_fullsized":"2024-09-11T00:00:53.607548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:00:53.605506+0000","last_peered":"2024-09-11T00:00:53.605506+0000","last_clean":"2024-09-11T00:00:53.605506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:00:53.605506+0000","last_undegraded":"2024-09-11T00:00:53.605506+0000","last_fullsized":"2024-09-11T00:00:53.605506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607907+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:00:53.607907+0000","last_peered":"2024-09-11T00:00:53.607907+0000","last_clean":"2024-09-11T00:00:53.607907+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:00:53.607907+0000","last_undegraded":"2024-09-11T00:00:53.607907+0000","last_fullsized":"2024-09-11T00:00:53.607907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697868+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:00:53.697868+0000","last_peered":"2024-09-11T00:00:53.697868+0000","last_clean":"2024-09-11T00:00:53.697868+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:00:53.697868+0000","last_undegraded":"2024-09-11T00:00:53.697868+0000","last_fullsized":"2024-09-11T00:00:53.697868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607284+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:00:53.607284+0000","last_peered":"2024-09-11T00:00:53.607284+0000","last_clean":"2024-09-11T00:00:53.607284+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:00:53.607284+0000","last_undegraded":"2024-09-11T00:00:53.607284+0000","last_fullsized":"2024-09-11T00:00:53.607284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697403+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:00:53.697403+0000","last_peered":"2024-09-11T00:00:53.697403+0000","last_clean":"2024-09-11T00:00:53.697403+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:00:53.697403+0000","last_undegraded":"2024-09-11T00:00:53.697403+0000","last_fullsized":"2024-09-11T00:00:53.697403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698427+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:00:53.698427+0000","last_peered":"2024-09-11T00:00:53.698427+0000","last_clean":"2024-09-11T00:00:53.698427+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:00:53.698427+0000","last_undegraded":"2024-09-11T00:00:53.698427+0000","last_fullsized":"2024-09-11T00:00:53.698427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.698160+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:00:53.698160+0000","last_peered":"2024-09-11T00:00:53.698160+0000","last_clean":"2024-09-11T00:00:53.698160+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:00:53.698160+0000","last_undegraded":"2024-09-11T00:00:53.698160+0000","last_fullsized":"2024-09-11T00:00:53.698160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607338+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:00:53.607338+0000","last_peered":"2024-09-11T00:00:53.607338+0000","last_clean":"2024-09-11T00:00:53.607338+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:00:53.607338+0000","last_undegraded":"2024-09-11T00:00:53.607338+0000","last_fullsized":"2024-09-11T00:00:53.607338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605630+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:00:53.605630+0000","last_peered":"2024-09-11T00:00:53.605630+0000","last_clean":"2024-09-11T00:00:53.605630+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:00:53.605630+0000","last_undegraded":"2024-09-11T00:00:53.605630+0000","last_fullsized":"2024-09-11T00:00:53.605630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608293+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:00:53.608293+0000","last_peered":"2024-09-11T00:00:53.608293+0000","last_clean":"2024-09-11T00:00:53.608293+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:00:53.608293+0000","last_undegraded":"2024-09-11T00:00:53.608293+0000","last_fullsized":"2024-09-11T00:00:53.608293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607421+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:00:53.607421+0000","last_peered":"2024-09-11T00:00:53.607421+0000","last_clean":"2024-09-11T00:00:53.607421+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:00:53.607421+0000","last_undegraded":"2024-09-11T00:00:53.607421+0000","last_fullsized":"2024-09-11T00:00:53.607421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607980+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:00:53.607980+0000","last_peered":"2024-09-11T00:00:53.607980+0000","last_clean":"2024-09-11T00:00:53.607980+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:00:53.607980+0000","last_undegraded":"2024-09-11T00:00:53.607980+0000","last_fullsized":"2024-09-11T00:00:53.607980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697447+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:00:53.697447+0000","last_peered":"2024-09-11T00:00:53.697447+0000","last_clean":"2024-09-11T00:00:53.697447+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:00:53.697447+0000","last_undegraded":"2024-09-11T00:00:53.697447+0000","last_fullsized":"2024-09-11T00:00:53.697447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610581+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:00:53.610581+0000","last_peered":"2024-09-11T00:00:53.610581+0000","last_clean":"2024-09-11T00:00:53.610581+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:00:53.610581+0000","last_undegraded":"2024-09-11T00:00:53.610581+0000","last_fullsized":"2024-09-11T00:00:53.610581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604702+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:00:53.604702+0000","last_peered":"2024-09-11T00:00:53.604702+0000","last_clean":"2024-09-11T00:00:53.604702+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:00:53.604702+0000","last_undegraded":"2024-09-11T00:00:53.604702+0000","last_fullsized":"2024-09-11T00:00:53.604702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608539+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:00:53.608539+0000","last_peered":"2024-09-11T00:00:53.608539+0000","last_clean":"2024-09-11T00:00:53.608539+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:00:53.608539+0000","last_undegraded":"2024-09-11T00:00:53.608539+0000","last_fullsized":"2024-09-11T00:00:53.608539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609167+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:00:53.609167+0000","last_peered":"2024-09-11T00:00:53.609167+0000","last_clean":"2024-09-11T00:00:53.609167+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:00:53.609167+0000","last_undegraded":"2024-09-11T00:00:53.609167+0000","last_fullsized":"2024-09-11T00:00:53.609167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608387+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:00:53.608387+0000","last_peered":"2024-09-11T00:00:53.608387+0000","last_clean":"2024-09-11T00:00:53.608387+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:00:53.608387+0000","last_undegraded":"2024-09-11T00:00:53.608387+0000","last_fullsized":"2024-09-11T00:00:53.608387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697829+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:00:53.697829+0000","last_peered":"2024-09-11T00:00:53.697829+0000","last_clean":"2024-09-11T00:00:53.697829+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:00:53.697829+0000","last_undegraded":"2024-09-11T00:00:53.697829+0000","last_fullsized":"2024-09-11T00:00:53.697829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697440+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:00:53.697440+0000","last_peered":"2024-09-11T00:00:53.697440+0000","last_clean":"2024-09-11T00:00:53.697440+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:00:53.697440+0000","last_undegraded":"2024-09-11T00:00:53.697440+0000","last_fullsized":"2024-09-11T00:00:53.697440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609524+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:00:53.609524+0000","last_peered":"2024-09-11T00:00:53.609524+0000","last_clean":"2024-09-11T00:00:53.609524+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:00:53.609524+0000","last_undegraded":"2024-09-11T00:00:53.609524+0000","last_fullsized":"2024-09-11T00:00:53.609524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697755+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:00:53.697755+0000","last_peered":"2024-09-11T00:00:53.697755+0000","last_clean":"2024-09-11T00:00:53.697755+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:00:53.697755+0000","last_undegraded":"2024-09-11T00:00:53.697755+0000","last_fullsized":"2024-09-11T00:00:53.697755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608401+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:00:53.608401+0000","last_peered":"2024-09-11T00:00:53.608401+0000","last_clean":"2024-09-11T00:00:53.608401+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:00:53.608401+0000","last_undegraded":"2024-09-11T00:00:53.608401+0000","last_fullsized":"2024-09-11T00:00:53.608401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609403+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:00:53.609403+0000","last_peered":"2024-09-11T00:00:53.609403+0000","last_clean":"2024-09-11T00:00:53.609403+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:00:53.609403+0000","last_undegraded":"2024-09-11T00:00:53.609403+0000","last_fullsized":"2024-09-11T00:00:53.609403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610028+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:00:53.610028+0000","last_peered":"2024-09-11T00:00:53.610028+0000","last_clean":"2024-09-11T00:00:53.610028+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:00:53.610028+0000","last_undegraded":"2024-09-11T00:00:53.610028+0000","last_fullsized":"2024-09-11T00:00:53.610028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608648+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:00:53.608648+0000","last_peered":"2024-09-11T00:00:53.608648+0000","last_clean":"2024-09-11T00:00:53.608648+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:00:53.608648+0000","last_undegraded":"2024-09-11T00:00:53.608648+0000","last_fullsized":"2024-09-11T00:00:53.608648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608123+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:00:53.608123+0000","last_peered":"2024-09-11T00:00:53.608123+0000","last_clean":"2024-09-11T00:00:53.608123+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:00:53.608123+0000","last_undegraded":"2024-09-11T00:00:53.608123+0000","last_fullsized":"2024-09-11T00:00:53.608123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607903+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:00:53.607903+0000","last_peered":"2024-09-11T00:00:53.607903+0000","last_clean":"2024-09-11T00:00:53.607903+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:00:53.607903+0000","last_undegraded":"2024-09-11T00:00:53.607903+0000","last_fullsized":"2024-09-11T00:00:53.607903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607733+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:00:53.607733+0000","last_peered":"2024-09-11T00:00:53.607733+0000","last_clean":"2024-09-11T00:00:53.607733+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:00:53.607733+0000","last_undegraded":"2024-09-11T00:00:53.607733+0000","last_fullsized":"2024-09-11T00:00:53.607733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608446+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:00:53.608446+0000","last_peered":"2024-09-11T00:00:53.608446+0000","last_clean":"2024-09-11T00:00:53.608446+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:00:53.608446+0000","last_undegraded":"2024-09-11T00:00:53.608446+0000","last_fullsized":"2024-09-11T00:00:53.608446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:46.403163+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:01:46.403163+0000","last_peered":"2024-09-11T00:01:46.403163+0000","last_clean":"2024-09-11T00:01:46.403163+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:01:46.403163+0000","last_undegraded":"2024-09-11T00:01:46.403163+0000","last_fullsized":"2024-09-11T00:01:46.403163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609036+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:00:53.609036+0000","last_peered":"2024-09-11T00:00:53.609036+0000","last_clean":"2024-09-11T00:00:53.609036+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:00:53.609036+0000","last_undegraded":"2024-09-11T00:00:53.609036+0000","last_fullsized":"2024-09-11T00:00:53.609036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697456+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:00:53.697456+0000","last_peered":"2024-09-11T00:00:53.697456+0000","last_clean":"2024-09-11T00:00:53.697456+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:00:53.697456+0000","last_undegraded":"2024-09-11T00:00:53.697456+0000","last_fullsized":"2024-09-11T00:00:53.697456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604331+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:00:53.604331+0000","last_peered":"2024-09-11T00:00:53.604331+0000","last_clean":"2024-09-11T00:00:53.604331+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:00:53.604331+0000","last_undegraded":"2024-09-11T00:00:53.604331+0000","last_fullsized":"2024-09-11T00:00:53.604331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":94,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:45.401036+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:01:45.401036+0000","last_peered":"2024-09-11T00:01:45.401036+0000","last_clean":"2024-09-11T00:01:45.401036+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:01:45.401036+0000","last_undegraded":"2024-09-11T00:01:45.401036+0000","last_fullsized":"2024-09-11T00:01:45.401036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697914+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:00:53.697914+0000","last_peered":"2024-09-11T00:00:53.697914+0000","last_clean":"2024-09-11T00:00:53.697914+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:00:53.697914+0000","last_undegraded":"2024-09-11T00:00:53.697914+0000","last_fullsized":"2024-09-11T00:00:53.697914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608380+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:00:53.608380+0000","last_peered":"2024-09-11T00:00:53.608380+0000","last_clean":"2024-09-11T00:00:53.608380+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:00:53.608380+0000","last_undegraded":"2024-09-11T00:00:53.608380+0000","last_fullsized":"2024-09-11T00:00:53.608380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697945+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:00:53.697945+0000","last_peered":"2024-09-11T00:00:53.697945+0000","last_clean":"2024-09-11T00:00:53.697945+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:00:53.697945+0000","last_undegraded":"2024-09-11T00:00:53.697945+0000","last_fullsized":"2024-09-11T00:00:53.697945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'26","reported_seq":193,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:46.402553+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:01:46.402553+0000","last_peered":"2024-09-11T00:01:46.402553+0000","last_clean":"2024-09-11T00:01:46.402553+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:01:46.402553+0000","last_undegraded":"2024-09-11T00:01:46.402553+0000","last_fullsized":"2024-09-11T00:01:46.402553+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":144,"num_read_kb":129,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608809+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:00:53.608809+0000","last_peered":"2024-09-11T00:00:53.608809+0000","last_clean":"2024-09-11T00:00:53.608809+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:00:53.608809+0000","last_undegraded":"2024-09-11T00:00:53.608809+0000","last_fullsized":"2024-09-11T00:00:53.608809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607445+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:00:53.607445+0000","last_peered":"2024-09-11T00:00:53.607445+0000","last_clean":"2024-09-11T00:00:53.607445+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:00:53.607445+0000","last_undegraded":"2024-09-11T00:00:53.607445+0000","last_fullsized":"2024-09-11T00:00:53.607445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.610837+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:00:53.610837+0000","last_peered":"2024-09-11T00:00:53.610837+0000","last_clean":"2024-09-11T00:00:53.610837+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:00:53.610837+0000","last_undegraded":"2024-09-11T00:00:53.610837+0000","last_fullsized":"2024-09-11T00:00:53.610837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:46.403195+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:01:46.403195+0000","last_peered":"2024-09-11T00:01:46.403195+0000","last_clean":"2024-09-11T00:01:46.403195+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:01:46.403195+0000","last_undegraded":"2024-09-11T00:01:46.403195+0000","last_fullsized":"2024-09-11T00:01:46.403195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607094+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:00:53.607094+0000","last_peered":"2024-09-11T00:00:53.607094+0000","last_clean":"2024-09-11T00:00:53.607094+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:00:53.607094+0000","last_undegraded":"2024-09-11T00:00:53.607094+0000","last_fullsized":"2024-09-11T00:00:53.607094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.699247+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:00:53.699247+0000","last_peered":"2024-09-11T00:00:53.699247+0000","last_clean":"2024-09-11T00:00:53.699247+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:00:53.699247+0000","last_undegraded":"2024-09-11T00:00:53.699247+0000","last_fullsized":"2024-09-11T00:00:53.699247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608145+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:00:53.608145+0000","last_peered":"2024-09-11T00:00:53.608145+0000","last_clean":"2024-09-11T00:00:53.608145+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:00:53.608145+0000","last_undegraded":"2024-09-11T00:00:53.608145+0000","last_fullsized":"2024-09-11T00:00:53.608145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607541+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:00:53.607541+0000","last_peered":"2024-09-11T00:00:53.607541+0000","last_clean":"2024-09-11T00:00:53.607541+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:00:53.607541+0000","last_undegraded":"2024-09-11T00:00:53.607541+0000","last_fullsized":"2024-09-11T00:00:53.607541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607290+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:00:53.607290+0000","last_peered":"2024-09-11T00:00:53.607290+0000","last_clean":"2024-09-11T00:00:53.607290+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:00:53.607290+0000","last_undegraded":"2024-09-11T00:00:53.607290+0000","last_fullsized":"2024-09-11T00:00:53.607290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607628+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:00:53.607628+0000","last_peered":"2024-09-11T00:00:53.607628+0000","last_clean":"2024-09-11T00:00:53.607628+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:00:53.607628+0000","last_undegraded":"2024-09-11T00:00:53.607628+0000","last_fullsized":"2024-09-11T00:00:53.607628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607354+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607354+0000","last_peered":"2024-09-11T00:00:53.607354+0000","last_clean":"2024-09-11T00:00:53.607354+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607354+0000","last_undegraded":"2024-09-11T00:00:53.607354+0000","last_fullsized":"2024-09-11T00:00:53.607354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605463+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605463+0000","last_peered":"2024-09-11T00:00:53.605463+0000","last_clean":"2024-09-11T00:00:53.605463+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605463+0000","last_undegraded":"2024-09-11T00:00:53.605463+0000","last_fullsized":"2024-09-11T00:00:53.605463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697601+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:00:53.697601+0000","last_peered":"2024-09-11T00:00:53.697601+0000","last_clean":"2024-09-11T00:00:53.697601+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:00:53.697601+0000","last_undegraded":"2024-09-11T00:00:53.697601+0000","last_fullsized":"2024-09-11T00:00:53.697601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607224+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607224+0000","last_peered":"2024-09-11T00:00:53.607224+0000","last_clean":"2024-09-11T00:00:53.607224+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607224+0000","last_undegraded":"2024-09-11T00:00:53.607224+0000","last_fullsized":"2024-09-11T00:00:53.607224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607136+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:00:53.607136+0000","last_peered":"2024-09-11T00:00:53.607136+0000","last_clean":"2024-09-11T00:00:53.607136+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:00:53.607136+0000","last_undegraded":"2024-09-11T00:00:53.607136+0000","last_fullsized":"2024-09-11T00:00:53.607136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":93,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:43.398849+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:01:43.398849+0000","last_peered":"2024-09-11T00:01:43.398849+0000","last_clean":"2024-09-11T00:01:43.398849+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:01:43.398849+0000","last_undegraded":"2024-09-11T00:01:43.398849+0000","last_fullsized":"2024-09-11T00:01:43.398849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612423+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:00:53.612423+0000","last_peered":"2024-09-11T00:00:53.612423+0000","last_clean":"2024-09-11T00:00:53.612423+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:00:53.612423+0000","last_undegraded":"2024-09-11T00:00:53.612423+0000","last_fullsized":"2024-09-11T00:00:53.612423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607808+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607808+0000","last_peered":"2024-09-11T00:00:53.607808+0000","last_clean":"2024-09-11T00:00:53.607808+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607808+0000","last_undegraded":"2024-09-11T00:00:53.607808+0000","last_fullsized":"2024-09-11T00:00:53.607808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697889+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:00:53.697889+0000","last_peered":"2024-09-11T00:00:53.697889+0000","last_clean":"2024-09-11T00:00:53.697889+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:00:53.697889+0000","last_undegraded":"2024-09-11T00:00:53.697889+0000","last_fullsized":"2024-09-11T00:00:53.697889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.611825+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.611825+0000","last_peered":"2024-09-11T00:00:53.611825+0000","last_clean":"2024-09-11T00:00:53.611825+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.611825+0000","last_undegraded":"2024-09-11T00:00:53.611825+0000","last_fullsized":"2024-09-11T00:00:53.611825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697988+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:00:53.697988+0000","last_peered":"2024-09-11T00:00:53.697988+0000","last_clean":"2024-09-11T00:00:53.697988+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:00:53.697988+0000","last_undegraded":"2024-09-11T00:00:53.697988+0000","last_fullsized":"2024-09-11T00:00:53.697988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607608+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:00:53.607608+0000","last_peered":"2024-09-11T00:00:53.607608+0000","last_clean":"2024-09-11T00:00:53.607608+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:00:53.607608+0000","last_undegraded":"2024-09-11T00:00:53.607608+0000","last_fullsized":"2024-09-11T00:00:53.607608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:54.250572+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:00:54.250572+0000","last_peered":"2024-09-11T00:00:54.250572+0000","last_clean":"2024-09-11T00:00:54.250572+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:00:54.250572+0000","last_undegraded":"2024-09-11T00:00:54.250572+0000","last_fullsized":"2024-09-11T00:00:54.250572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697866+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:00:53.697866+0000","last_peered":"2024-09-11T00:00:53.697866+0000","last_clean":"2024-09-11T00:00:53.697866+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:00:53.697866+0000","last_undegraded":"2024-09-11T00:00:53.697866+0000","last_fullsized":"2024-09-11T00:00:53.697866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607896+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:00:53.607896+0000","last_peered":"2024-09-11T00:00:53.607896+0000","last_clean":"2024-09-11T00:00:53.607896+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:00:53.607896+0000","last_undegraded":"2024-09-11T00:00:53.607896+0000","last_fullsized":"2024-09-11T00:00:53.607896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607559+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:00:53.607559+0000","last_peered":"2024-09-11T00:00:53.607559+0000","last_clean":"2024-09-11T00:00:53.607559+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:00:53.607559+0000","last_undegraded":"2024-09-11T00:00:53.607559+0000","last_fullsized":"2024-09-11T00:00:53.607559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607830+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:00:53.607830+0000","last_peered":"2024-09-11T00:00:53.607830+0000","last_clean":"2024-09-11T00:00:53.607830+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:00:53.607830+0000","last_undegraded":"2024-09-11T00:00:53.607830+0000","last_fullsized":"2024-09-11T00:00:53.607830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697657+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:00:53.697657+0000","last_peered":"2024-09-11T00:00:53.697657+0000","last_clean":"2024-09-11T00:00:53.697657+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:00:53.697657+0000","last_undegraded":"2024-09-11T00:00:53.697657+0000","last_fullsized":"2024-09-11T00:00:53.697657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607530+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:00:53.607530+0000","last_peered":"2024-09-11T00:00:53.607530+0000","last_clean":"2024-09-11T00:00:53.607530+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:00:53.607530+0000","last_undegraded":"2024-09-11T00:00:53.607530+0000","last_fullsized":"2024-09-11T00:00:53.607530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609349+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:00:53.609349+0000","last_peered":"2024-09-11T00:00:53.609349+0000","last_clean":"2024-09-11T00:00:53.609349+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:00:53.609349+0000","last_undegraded":"2024-09-11T00:00:53.609349+0000","last_fullsized":"2024-09-11T00:00:53.609349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697588+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:00:53.697588+0000","last_peered":"2024-09-11T00:00:53.697588+0000","last_clean":"2024-09-11T00:00:53.697588+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:00:53.697588+0000","last_undegraded":"2024-09-11T00:00:53.697588+0000","last_fullsized":"2024-09-11T00:00:53.697588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608277+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:00:53.608277+0000","last_peered":"2024-09-11T00:00:53.608277+0000","last_clean":"2024-09-11T00:00:53.608277+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:00:53.608277+0000","last_undegraded":"2024-09-11T00:00:53.608277+0000","last_fullsized":"2024-09-11T00:00:53.608277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697953+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697953+0000","last_peered":"2024-09-11T00:00:53.697953+0000","last_clean":"2024-09-11T00:00:53.697953+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697953+0000","last_undegraded":"2024-09-11T00:00:53.697953+0000","last_fullsized":"2024-09-11T00:00:53.697953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697819+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:00:53.697819+0000","last_peered":"2024-09-11T00:00:53.697819+0000","last_clean":"2024-09-11T00:00:53.697819+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:00:53.697819+0000","last_undegraded":"2024-09-11T00:00:53.697819+0000","last_fullsized":"2024-09-11T00:00:53.697819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604729+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604729+0000","last_peered":"2024-09-11T00:00:53.604729+0000","last_clean":"2024-09-11T00:00:53.604729+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604729+0000","last_undegraded":"2024-09-11T00:00:53.604729+0000","last_fullsized":"2024-09-11T00:00:53.604729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63210,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":433,"num_read_kb":280,"num_write":159,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710750,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906979,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1073127,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070504,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266732,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462962,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":1014132,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822716,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":1013425,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":423081,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149765,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378700,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":481441,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542224,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":480673,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:01:49.655 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T00:01:49.655 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T00:01:49.655 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T00:01:49.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T00:01:49.925 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:50.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:49 smithi019 ceph-mon[30859]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:50.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:49 smithi019 ceph-mon[30859]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:50.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:49 smithi131 ceph-mon[35491]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:50.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:49 smithi131 ceph-mon[35491]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:50.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:49 smithi135 ceph-mon[35432]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:01:50.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:49 smithi135 ceph-mon[35432]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 -- 172.21.15.19:0/1618700015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c1076e0 msgr2=0x7f2e8c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1618700015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c1076e0 0x7f2e8c107b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009900 tx=0x7f2e7402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 -- 172.21.15.19:0/1618700015 shutdown_connections 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1618700015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c108060 0x7f2e8c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1618700015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c1076e0 0x7f2e8c107b20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1618700015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e8c101cd0 0x7f2e8c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 -- 172.21.15.19:0/1618700015 >> 172.21.15.19:0/1618700015 conn(0x7f2e8c0fd700 msgr2=0x7f2e8c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 -- 172.21.15.19:0/1618700015 shutdown_connections 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.426+0000 7f2e9223a640 1 -- 172.21.15.19:0/1618700015 wait complete. 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 Processor -- start 2024-09-11T00:01:50.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 -- start start 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e8c101cd0 0x7f2e8c19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c1076e0 0x7f2e8c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c108060 0x7f2e8c1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c111ce0 con 0x7f2e8c108060 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c111b60 con 0x7f2e8c101cd0 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e9223a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c111e60 con 0x7f2e8c1076e0 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c108060 0x7f2e8c1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c108060 0x7f2e8c1a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50030/0 (socket says 172.21.15.19:50030) 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e8bfff640 1 -- 172.21.15.19:0/1846770396 learned_addr learned my addr 172.21.15.19:0/1846770396 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e82ffd640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c1076e0 0x7f2e8c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.427+0000 7f2e8b7fe640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e8c101cd0 0x7f2e8c19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e8bfff640 1 -- 172.21.15.19:0/1846770396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c1076e0 msgr2=0x7f2e8c19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:50.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e8bfff640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c1076e0 0x7f2e8c19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e8bfff640 1 -- 172.21.15.19:0/1846770396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e8c101cd0 msgr2=0x7f2e8c19b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e8bfff640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e8c101cd0 0x7f2e8c19b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e8bfff640 1 -- 172.21.15.19:0/1846770396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c1a1510 con 0x7f2e8c108060 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e8bfff640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c108060 0x7f2e8c1a0d40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400eaa0 tx=0x7f2e8400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e897fa640 1 -- 172.21.15.19:0/1846770396 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84004d20 con 0x7f2e8c108060 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c1a1800 con 0x7f2e8c108060 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e897fa640 1 -- 172.21.15.19:0/1846770396 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e84005020 con 0x7f2e8c108060 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e897fa640 1 -- 172.21.15.19:0/1846770396 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e840116d0 con 0x7f2e8c108060 2024-09-11T00:01:50.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.428+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c1a7ec0 con 0x7f2e8c108060 2024-09-11T00:01:50.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.429+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c1020b0 con 0x7f2e8c108060 2024-09-11T00:01:50.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.431+0000 7f2e897fa640 1 -- 172.21.15.19:0/1846770396 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f2e8400f040 con 0x7f2e8c108060 2024-09-11T00:01:50.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.431+0000 7f2e897fa640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e780b53c0 0x7f2e780b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:50.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.432+0000 7f2e8b7fe640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e780b53c0 0x7f2e780b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:50.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.432+0000 7f2e897fa640 1 -- 172.21.15.19:0/1846770396 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2e840e5fc0 con 0x7f2e8c108060 2024-09-11T00:01:50.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.432+0000 7f2e8b7fe640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e780b53c0 0x7f2e780b7880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00abe0 tx=0x7f2e7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:50.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.434+0000 7f2e897fa640 1 -- 172.21.15.19:0/1846770396 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2e84016030 con 0x7f2e8c108060 2024-09-11T00:01:50.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.662+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e8c1a8210 con 0x7f2e8c108060 2024-09-11T00:01:50.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.662+0000 7f2e897fa640 1 -- 172.21.15.19:0/1846770396 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2e840acc80 con 0x7f2e8c108060 2024-09-11T00:01:50.664 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:50.664 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T00:01:50.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e780b53c0 msgr2=0x7f2e780b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:50.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e780b53c0 0x7f2e780b7880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00abe0 tx=0x7f2e7c00a2d0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c108060 msgr2=0x7f2e8c1a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:50.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c108060 0x7f2e8c1a0d40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400eaa0 tx=0x7f2e8400eea0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 shutdown_connections 2024-09-11T00:01:50.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2e780b53c0 0x7f2e780b7880 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e8c108060 0x7f2e8c1a0d40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e8c1076e0 0x7f2e8c19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 --2- 172.21.15.19:0/1846770396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e8c101cd0 0x7f2e8c19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:50.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 >> 172.21.15.19:0/1846770396 conn(0x7f2e8c0fd700 msgr2=0x7f2e8c104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:50.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 shutdown_connections 2024-09-11T00:01:50.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:50.665+0000 7f2e9223a640 1 -- 172.21.15.19:0/1846770396 wait complete. 2024-09-11T00:01:51.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:51 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1846770396' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T00:01:51.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:51 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1846770396' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T00:01:51.380 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T00:01:51.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:01:51.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:51 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1846770396' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T00:01:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:52.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:52 smithi019 ceph-mon[30859]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 -- 172.21.15.19:0/3387409519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28481087b0 msgr2=0x7f2848108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 --2- 172.21.15.19:0/3387409519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28481087b0 0x7f2848108bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2830009900 tx=0x7f283002a3f0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 -- 172.21.15.19:0/3387409519 shutdown_connections 2024-09-11T00:01:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 --2- 172.21.15.19:0/3387409519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2848109130 0x7f284810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 --2- 172.21.15.19:0/3387409519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28481087b0 0x7f2848108bf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 --2- 172.21.15.19:0/3387409519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2848102da0 0x7f2848103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 -- 172.21.15.19:0/3387409519 >> 172.21.15.19:0/3387409519 conn(0x7f28480fe850 msgr2=0x7f2848100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 -- 172.21.15.19:0/3387409519 shutdown_connections 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 -- 172.21.15.19:0/3387409519 wait complete. 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.160+0000 7f284c9a0640 1 Processor -- start 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284c9a0640 1 -- start start 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284c9a0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2848102da0 0x7f28480754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284c9a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28481087b0 0x7f28480759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284c9a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2848109130 0x7f2848075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284c9a0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112e40 con 0x7f2848109130 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284c9a0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112cc0 con 0x7f2848102da0 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284c9a0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112fc0 con 0x7f28481087b0 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2848109130 0x7f2848075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2848109130 0x7f2848075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54198/0 (socket says 172.21.15.19:54198) 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 -- 172.21.15.19:0/2489313762 learned_addr learned my addr 172.21.15.19:0/2489313762 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f283ffff640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28481087b0 0x7f28480759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f284659c640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2848102da0 0x7f28480754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 -- 172.21.15.19:0/2489313762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28481087b0 msgr2=0x7f28480759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28481087b0 0x7f28480759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 -- 172.21.15.19:0/2489313762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2848102da0 msgr2=0x7f28480754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2848102da0 0x7f28480754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 -- 172.21.15.19:0/2489313762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28481a76b0 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.161+0000 7f2846d9d640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2848109130 0x7f2848075f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f284000b970 tx=0x7f284000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.162+0000 7f283f7fe640 1 -- 172.21.15.19:0/2489313762 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840019070 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.162+0000 7f283f7fe640 1 -- 172.21.15.19:0/2489313762 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2840014440 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.162+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28481a79a0 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.162+0000 7f283f7fe640 1 -- 172.21.15.19:0/2489313762 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28400075d0 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.162+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28481a7f30 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.163+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2848103180 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.164+0000 7f283f7fe640 1 -- 172.21.15.19:0/2489313762 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f284000cb40 con 0x7f2848109130 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.165+0000 7f283f7fe640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f28340b5440 0x7f28340b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.165+0000 7f284659c640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f28340b5440 0x7f28340b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.165+0000 7f283f7fe640 1 -- 172.21.15.19:0/2489313762 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f28400e55a0 con 0x7f2848109130 2024-09-11T00:01:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.166+0000 7f284659c640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f28340b5440 0x7f28340b7900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2838005e10 tx=0x7f2838005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.169+0000 7f283f7fe640 1 -- 172.21.15.19:0/2489313762 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28400abc10 con 0x7f2848109130 2024-09-11T00:01:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:52 smithi131 ceph-mon[35491]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.395+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f284802e5c0 con 0x7f2848109130 2024-09-11T00:01:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.396+0000 7f283f7fe640 1 -- 172.21.15.19:0/2489313762 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7f28400b0640 con 0x7f2848109130 2024-09-11T00:01:52.399 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:52.399 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-11T00:00:41:297551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:00:40.994067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:01:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f28340b5440 msgr2=0x7f28340b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f28340b5440 0x7f28340b7900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2838005e10 tx=0x7f2838005da0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2848109130 msgr2=0x7f2848075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2848109130 0x7f2848075f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f284000b970 tx=0x7f284000be30 comp rx=0 tx=0).stop 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 shutdown_connections 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f28340b5440 0x7f28340b7900 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2848109130 0x7f2848075f20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28481087b0 0x7f28480759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 --2- 172.21.15.19:0/2489313762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2848102da0 0x7f28480754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 >> 172.21.15.19:0/2489313762 conn(0x7f28480fe850 msgr2=0x7f2848100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 shutdown_connections 2024-09-11T00:01:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:52.398+0000 7f284c9a0640 1 -- 172.21.15.19:0/2489313762 wait complete. 2024-09-11T00:01:52.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:52 smithi135 ceph-mon[35432]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:01:53.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:53 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2489313762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:53.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:01:53.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:53 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2489313762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:53.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:53 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2489313762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 -- 172.21.15.19:0/2667130997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 msgr2=0x7f3e2410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/2667130997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e2410f5a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009ca0 tx=0x7f3e1c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 -- 172.21.15.19:0/2667130997 shutdown_connections 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/2667130997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e2410f5a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/2667130997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e24104600 0x7f3e2410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/2667130997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e24103ce0 0x7f3e241040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 -- 172.21.15.19:0/2667130997 >> 172.21.15.19:0/2667130997 conn(0x7f3e240fd700 msgr2=0x7f3e240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 -- 172.21.15.19:0/2667130997 shutdown_connections 2024-09-11T00:01:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.835+0000 7f3e2ac53640 1 -- 172.21.15.19:0/2667130997 wait complete. 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 Processor -- start 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 -- start start 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e24103ce0 0x7f3e24101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e24104600 0x7f3e24101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e24102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e24112ee0 con 0x7f3e2410d140 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3e24112d60 con 0x7f3e24104600 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e2ac53640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e24113060 con 0x7f3e24103ce0 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e24102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e24102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54220/0 (socket says 172.21.15.19:54220) 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 -- 172.21.15.19:0/75823244 learned_addr learned my addr 172.21.15.19:0/75823244 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e289ef640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e24103ce0 0x7f3e24101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e23fff640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e24104600 0x7f3e24101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 -- 172.21.15.19:0/75823244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e24103ce0 msgr2=0x7f3e24101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e24103ce0 0x7f3e24101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 -- 172.21.15.19:0/75823244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e24104600 msgr2=0x7f3e24101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e24104600 0x7f3e24101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.836+0000 7f3e291f0640 1 -- 172.21.15.19:0/75823244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e241a77f0 con 0x7f3e2410d140 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.837+0000 7f3e291f0640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e24102410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c031a20 tx=0x7f3e1c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.837+0000 7f3e21ffb640 1 -- 172.21.15.19:0/75823244 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003c70 con 0x7f3e2410d140 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.837+0000 7f3e21ffb640 1 -- 172.21.15.19:0/75823244 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c003e10 con 0x7f3e2410d140 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.837+0000 7f3e21ffb640 1 -- 172.21.15.19:0/75823244 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c02fcb0 con 0x7f3e2410d140 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.837+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e241a7a80 con 0x7f3e2410d140 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.837+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e241a8040 con 0x7f3e2410d140 2024-09-11T00:01:53.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.838+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e24104140 con 0x7f3e2410d140 2024-09-11T00:01:53.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.839+0000 7f3e21ffb640 1 -- 172.21.15.19:0/75823244 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f3e1c004040 con 0x7f3e2410d140 2024-09-11T00:01:53.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.840+0000 7f3e21ffb640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e0c0b53c0 0x7f3e0c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.840+0000 7f3e289ef640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e0c0b53c0 0x7f3e0c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.840+0000 7f3e21ffb640 1 -- 172.21.15.19:0/75823244 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f3e1c107290 con 0x7f3e2410d140 2024-09-11T00:01:53.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.841+0000 7f3e289ef640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e0c0b53c0 0x7f3e0c0b7880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009990 tx=0x7f3e14009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:53.844+0000 7f3e21ffb640 1 -- 172.21.15.19:0/75823244 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e1c0cdfe0 con 0x7f3e2410d140 2024-09-11T00:01:54.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.065+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e2402e5c0 con 0x7f3e2410d140 2024-09-11T00:01:54.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.066+0000 7f3e21ffb640 1 -- 172.21.15.19:0/75823244 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7f3e1c0cd8e0 con 0x7f3e2410d140 2024-09-11T00:01:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:54.069 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-11T00:00:41:297551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:00:40.994067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:01:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-11T00:01:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e0c0b53c0 msgr2=0x7f3e0c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e0c0b53c0 0x7f3e0c0b7880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009990 tx=0x7f3e14009110 comp rx=0 tx=0).stop 2024-09-11T00:01:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 msgr2=0x7f3e24102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e24102410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c031a20 tx=0x7f3e1c031a50 comp rx=0 tx=0).stop 2024-09-11T00:01:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 shutdown_connections 2024-09-11T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3e0c0b53c0 0x7f3e0c0b7880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2410d140 0x7f3e24102410 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e24104600 0x7f3e24101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 --2- 172.21.15.19:0/75823244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e24103ce0 0x7f3e24101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 >> 172.21.15.19:0/75823244 conn(0x7f3e240fd700 msgr2=0x7f3e240fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 shutdown_connections 2024-09-11T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:54.068+0000 7f3e2ac53640 1 -- 172.21.15.19:0/75823244 wait complete. 2024-09-11T00:01:54.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:54 smithi019 ceph-mon[30859]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:54 smithi131 ceph-mon[35491]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:54.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:54 smithi135 ceph-mon[35432]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:01:54.780 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:01:55.045 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:55.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:55 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/75823244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:55.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:55 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/75823244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:55.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:55 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/75823244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 -- 172.21.15.19:0/2953755854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 msgr2=0x7f20a81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 --2- 172.21.15.19:0/2953755854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a81020b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009900 tx=0x7f20a402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 -- 172.21.15.19:0/2953755854 shutdown_connections 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 --2- 172.21.15.19:0/2953755854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a8108060 0x7f20a810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 --2- 172.21.15.19:0/2953755854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a81076e0 0x7f20a8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 --2- 172.21.15.19:0/2953755854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a81020b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 -- 172.21.15.19:0/2953755854 >> 172.21.15.19:0/2953755854 conn(0x7f20a80fd720 msgr2=0x7f20a80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 -- 172.21.15.19:0/2953755854 shutdown_connections 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 -- 172.21.15.19:0/2953755854 wait complete. 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.549+0000 7f20af605640 1 Processor -- start 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20af605640 1 -- start start 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20af605640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20af605640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a81076e0 0x7f20a819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20af605640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a8108060 0x7f20a81a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20af605640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8111d20 con 0x7f20a8101cd0 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20af605640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8111ba0 con 0x7f20a8108060 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20af605640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8111ea0 con 0x7f20a81076e0 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54240/0 (socket says 172.21.15.19:54240) 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 -- 172.21.15.19:0/3178962058 learned_addr learned my addr 172.21.15.19:0/3178962058 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20acba0640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a81076e0 0x7f20a819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20adba2640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a8108060 0x7f20a81a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 -- 172.21.15.19:0/3178962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a81076e0 msgr2=0x7f20a819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a81076e0 0x7f20a819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 -- 172.21.15.19:0/3178962058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a8108060 msgr2=0x7f20a81a5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a8108060 0x7f20a81a5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 -- 172.21.15.19:0/3178962058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a81a5680 con 0x7f20a8101cd0 2024-09-11T00:01:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.550+0000 7f20ad3a1640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a819a0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20a4006010 tx=0x7f20a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.551+0000 7f209e7fc640 1 -- 172.21.15.19:0/3178962058 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a403f030 con 0x7f20a8101cd0 2024-09-11T00:01:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.551+0000 7f209e7fc640 1 -- 172.21.15.19:0/3178962058 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20a4003800 con 0x7f20a8101cd0 2024-09-11T00:01:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.551+0000 7f209e7fc640 1 -- 172.21.15.19:0/3178962058 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4035070 con 0x7f20a8101cd0 2024-09-11T00:01:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.551+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a81a5850 con 0x7f20a8101cd0 2024-09-11T00:01:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.551+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a81a5c50 con 0x7f20a8101cd0 2024-09-11T00:01:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.552+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a81020b0 con 0x7f20a8101cd0 2024-09-11T00:01:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.553+0000 7f209e7fc640 1 -- 172.21.15.19:0/3178962058 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f20a4031b10 con 0x7f20a8101cd0 2024-09-11T00:01:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.554+0000 7f209e7fc640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20940b53b0 0x7f20940b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.554+0000 7f20acba0640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20940b53b0 0x7f20940b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.554+0000 7f209e7fc640 1 -- 172.21.15.19:0/3178962058 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f20a41065b0 con 0x7f20a8101cd0 2024-09-11T00:01:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.554+0000 7f20acba0640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20940b53b0 0x7f20940b7870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f20a806c0f0 tx=0x7f209800a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.558+0000 7f209e7fc640 1 -- 172.21.15.19:0/3178962058 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f20a40cd3d0 con 0x7f20a8101cd0 2024-09-11T00:01:55.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.744+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20a802e5c0 con 0x7f20a8101cd0 2024-09-11T00:01:55.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.746+0000 7f209e7fc640 1 -- 172.21.15.19:0/3178962058 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22967 (secure 0 0 0) 0x7f20a40cccd0 con 0x7f20a8101cd0 2024-09-11T00:01:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:55.749 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:53.600623+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:01:55.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20940b53b0 msgr2=0x7f20940b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:55.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20940b53b0 0x7f20940b7870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f20a806c0f0 tx=0x7f209800a250 comp rx=0 tx=0).stop 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 msgr2=0x7f20a819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a819a0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20a4006010 tx=0x7f20a40042f0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 shutdown_connections 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a8108060 0x7f20a81a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20a81076e0 0x7f20a819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20940b53b0 0x7f20940b7870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 --2- 172.21.15.19:0/3178962058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8101cd0 0x7f20a819a0c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 >> 172.21.15.19:0/3178962058 conn(0x7f20a80fd720 msgr2=0x7f20a80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 shutdown_connections 2024-09-11T00:01:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:55.748+0000 7f20af605640 1 -- 172.21.15.19:0/3178962058 wait complete. 2024-09-11T00:01:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:56 smithi019 ceph-mon[30859]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:01:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:56 smithi019 ceph-mon[30859]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-11T00:01:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:56 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3178962058' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:56 smithi131 ceph-mon[35491]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:01:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:56 smithi131 ceph-mon[35491]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-11T00:01:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:56 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3178962058' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:56 smithi135 ceph-mon[35432]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:01:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:56 smithi135 ceph-mon[35432]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-11T00:01:56.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:56 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3178962058' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:01:56.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:01:56.733 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 -- 172.21.15.19:0/2390096339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28103ce0 msgr2=0x7f2f281040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 --2- 172.21.15.19:0/2390096339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28103ce0 0x7f2f281040c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009900 tx=0x7f2f2402a410 comp rx=0 tx=0).stop 2024-09-11T00:01:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 -- 172.21.15.19:0/2390096339 shutdown_connections 2024-09-11T00:01:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 --2- 172.21.15.19:0/2390096339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f2810d140 0x7f2f2810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 --2- 172.21.15.19:0/2390096339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f28104600 0x7f2f2810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 --2- 172.21.15.19:0/2390096339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28103ce0 0x7f2f281040c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 -- 172.21.15.19:0/2390096339 >> 172.21.15.19:0/2390096339 conn(0x7f2f280fd700 msgr2=0x7f2f280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 -- 172.21.15.19:0/2390096339 shutdown_connections 2024-09-11T00:01:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.223+0000 7f2f30388640 1 -- 172.21.15.19:0/2390096339 wait complete. 2024-09-11T00:01:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 Processor -- start 2024-09-11T00:01:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 -- start start 2024-09-11T00:01:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f28103ce0 0x7f2f281992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f28104600 0x7f2f28199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f2810d140 0x7f2f2819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112db0 con 0x7f2f2810d140 2024-09-11T00:01:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112c30 con 0x7f2f28103ce0 2024-09-11T00:01:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f30388640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112f30 con 0x7f2f28104600 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e925640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f2810d140 0x7f2f2819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e925640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f2810d140 0x7f2f2819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54262/0 (socket says 172.21.15.19:54262) 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e925640 1 -- 172.21.15.19:0/3712547934 learned_addr learned my addr 172.21.15.19:0/3712547934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e124640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f28103ce0 0x7f2f281992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2d923640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f28104600 0x7f2f28199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e925640 1 -- 172.21.15.19:0/3712547934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f28104600 msgr2=0x7f2f28199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e925640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f28104600 0x7f2f28199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e925640 1 -- 172.21.15.19:0/3712547934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f28103ce0 msgr2=0x7f2f281992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.224+0000 7f2f2e925640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f28103ce0 0x7f2f281992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f2e925640 1 -- 172.21.15.19:0/3712547934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2819f370 con 0x7f2f2810d140 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f2d923640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f28104600 0x7f2f28199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f2e925640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f2810d140 0x7f2f2819eba0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000eaa0 tx=0x7f2f2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f1f7fe640 1 -- 172.21.15.19:0/3712547934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000cdb0 con 0x7f2f2810d140 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2819f660 con 0x7f2f2810d140 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f1f7fe640 1 -- 172.21.15.19:0/3712547934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f20005020 con 0x7f2f2810d140 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f1f7fe640 1 -- 172.21.15.19:0/3712547934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f200116d0 con 0x7f2f2810d140 2024-09-11T00:01:57.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.225+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f281a5d20 con 0x7f2f2810d140 2024-09-11T00:01:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.226+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f281040c0 con 0x7f2f2810d140 2024-09-11T00:01:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.227+0000 7f2f1f7fe640 1 -- 172.21.15.19:0/3712547934 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f2f2000f040 con 0x7f2f2810d140 2024-09-11T00:01:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.228+0000 7f2f1f7fe640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2f140b5330 0x7f2f140b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.228+0000 7f2f2e124640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2f140b5330 0x7f2f140b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.228+0000 7f2f1f7fe640 1 -- 172.21.15.19:0/3712547934 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2f200e5fb0 con 0x7f2f2810d140 2024-09-11T00:01:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.229+0000 7f2f2e124640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2f140b5330 0x7f2f140b77f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f24031440 tx=0x7f2f24005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.231+0000 7f2f1f7fe640 1 -- 172.21.15.19:0/3712547934 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2f20016030 con 0x7f2f2810d140 2024-09-11T00:01:57.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.454+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f2819a3f0 con 0x7f2f2810d140 2024-09-11T00:01:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.455+0000 7f2f1f7fe640 1 -- 172.21.15.19:0/3712547934 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7f2f200acd70 con 0x7f2f2810d140 2024-09-11T00:01:57.457 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:01:57.457 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-11T00:00:41:297551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:00:40.994067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:01:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-11T00:01:57.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2f140b5330 msgr2=0x7f2f140b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2f140b5330 0x7f2f140b77f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f24031440 tx=0x7f2f24005b50 comp rx=0 tx=0).stop 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f2810d140 msgr2=0x7f2f2819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f2810d140 0x7f2f2819eba0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000eaa0 tx=0x7f2f2000ef60 comp rx=0 tx=0).stop 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 shutdown_connections 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2f140b5330 0x7f2f140b77f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f2810d140 0x7f2f2819eba0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f28104600 0x7f2f28199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 --2- 172.21.15.19:0/3712547934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f28103ce0 0x7f2f281992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 >> 172.21.15.19:0/3712547934 conn(0x7f2f280fd700 msgr2=0x7f2f280fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 shutdown_connections 2024-09-11T00:01:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:57.457+0000 7f2f30388640 1 -- 172.21.15.19:0/3712547934 wait complete. 2024-09-11T00:01:58.114 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T00:00:28.916347+0000', 'modified': '2024-09-11T00:00:40.994067+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24625, 'mds_1': 24605, 'mds_2': 24604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24565': {'gid': 24565, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/324976573', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 324976573}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 324976573}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6837/3685381952', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 3685381952}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 3685381952}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24598': {'gid': 24598, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/3910864085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3910864085}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3910864085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24604': {'gid': 24604, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.135:6837/3873679773', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 3873679773}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 3873679773}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24605': {'gid': 24605, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6839/3500650127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6838', 'nonce': 3500650127}, {'type': 'v1', 'addr': '172.21.15.131:6839', 'nonce': 3500650127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.135:6839/2927257252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2927257252}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2927257252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24625, 'qdb_cluster': [24604, 24605, 24625]} 2024-09-11T00:01:58.114 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T00:01:58.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T00:01:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:58 smithi131 ceph-mon[35491]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T00:01:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:01:58 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3712547934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:58.372 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:58 smithi135 ceph-mon[35432]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T00:01:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:01:58 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3712547934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:58.493 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:58 smithi019 ceph-mon[30859]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T00:01:58.493 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:01:58 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3712547934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 -- 172.21.15.19:0/4126937290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c1076a0 msgr2=0x7fbd5c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 --2- 172.21.15.19:0/4126937290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c1076a0 0x7fbd5c107ae0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009900 tx=0x7fbd5002a410 comp rx=0 tx=0).stop 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 -- 172.21.15.19:0/4126937290 shutdown_connections 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 --2- 172.21.15.19:0/4126937290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c108020 0x7fbd5c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 --2- 172.21.15.19:0/4126937290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c1076a0 0x7fbd5c107ae0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 --2- 172.21.15.19:0/4126937290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd5c101c90 0x7fbd5c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 -- 172.21.15.19:0/4126937290 >> 172.21.15.19:0/4126937290 conn(0x7fbd5c0fd700 msgr2=0x7fbd5c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 -- 172.21.15.19:0/4126937290 shutdown_connections 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 -- 172.21.15.19:0/4126937290 wait complete. 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 Processor -- start 2024-09-11T00:01:58.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.884+0000 7fbd626d6640 1 -- start start 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd626d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c101c90 0x7fbd5c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd626d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd5c1076a0 0x7fbd5c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd626d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c108020 0x7fbd5c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd626d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c112dc0 con 0x7fbd5c101c90 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd626d6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c112c40 con 0x7fbd5c1076a0 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd626d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c112f40 con 0x7fbd5c108020 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c101c90 0x7fbd5c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c101c90 0x7fbd5c199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54278/0 (socket says 172.21.15.19:54278) 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 -- 172.21.15.19:0/3941696162 learned_addr learned my addr 172.21.15.19:0/3941696162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5b7fe640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd5c1076a0 0x7fbd5c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd60c73640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c108020 0x7fbd5c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 -- 172.21.15.19:0/3941696162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c108020 msgr2=0x7fbd5c19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c108020 0x7fbd5c19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 -- 172.21.15.19:0/3941696162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd5c1076a0 msgr2=0x7fbd5c1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd5c1076a0 0x7fbd5c1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 -- 172.21.15.19:0/3941696162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c19f320 con 0x7fbd5c101c90 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5b7fe640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd5c1076a0 0x7fbd5c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c101c90 0x7fbd5c199270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c890 tx=0x7fbd4c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd597fa640 1 -- 172.21.15.19:0/3941696162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c004220 con 0x7fbd5c101c90 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.885+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c19f610 con 0x7fbd5c101c90 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.886+0000 7fbd597fa640 1 -- 172.21.15.19:0/3941696162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd4c0043c0 con 0x7fbd5c101c90 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.886+0000 7fbd597fa640 1 -- 172.21.15.19:0/3941696162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c004a00 con 0x7fbd5c101c90 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.886+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c1a5ea0 con 0x7fbd5c101c90 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd597fa640 1 -- 172.21.15.19:0/3941696162 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fbd4c0079b0 con 0x7fbd5c101c90 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 Processor -- start 2024-09-11T00:01:58.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 -- start start 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08ed30 0x563fcd08f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd08f650 0x563fcd09f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd09f9f0 0x563fcd0a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563fcd006c10 con 0x563fcd08f650 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563fccff6040 con 0x563fcd09f9f0 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.888+0000 7fbd64aab740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563fccff9e50 con 0x563fcd08ed30 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd08f650 0x563fcd09f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd08f650 0x563fcd09f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54286/0 (socket says 172.21.15.19:54286) 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 -- 172.21.15.19:0/2601399392 learned_addr learned my addr 172.21.15.19:0/2601399392 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5b7fe640 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd09f9f0 0x563fcd0a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd60c73640 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08ed30 0x563fcd08f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd597fa640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbd440b5330 0x7fbd440b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 -- 172.21.15.19:0/2601399392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08ed30 msgr2=0x563fcd08f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08ed30 0x563fcd08f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 -- 172.21.15.19:0/2601399392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd09f9f0 msgr2=0x563fcd0a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd09f9f0 0x563fcd0a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 -- 172.21.15.19:0/2601399392 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fccd54540 con 0x563fcd08f650 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd60c73640 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08ed30 0x563fcd08f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5b7fe640 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd09f9f0 0x563fcd0a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd60c73640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbd440b5330 0x7fbd440b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd597fa640 1 -- 172.21.15.19:0/3941696162 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fbd4c0e5b80 con 0x7fbd5c101c90 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd08f650 0x563fcd09f4b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0ba2f0 tx=0x7fbd4c0a80e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e224a3901e6691a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.889+0000 7fbd427fc640 1 -- 172.21.15.19:0/2601399392 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c01d070 con 0x563fcd08f650 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd427fc640 1 -- 172.21.15.19:0/2601399392 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd4c0ed040 con 0x563fcd08f650 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd427fc640 1 -- 172.21.15.19:0/2601399392 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0abb90 con 0x563fcd08f650 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 -- 172.21.15.19:0/2601399392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd08f650 msgr2=0x563fcd09f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd60c73640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbd440b5330 0x7fbd440b77f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400be30 tx=0x7fbd54004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd08f650 0x563fcd09f4b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0ba2f0 tx=0x7fbd4c0a80e0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 -- 172.21.15.19:0/2601399392 shutdown_connections 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd09f9f0 0x563fcd0a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd08f650 0x563fcd09f4b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 --2- 172.21.15.19:0/2601399392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08ed30 0x563fcd08f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 -- 172.21.15.19:0/2601399392 >> 172.21.15.19:0/2601399392 conn(0x563fcd08cb60 msgr2=0x563fcd08dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 -- 172.21.15.19:0/2601399392 shutdown_connections 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.890+0000 7fbd64aab740 1 -- 172.21.15.19:0/2601399392 wait complete. 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 -- start start 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 Processor -- start 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563fcce575f0 con 0x563fcd09f9f0 2024-09-11T00:01:58.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563fccf91010 con 0x563fcd08ed30 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563fcd0a26a0 con 0x563fcd08f650 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd64aab740 10 client.0 _ll_register_callbacks cb 0x563fccff0340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd60c73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd60c73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54288/0 (socket says 172.21.15.19:54288) 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd60c73640 1 -- 172.21.15.19:0/1615264203 learned_addr learned my addr 172.21.15.19:0/1615264203 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.891+0000 7fbd5b7fe640 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd60c73640 1 -- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 msgr2=0x563fcd09cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd60c73640 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd60c73640 1 -- 172.21.15.19:0/1615264203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 msgr2=0x563fcd09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd60c73640 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd09ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd60c73640 1 -- 172.21.15.19:0/1615264203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fccfbea00 con 0x563fcd09f9f0 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd60c73640 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09d4a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbd54011e10 tx=0x7fbd54004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a37a42f4d1b89d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:58.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1615264203 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5401c630 con 0x563fcd09f9f0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1615264203 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fbd5401c7d0 con 0x563fcd09f9f0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd4c0ed040 con 0x563fcd09f9f0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1615264203 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd54011e40 con 0x563fcd09f9f0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd64aab740 10 client.15183 fetch_fsmap learned FSMap version 24 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563fcd0ae320 con 0x563fcd09f9f0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.892+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1615264203 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd4c0ed040 con 0x563fcd09f9f0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1615264203 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd5401dab0 con 0x563fcd09f9f0 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd64aab740 10 client.15183 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd64aab740 10 client.15183 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd64aab740 20 client.15183 populate_metadata read hostname 'smithi019' 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd0b0910 0x563fcd0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd64aab740 4 client.15183 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fcd008b60 con 0x563fcd0b0910 2024-09-11T00:01:58.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd0b0910 0x563fcd0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd0b0910 0x563fcd0b1d80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5903eae93c58c5e7 server_cookie=a3755b8fcdc99ad6 in_seq=0 out_seq=0 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.893+0000 7fbd3b7fe640 10 client.15183 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1615264203 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fcd008b60 con 0x563fcd0b0910 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd3b7fe640 10 client.15183 handle_command_reply: tid=0 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 client.15183 shutdown 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 msgr2=0x563fcd09d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09d4a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbd54011e10 tx=0x7fbd54004ab0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 shutdown_connections 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd0b0910 0x563fcd0b1d80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09d4a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1615264203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd3b7fe640 0 client.15183 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.894+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 >> 172.21.15.19:0/1615264203 conn(0x563fcd08cb60 msgr2=0x563fcd08bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:58.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.895+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 shutdown_connections 2024-09-11T00:01:58.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.895+0000 7fbd64aab740 1 -- 172.21.15.19:0/1615264203 wait complete. 2024-09-11T00:01:58.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.895+0000 7fbd64aab740 20 client.15183 trim_cache size 0 max 16384 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 Processor -- start 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 -- start start 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd08c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563fcd0b00c0 con 0x563fcd09f9f0 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563fcd0b0790 con 0x563fcd08ed30 2024-09-11T00:01:58.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd64aab740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563fcd0b0e60 con 0x563fcd08f650 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54300/0 (socket says 172.21.15.19:54300) 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 -- 172.21.15.19:0/4207874057 learned_addr learned my addr 172.21.15.19:0/4207874057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd5b7fe640 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd08c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 -- 172.21.15.19:0/4207874057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 msgr2=0x563fcd09e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 -- 172.21.15.19:0/4207874057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 msgr2=0x563fcd08c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd08c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.913+0000 7fbd60c73640 1 -- 172.21.15.19:0/4207874057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fcd094e90 con 0x563fcd09f9f0 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd60c73640 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09e590 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd54010d50 tx=0x7fbd54011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4939927a209a16f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd41ffb640 1 -- 172.21.15.19:0/4207874057 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5403d070 con 0x563fcd09f9f0 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd41ffb640 1 -- 172.21.15.19:0/4207874057 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd54021030 con 0x563fcd09f9f0 2024-09-11T00:01:58.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd41ffb640 1 -- 172.21.15.19:0/4207874057 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54026770 con 0x563fcd09f9f0 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd64aab740 1 -- 172.21.15.19:0/4207874057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 msgr2=0x563fcd09e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd64aab740 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09e590 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd54010d50 tx=0x7fbd54011aa0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd64aab740 1 -- 172.21.15.19:0/4207874057 shutdown_connections 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd64aab740 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd09e590 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd64aab740 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd09e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.914+0000 7fbd64aab740 1 --2- 172.21.15.19:0/4207874057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd08c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 -- 172.21.15.19:0/4207874057 >> 172.21.15.19:0/4207874057 conn(0x563fcd08cb60 msgr2=0x563fcd0af790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 -- 172.21.15.19:0/4207874057 shutdown_connections 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 -- 172.21.15.19:0/4207874057 wait complete. 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 -- start start 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 Processor -- start 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd090fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd091560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd08fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563fcd0b1c00 con 0x563fcd09f9f0 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563fcd0b1530 con 0x563fcd08ed30 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563fcd0b22d0 con 0x563fcd08f650 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.915+0000 7fbd64aab740 10 client.0 _ll_register_callbacks cb 0x7fbd5400be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd08fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd08fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54312/0 (socket says 172.21.15.19:54312) 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 -- 172.21.15.19:0/1134607410 learned_addr learned my addr 172.21.15.19:0/1134607410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:01:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd090fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd5b7fe640 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd091560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 -- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 msgr2=0x563fcd091560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd091560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 -- 172.21.15.19:0/1134607410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 msgr2=0x563fcd090fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd090fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 -- 172.21.15.19:0/1134607410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fcd0906f0 con 0x563fcd09f9f0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd60c73640 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd08fec0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd5401ded0 tx=0x7fbd5400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7c59affdd9bafe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1134607410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5403d030 con 0x563fcd09f9f0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd54021030 con 0x563fcd09f9f0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.916+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1134607410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fbd54035040 con 0x563fcd09f9f0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1134607410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd5400bbb0 con 0x563fcd09f9f0 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 10 client.15189 fetch_fsmap learned FSMap version 24 2024-09-11T00:01:58.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563fcd0b9c30 con 0x563fcd09f9f0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1134607410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd54021030 con 0x563fcd09f9f0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1134607410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd540052a0 con 0x563fcd09f9f0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 10 client.15189 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 10 client.15189 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 20 client.15189 populate_metadata read hostname 'smithi019' 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd1225b0 0x563fcd1212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 4 client.15189 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "status"}) -- 0x563fcd0a0650 con 0x563fcd1225b0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.917+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd1225b0 0x563fcd1212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd5bfff640 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd1225b0 0x563fcd1212c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f33cc6ed6960d4ca server_cookie=69f4cd3765c86d79 in_seq=0 out_seq=0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd3b7fe640 10 client.15189 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd3b7fe640 1 -- 172.21.15.19:0/1134607410 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563fcd0a0650 con 0x563fcd1225b0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd3b7fe640 10 client.15189 handle_command_reply: tid=0 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 client.15189 shutdown 2024-09-11T00:01:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 msgr2=0x563fcd08fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd08fec0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd5401ded0 tx=0x7fbd5400ece0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 shutdown_connections 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x563fcd1225b0 0x563fcd1212c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563fcd09f9f0 0x563fcd08fec0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fcd08f650 0x563fcd091560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 --2- 172.21.15.19:0/1134607410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcd08ed30 0x563fcd090fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 >> 172.21.15.19:0/1134607410 conn(0x563fcd08cb60 msgr2=0x563fcd09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd3b7fe640 0 client.15189 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 shutdown_connections 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 1 -- 172.21.15.19:0/1134607410 wait complete. 2024-09-11T00:01:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.918+0000 7fbd64aab740 20 client.15189 trim_cache size 0 max 16384 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24604, 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 80.629266150999996, 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 78, 2024-09-11T00:01:58.926 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 76, 2024-09-11T00:01:58.927 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 114.283982382 2024-09-11T00:01:58.927 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:01:58.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbd440b5330 msgr2=0x7fbd440b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbd440b5330 0x7fbd440b77f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400be30 tx=0x7fbd54004a40 comp rx=0 tx=0).stop 2024-09-11T00:01:58.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c101c90 msgr2=0x7fbd5c199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:58.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c101c90 0x7fbd5c199270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c890 tx=0x7fbd4c00cd50 comp rx=0 tx=0).stop 2024-09-11T00:01:58.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 shutdown_connections 2024-09-11T00:01:58.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c108020 0x7fbd5c19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd5c1076a0 0x7fbd5c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fbd440b5330 0x7fbd440b77f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 --2- 172.21.15.19:0/3941696162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd5c101c90 0x7fbd5c199270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:58.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 >> 172.21.15.19:0/3941696162 conn(0x7fbd5c0fd700 msgr2=0x7fbd5c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:58.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 shutdown_connections 2024-09-11T00:01:58.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:01:58.919+0000 7fbd626d6640 1 -- 172.21.15.19:0/3941696162 wait complete. 2024-09-11T00:01:59.790 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T00:02:00.052 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:00.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:00 smithi019 ceph-mon[30859]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T00:02:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:00 smithi131 ceph-mon[35491]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T00:02:00.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:00 smithi135 ceph-mon[35432]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T00:02:00.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 -- 172.21.15.19:0/3630671358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04103ce0 msgr2=0x7f6e041040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 --2- 172.21.15.19:0/3630671358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04103ce0 0x7f6e041040c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009900 tx=0x7f6df402a410 comp rx=0 tx=0).stop 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 -- 172.21.15.19:0/3630671358 shutdown_connections 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 --2- 172.21.15.19:0/3630671358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0410d140 0x7f6e0410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 --2- 172.21.15.19:0/3630671358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e04104600 0x7f6e0410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 --2- 172.21.15.19:0/3630671358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04103ce0 0x7f6e041040c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 -- 172.21.15.19:0/3630671358 >> 172.21.15.19:0/3630671358 conn(0x7f6e040fd720 msgr2=0x7f6e040ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 -- 172.21.15.19:0/3630671358 shutdown_connections 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.575+0000 7f6e09501640 1 -- 172.21.15.19:0/3630671358 wait complete. 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 Processor -- start 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 -- start start 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e04103ce0 0x7f6e041994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04104600 0x7f6e041999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0410d140 0x7f6e0419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04112e90 con 0x7f6e04104600 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04112d10 con 0x7f6e0410d140 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e09501640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04113010 con 0x7f6e04103ce0 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6dfa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04104600 0x7f6e041999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6dfa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04104600 0x7f6e041999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54328/0 (socket says 172.21.15.19:54328) 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/2054350660 learned_addr learned my addr 172.21.15.19:0/2054350660 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.576+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e04103ce0 0x7f6e041994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6e037fe640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0410d140 0x7f6e0419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/2054350660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e04103ce0 msgr2=0x7f6e041994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e04103ce0 0x7f6e041994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/2054350660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0410d140 msgr2=0x7f6e0419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0410d140 0x7f6e0419ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/2054350660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0419f550 con 0x7f6e04104600 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e04103ce0 0x7f6e041994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04104600 0x7f6e041999e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00b3c0 tx=0x7f6dec00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6e00ff9640 1 -- 172.21.15.19:0/2054350660 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec011830 con 0x7f6e04104600 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0419f840 con 0x7f6e04104600 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6e00ff9640 1 -- 172.21.15.19:0/2054350660 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dec016070 con 0x7f6e04104600 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6e00ff9640 1 -- 172.21.15.19:0/2054350660 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec010de0 con 0x7f6e04104600 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.577+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e041a5f00 con 0x7f6e04104600 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.579+0000 7f6e0b8d6740 1 Processor -- start 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e0b8d6740 1 -- start start 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eeb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723efb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723efdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557723e62c10 con 0x557723eead30 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e00ff9640 1 -- 172.21.15.19:0/2054350660 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f6dec0119d0 con 0x7f6e04104600 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557723e52040 con 0x557723eeb650 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557723e55e50 con 0x557723efb9f0 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eeb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eeb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54334/0 (socket says 172.21.15.19:54334) 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 -- 172.21.15.19:0/4142152716 learned_addr learned my addr 172.21.15.19:0/4142152716 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723efdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723efb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 -- 172.21.15.19:0/4142152716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 msgr2=0x557723efdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723efdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 -- 172.21.15.19:0/4142152716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 msgr2=0x557723efb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723efb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e037fe640 1 -- 172.21.15.19:0/4142152716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557723bb0540 con 0x557723eead30 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723efdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.580+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723efb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.581+0000 7f6e037fe640 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eeb110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007dc0 tx=0x7f6dfc00c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cfedcdc0cb8def server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.581+0000 7f6df97fa640 1 -- 172.21.15.19:0/4142152716 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc015020 con 0x557723eead30 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.581+0000 7f6df97fa640 1 -- 172.21.15.19:0/4142152716 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dfc011ae0 con 0x557723eead30 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.581+0000 7f6df97fa640 1 -- 172.21.15.19:0/4142152716 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc010940 con 0x557723eead30 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.581+0000 7f6e00ff9640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6df00b5330 0x7f6df00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.581+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6df00b5330 0x7f6df00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.581+0000 7f6e00ff9640 1 -- 172.21.15.19:0/2054350660 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6dec0e52f0 con 0x7f6e04104600 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/4142152716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 msgr2=0x557723eeb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6df00b5330 0x7f6df00b77f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6df4031440 tx=0x7f6df40314a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eeb110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007dc0 tx=0x7f6dfc00c560 comp rx=0 tx=0).stop 2024-09-11T00:02:00.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/4142152716 shutdown_connections 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723efdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723efb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/4142152716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eeb110 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/4142152716 >> 172.21.15.19:0/4142152716 conn(0x557723ee8b60 msgr2=0x557723ee9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/4142152716 shutdown_connections 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/4142152716 wait complete. 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 -- start start 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.582+0000 7f6e0b8d6740 1 Processor -- start 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eead30 0x557723ef8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eeb650 0x557723ef8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723efb9f0 0x557723ef9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557723cb35f0 con 0x557723eeb650 2024-09-11T00:02:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557723ded010 con 0x557723efb9f0 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557723efe6a0 con 0x557723eead30 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 10 client.0 _ll_register_callbacks cb 0x557723e4c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eeb650 0x557723ef8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eeb650 0x557723ef8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54338/0 (socket says 172.21.15.19:54338) 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/3113109165 learned_addr learned my addr 172.21.15.19:0/3113109165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eead30 0x557723ef8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e037fe640 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723efb9f0 0x557723ef9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/3113109165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eead30 msgr2=0x557723ef8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eead30 0x557723ef8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723efb9f0 msgr2=0x557723ef9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723efb9f0 0x557723ef9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 -- 172.21.15.19:0/3113109165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557723e1aa00 con 0x557723eeb650 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eeb650 0x557723ef8ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0ab9a0 tx=0x7f6dec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e447e86a48bb28ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dea7fc640 1 -- 172.21.15.19:0/3113109165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0ab360 con 0x557723eeb650 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dfc011ae0 con 0x557723eeb650 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.583+0000 7f6dea7fc640 1 -- 172.21.15.19:0/3113109165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6dec0e8d40 con 0x557723eeb650 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6dea7fc640 1 -- 172.21.15.19:0/3113109165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6dec0a7180 con 0x557723eeb650 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 10 client.15201 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557723f0a2c0 con 0x557723eeb650 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6dea7fc640 1 -- 172.21.15.19:0/3113109165 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dfc011ae0 con 0x557723eeb650 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6dea7fc640 1 -- 172.21.15.19:0/3113109165 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6dec0a7c80 con 0x557723eeb650 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 10 client.15201 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 10 client.15201 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 20 client.15201 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f0dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 4 client.15201 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557723e64b60 con 0x557723f0c860 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.584+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f0dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.585+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f0dcd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=390fc4f610598ef0 server_cookie=4352b20b470463d5 in_seq=0 out_seq=0 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.585+0000 7f6dea7fc640 10 client.15201 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.585+0000 7f6dea7fc640 1 -- 172.21.15.19:0/3113109165 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557723e64b60 con 0x557723f0c860 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.585+0000 7f6dea7fc640 10 client.15201 handle_command_reply: tid=0 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.585+0000 7f6e0b8d6740 1 client.15201 shutdown 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eeb650 msgr2=0x557723ef8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eeb650 0x557723ef8ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0ab9a0 tx=0x7f6dec0046c0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 shutdown_connections 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f0dcd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723efb9f0 0x557723ef9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6dea7fc640 0 client.15201 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eeb650 0x557723ef8ed0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/3113109165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eead30 0x557723ef8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 >> 172.21.15.19:0/3113109165 conn(0x557723ee8b60 msgr2=0x557723ee7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 shutdown_connections 2024-09-11T00:02:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/3113109165 wait complete. 2024-09-11T00:02:00.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.586+0000 7f6e0b8d6740 20 client.15201 trim_cache size 0 max 16384 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.604+0000 7f6e0b8d6740 1 Processor -- start 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.604+0000 7f6e0b8d6740 1 -- start start 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eead30 0x557723ef6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eeb650 0x557723ee84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723efb9f0 0x557723efbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557723f0c010 con 0x557723efb9f0 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557723f0c6e0 con 0x557723eead30 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557723f0cdb0 con 0x557723eeb650 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723efb9f0 0x557723efbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723efb9f0 0x557723efbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54348/0 (socket says 172.21.15.19:54348) 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 -- 172.21.15.19:0/2297080259 learned_addr learned my addr 172.21.15.19:0/2297080259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eeb650 0x557723ee84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eead30 0x557723ef6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 -- 172.21.15.19:0/2297080259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eeb650 msgr2=0x557723ee84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eeb650 0x557723ee84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 -- 172.21.15.19:0/2297080259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eead30 msgr2=0x557723ef6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eead30 0x557723ef6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 -- 172.21.15.19:0/2297080259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557723ef6eb0 con 0x557723efb9f0 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eead30 0x557723ef6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6e037fe640 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723efb9f0 0x557723efbed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0070f0 tx=0x7f6dfc0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6b64477f5c567e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6df8ff9640 1 -- 172.21.15.19:0/2297080259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc029070 con 0x557723efb9f0 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6df8ff9640 1 -- 172.21.15.19:0/2297080259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dfc024b30 con 0x557723efb9f0 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.605+0000 7f6df8ff9640 1 -- 172.21.15.19:0/2297080259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc015040 con 0x557723efb9f0 2024-09-11T00:02:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/2297080259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723efb9f0 msgr2=0x557723efbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723efb9f0 0x557723efbed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0070f0 tx=0x7f6dfc0049e0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/2297080259 shutdown_connections 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723efb9f0 0x557723efbed0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723eeb650 0x557723ee84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/2297080259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eead30 0x557723ef6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/2297080259 >> 172.21.15.19:0/2297080259 conn(0x557723ee8b60 msgr2=0x557723efda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/2297080259 shutdown_connections 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.606+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/2297080259 wait complete. 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 -- start start 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 Processor -- start 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eebe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723eec370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723eec910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557723f0db50 con 0x557723eead30 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557723f0d480 con 0x557723eeb650 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557723f0e220 con 0x557723efb9f0 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e0b8d6740 10 client.0 _ll_register_callbacks cb 0x7f6dec00b310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eebe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54354/0 (socket says 172.21.15.19:54354) 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 -- 172.21.15.19:0/1403363716 learned_addr learned my addr 172.21.15.19:0/1403363716 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e037fe640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723eec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723eec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 -- 172.21.15.19:0/1403363716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 msgr2=0x557723eec910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723eec910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 -- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 msgr2=0x557723eec370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:00.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723eec370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e02ffd640 1 -- 172.21.15.19:0/1403363716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557723eed140 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.607+0000 7f6e037fe640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723eec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6e02ffd640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eebe30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009230 tx=0x7f6df4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f054b84bd2cff2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6dea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6dea7fc640 1 -- 172.21.15.19:0/1403363716 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4053030 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6dea7fc640 1 -- 172.21.15.19:0/1403363716 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6df4042040 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dfc024b30 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6dea7fc640 1 -- 172.21.15.19:0/1403363716 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6df405f050 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6e0b8d6740 10 client.15207 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557723f79990 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6dea7fc640 1 -- 172.21.15.19:0/1403363716 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dfc024b30 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6dea7fc640 1 -- 172.21.15.19:0/1403363716 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6df4004920 con 0x557723eead30 2024-09-11T00:02:00.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6e0b8d6740 10 client.15207 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.608+0000 7f6e0b8d6740 10 client.15207 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6e0b8d6740 20 client.15207 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f7d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6e0b8d6740 4 client.15207 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "status"}) -- 0x557723f0be60 con 0x557723f0c860 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f7d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6dea7fc640 10 client.15207 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6dfa7fc640 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f7d2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7550f1e6d530e25b server_cookie=7ae349af5469e187 in_seq=0 out_seq=0 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6dea7fc640 1 -- 172.21.15.19:0/1403363716 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557723f0be60 con 0x557723f0c860 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6dea7fc640 10 client.15207 handle_command_reply: tid=0 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6e0b8d6740 1 client.15207 shutdown 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 msgr2=0x557723eebe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.609+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eebe30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009230 tx=0x7f6df4009260 comp rx=0 tx=0).stop 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 shutdown_connections 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x557723f0c860 0x557723f7d2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557723efb9f0 0x557723eec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557723eeb650 0x557723eec370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 --2- 172.21.15.19:0/1403363716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557723eead30 0x557723eebe30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 >> 172.21.15.19:0/1403363716 conn(0x557723ee8b60 msgr2=0x557723efbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6dea7fc640 0 client.15207 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 shutdown_connections 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 1 -- 172.21.15.19:0/1403363716 wait complete. 2024-09-11T00:02:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e0b8d6740 20 client.15207 trim_cache size 0 max 16384 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24605, 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 83.326102180000007, 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 78, 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 76, 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 100.570432212 2024-09-11T00:02:00.625 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:02:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6df00b5330 msgr2=0x7f6df00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6df00b5330 0x7f6df00b77f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6df4031440 tx=0x7f6df40314a0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04104600 msgr2=0x7f6e041999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04104600 0x7f6e041999e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00b3c0 tx=0x7f6dec00b880 comp rx=0 tx=0).stop 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 shutdown_connections 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0410d140 0x7f6e0419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6df00b5330 0x7f6df00b77f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e04104600 0x7f6e041999e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.610+0000 7f6e09501640 1 --2- 172.21.15.19:0/2054350660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e04103ce0 0x7f6e041994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.611+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 >> 172.21.15.19:0/2054350660 conn(0x7f6e040fd720 msgr2=0x7f6e040fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.611+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 shutdown_connections 2024-09-11T00:02:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:00.611+0000 7f6e09501640 1 -- 172.21.15.19:0/2054350660 wait complete. 2024-09-11T00:02:01.430 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T00:02:01.687 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:02.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:02 smithi019 ceph-mon[30859]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 -- 172.21.15.19:0/2033279686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 msgr2=0x7fe17c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 --2- 172.21.15.19:0/2033279686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c107b20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe170009900 tx=0x7fe17002a410 comp rx=0 tx=0).stop 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 -- 172.21.15.19:0/2033279686 shutdown_connections 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 --2- 172.21.15.19:0/2033279686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17c108060 0x7fe17c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 --2- 172.21.15.19:0/2033279686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c107b20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 --2- 172.21.15.19:0/2033279686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c101cd0 0x7fe17c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 -- 172.21.15.19:0/2033279686 >> 172.21.15.19:0/2033279686 conn(0x7fe17c0fd700 msgr2=0x7fe17c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 -- 172.21.15.19:0/2033279686 shutdown_connections 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 -- 172.21.15.19:0/2033279686 wait complete. 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.184+0000 7fe1815e7640 1 Processor -- start 2024-09-11T00:02:02.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe1815e7640 1 -- start start 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe1815e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17c101cd0 0x7fe17c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe1815e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe1815e7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c108060 0x7fe17c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe1815e7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c112e40 con 0x7fe17c1076e0 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe1815e7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c112cc0 con 0x7fe17c108060 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe1815e7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c112fc0 con 0x7fe17c101cd0 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c1997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50708/0 (socket says 172.21.15.19:50708) 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 -- 172.21.15.19:0/4264537519 learned_addr learned my addr 172.21.15.19:0/4264537519 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17affd640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17c101cd0 0x7fe17c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c108060 0x7fe17c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 -- 172.21.15.19:0/4264537519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17c101cd0 msgr2=0x7fe17c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17c101cd0 0x7fe17c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 -- 172.21.15.19:0/4264537519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c108060 msgr2=0x7fe17c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c108060 0x7fe17c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 -- 172.21.15.19:0/4264537519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c19f340 con 0x7fe17c1076e0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c108060 0x7fe17c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.185+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c1997d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe170005940 tx=0x7fe1700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.186+0000 7fe163fff640 1 -- 172.21.15.19:0/4264537519 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17003f030 con 0x7fe17c1076e0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.186+0000 7fe163fff640 1 -- 172.21.15.19:0/4264537519 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe170003cb0 con 0x7fe17c1076e0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.186+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17c19f5d0 con 0x7fe17c1076e0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.186+0000 7fe163fff640 1 -- 172.21.15.19:0/4264537519 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170035070 con 0x7fe17c1076e0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.186+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17c1a5cf0 con 0x7fe17c1076e0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.188+0000 7fe163fff640 1 -- 172.21.15.19:0/4264537519 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fe17003bbf0 con 0x7fe17c1076e0 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.188+0000 7fe1839bc740 1 Processor -- start 2024-09-11T00:02:02.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.188+0000 7fe1839bc740 1 -- start start 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91309110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe1839bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55be91280c10 con 0x55be913199f0 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe1839bc740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55be91270040 con 0x55be91309650 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe1839bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be91273e50 con 0x55be91308d30 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50716/0 (socket says 172.21.15.19:50716) 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 -- 172.21.15.19:0/2298826272 learned_addr learned my addr 172.21.15.19:0/2298826272 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91309110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17affd640 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 -- 172.21.15.19:0/2298826272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 msgr2=0x55be91309110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91309110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 -- 172.21.15.19:0/2298826272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 msgr2=0x55be913194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.189+0000 7fe17a7fc640 1 -- 172.21.15.19:0/2298826272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be90fce540 con 0x55be913199f0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.190+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131bde0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe17010cc10 tx=0x7fe17010cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643a3ee1c70540bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.190+0000 7fe163fff640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1640b53b0 0x7fe1640b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.190+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1640b53b0 0x7fe1640b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.190+0000 7fe1617fa640 1 -- 172.21.15.19:0/2298826272 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170115070 con 0x55be913199f0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.190+0000 7fe163fff640 1 -- 172.21.15.19:0/4264537519 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe1701067d0 con 0x7fe17c1076e0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.190+0000 7fe1617fa640 1 -- 172.21.15.19:0/2298826272 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1700cca00 con 0x55be913199f0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.190+0000 7fe1617fa640 1 -- 172.21.15.19:0/2298826272 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1700c9540 con 0x55be913199f0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 -- 172.21.15.19:0/2298826272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 msgr2=0x55be9131bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1640b53b0 0x7fe1640b7870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe174005fd0 tx=0x7fe174009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131bde0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe17010cc10 tx=0x7fe17010cd00 comp rx=0 tx=0).stop 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 -- 172.21.15.19:0/2298826272 shutdown_connections 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131bde0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 --2- 172.21.15.19:0/2298826272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91309110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 -- 172.21.15.19:0/2298826272 >> 172.21.15.19:0/2298826272 conn(0x55be91306b60 msgr2=0x55be91307d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 -- 172.21.15.19:0/2298826272 shutdown_connections 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 -- 172.21.15.19:0/2298826272 wait complete. 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 -- start start 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.191+0000 7fe1839bc740 1 Processor -- start 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91319480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913168f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be91317080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55be910d15f0 con 0x55be913199f0 2024-09-11T00:02:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55be9120b010 con 0x55be91309650 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be9131c460 con 0x55be91308d30 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 10 client.0 _ll_register_callbacks cb 0x55be9126a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be91317080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be91317080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50718/0 (socket says 172.21.15.19:50718) 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 -- 172.21.15.19:0/3464553728 learned_addr learned my addr 172.21.15.19:0/3464553728 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17affd640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91319480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 -- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 msgr2=0x55be91319480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91319480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 -- 172.21.15.19:0/3464553728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 msgr2=0x55be913168f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913168f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 -- 172.21.15.19:0/3464553728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be91238a00 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be91317080 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe174011ce0 tx=0x7fe174004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9399d5ffe2fc3ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe15eff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe15eff5640 1 -- 172.21.15.19:0/3464553728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17401eb20 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1700cca00 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.192+0000 7fe15eff5640 1 -- 172.21.15.19:0/3464553728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe17401ecc0 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe15eff5640 1 -- 172.21.15.19:0/3464553728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe17402a480 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 10 client.15219 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55be91327f20 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe15eff5640 1 -- 172.21.15.19:0/3464553728 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1700cca00 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe15eff5640 1 -- 172.21.15.19:0/3464553728 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe17400f040 con 0x55be913199f0 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 10 client.15219 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 10 client.15219 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T00:02:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 20 client.15219 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9132a4b0 0x55be9132b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 4 client.15219 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be91282b60 con 0x55be9132a4b0 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.193+0000 7fe17affd640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9132a4b0 0x55be9132b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.194+0000 7fe17affd640 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9132a4b0 0x55be9132b920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6995fc42459b2bc server_cookie=b77a10577fa8492f in_seq=0 out_seq=0 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.194+0000 7fe15eff5640 10 client.15219 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.194+0000 7fe15eff5640 1 -- 172.21.15.19:0/3464553728 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be91282b60 con 0x55be9132a4b0 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.194+0000 7fe15eff5640 10 client.15219 handle_command_reply: tid=0 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 client.15219 shutdown 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 msgr2=0x55be91317080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be91317080 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe174011ce0 tx=0x7fe174004a40 comp rx=0 tx=0).stop 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 shutdown_connections 2024-09-11T00:02:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9132a4b0 0x55be9132b920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be91317080 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be913168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe15eff5640 0 client.15219 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3464553728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91319480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 >> 172.21.15.19:0/3464553728 conn(0x55be91306b60 msgr2=0x55be9130c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 shutdown_connections 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 1 -- 172.21.15.19:0/3464553728 wait complete. 2024-09-11T00:02:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.195+0000 7fe1839bc740 20 client.15219 trim_cache size 0 max 16384 2024-09-11T00:02:02.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.213+0000 7fe1839bc740 1 Processor -- start 2024-09-11T00:02:02.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.213+0000 7fe1839bc740 1 -- start start 2024-09-11T00:02:02.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91329390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be9131b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe1839bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55be91329c60 con 0x55be913199f0 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe1839bc740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55be9132a330 con 0x55be91309650 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe1839bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be9132aa00 con 0x55be91308d30 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50734/0 (socket says 172.21.15.19:50734) 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 -- 172.21.15.19:0/1327587838 learned_addr learned my addr 172.21.15.19:0/1327587838 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be9131b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 -- 172.21.15.19:0/1327587838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 msgr2=0x55be91329390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17affd640 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91329390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91329390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 -- 172.21.15.19:0/1327587838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 msgr2=0x55be9131b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be9131b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 -- 172.21.15.19:0/1327587838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be91314df0 con 0x55be913199f0 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be9131b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131a9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe174018040 tx=0x7fe1740118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d4bc06f5b85548 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe160ff9640 1 -- 172.21.15.19:0/1327587838 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1740349b0 con 0x55be913199f0 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe160ff9640 1 -- 172.21.15.19:0/1327587838 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe174039070 con 0x55be913199f0 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.214+0000 7fe160ff9640 1 -- 172.21.15.19:0/1327587838 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17402a620 con 0x55be913199f0 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 -- 172.21.15.19:0/1327587838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 msgr2=0x55be9131a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131a9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe174018040 tx=0x7fe1740118a0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 -- 172.21.15.19:0/1327587838 shutdown_connections 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be913199f0 0x55be9131a9c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be91309650 0x55be9131b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 --2- 172.21.15.19:0/1327587838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91308d30 0x55be91329390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 -- 172.21.15.19:0/1327587838 >> 172.21.15.19:0/1327587838 conn(0x55be91306b60 msgr2=0x55be91301c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:02.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 -- 172.21.15.19:0/1327587838 shutdown_connections 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.215+0000 7fe1839bc740 1 -- 172.21.15.19:0/1327587838 wait complete. 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 -- start start 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 Processor -- start 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be91308d30 0x55be9130c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91309650 0x55be913054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be913199f0 0x55be91305a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55be9132b7a0 con 0x55be91308d30 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55be9132b0d0 con 0x55be913199f0 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be9132be70 con 0x55be91309650 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe1839bc740 10 client.0 _ll_register_callbacks cb 0x7fe1740093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be91308d30 0x55be9130c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be91308d30 0x55be9130c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50742/0 (socket says 172.21.15.19:50742) 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 -- 172.21.15.19:0/3736874405 learned_addr learned my addr 172.21.15.19:0/3736874405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91309650 0x55be913054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17b7fe640 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be913199f0 0x55be91305a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 -- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91309650 msgr2=0x55be913054e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91309650 0x55be913054e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 -- 172.21.15.19:0/3736874405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be913199f0 msgr2=0x55be91305a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be913199f0 0x55be91305a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.216+0000 7fe17affd640 1 -- 172.21.15.19:0/3736874405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be91306060 con 0x55be91308d30 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe17affd640 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be91308d30 0x55be9130c530 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7179004db8237b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe15eff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe15eff5640 1 -- 172.21.15.19:0/3736874405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c005220 con 0x55be91308d30 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe174039070 con 0x55be91308d30 2024-09-11T00:02:02.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe15eff5640 1 -- 172.21.15.19:0/3736874405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe16c0053c0 con 0x55be91308d30 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe15eff5640 1 -- 172.21.15.19:0/3736874405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe16c0055c0 con 0x55be91308d30 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe1839bc740 10 client.15225 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55be91397c60 con 0x55be91308d30 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe15eff5640 1 -- 172.21.15.19:0/3736874405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe174039070 con 0x55be91308d30 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe15eff5640 1 -- 172.21.15.19:0/3736874405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe16c01db00 con 0x55be91308d30 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.217+0000 7fe1839bc740 10 client.15225 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe1839bc740 10 client.15225 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe1839bc740 20 client.15225 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9139c7a0 0x55be9139b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe1839bc740 4 client.15225 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "status"}) -- 0x55be9127e610 con 0x55be9139c7a0 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9139c7a0 0x55be9139b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe17a7fc640 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9139c7a0 0x55be9139b4b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=665965e9d4ffa339 server_cookie=9580ac170f43e88b in_seq=0 out_seq=0 2024-09-11T00:02:02.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.218+0000 7fe15eff5640 10 client.15225 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe15eff5640 1 -- 172.21.15.19:0/3736874405 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55be9127e610 con 0x55be9139c7a0 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe15eff5640 10 client.15225 handle_command_reply: tid=0 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 client.15225 shutdown 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be91308d30 msgr2=0x55be9130c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be91308d30 0x55be9130c530 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c011810 comp rx=0 tx=0).stop 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 shutdown_connections 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be913199f0 0x55be91305a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be91309650 0x55be913054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55be9139c7a0 0x55be9139b4b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 --2- 172.21.15.19:0/3736874405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55be91308d30 0x55be9130c530 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 >> 172.21.15.19:0/3736874405 conn(0x55be91306b60 msgr2=0x55be91329390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe15eff5640 0 client.15225 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 shutdown_connections 2024-09-11T00:02:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 1 -- 172.21.15.19:0/3736874405 wait complete. 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.219+0000 7fe1839bc740 20 client.15225 trim_cache size 0 max 16384 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24625, 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-11T00:02:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 92.977685919999999, 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 78, 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 76, 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 112.32065542700001 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1640b53b0 msgr2=0x7fe1640b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1640b53b0 0x7fe1640b7870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe174005fd0 tx=0x7fe174009800 comp rx=0 tx=0).stop 2024-09-11T00:02:02.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 msgr2=0x7fe17c1997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c1997d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe170005940 tx=0x7fe1700042f0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 shutdown_connections 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c108060 0x7fe17c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe1640b53b0 0x7fe1640b7870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c1076e0 0x7fe17c1997d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 --2- 172.21.15.19:0/4264537519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17c101cd0 0x7fe17c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 >> 172.21.15.19:0/4264537519 conn(0x7fe17c0fd700 msgr2=0x7fe17c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 shutdown_connections 2024-09-11T00:02:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:02.220+0000 7fe1815e7640 1 -- 172.21.15.19:0/4264537519 wait complete. 2024-09-11T00:02:02.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:02 smithi131 ceph-mon[35491]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:02.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:02 smithi135 ceph-mon[35432]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:02.989 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T00:02:02.989 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:02:03.001 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T00:02:03.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T00:02:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:03.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.766+0000 7f5a14ca3640 1 -- 172.21.15.19:0/2612478328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 msgr2=0x7f5a1010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.766+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/2612478328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1010e860 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009900 tx=0x7f5a0802a410 comp rx=0 tx=0).stop 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 -- 172.21.15.19:0/2612478328 shutdown_connections 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/2612478328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1010e860 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/2612478328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a101076e0 0x7f5a10107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/2612478328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a10101cd0 0x7f5a101020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 -- 172.21.15.19:0/2612478328 >> 172.21.15.19:0/2612478328 conn(0x7f5a100fd720 msgr2=0x7f5a100ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 -- 172.21.15.19:0/2612478328 shutdown_connections 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 -- 172.21.15.19:0/2612478328 wait complete. 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 Processor -- start 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.767+0000 7f5a14ca3640 1 -- start start 2024-09-11T00:02:03.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a14ca3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10101cd0 0x7f5a1019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a14ca3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a101076e0 0x7f5a1019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a14ca3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a14ca3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10111ce0 con 0x7f5a10108060 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a14ca3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10111b60 con 0x7f5a101076e0 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a14ca3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10111e60 con 0x7f5a10101cd0 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50760/0 (socket says 172.21.15.19:50760) 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 -- 172.21.15.19:0/3101660363 learned_addr learned my addr 172.21.15.19:0/3101660363 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0e59c640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10101cd0 0x7f5a1019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0dd9b640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a101076e0 0x7f5a1019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 -- 172.21.15.19:0/3101660363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10101cd0 msgr2=0x7f5a1019a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:03.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10101cd0 0x7f5a1019a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 -- 172.21.15.19:0/3101660363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a101076e0 msgr2=0x7f5a1019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a101076e0 0x7f5a1019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 -- 172.21.15.19:0/3101660363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a101a5450 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0dd9b640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a101076e0 0x7f5a1019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.768+0000 7f5a0ed9d640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1019ab10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5a08004770 tx=0x7f5a08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.769+0000 7f59ff7fe640 1 -- 172.21.15.19:0/3101660363 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0803f030 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.769+0000 7f59ff7fe640 1 -- 172.21.15.19:0/3101660363 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a08003aa0 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.769+0000 7f59ff7fe640 1 -- 172.21.15.19:0/3101660363 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08035070 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.769+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a101a56e0 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.769+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a101a5bc0 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.770+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a101020b0 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.771+0000 7f59ff7fe640 1 -- 172.21.15.19:0/3101660363 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f5a080035f0 con 0x7f5a10108060 2024-09-11T00:02:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.772+0000 7f59ff7fe640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f59f80b5330 0x7f59f80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:03.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.772+0000 7f5a0e59c640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f59f80b5330 0x7f59f80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:03.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.772+0000 7f59ff7fe640 1 -- 172.21.15.19:0/3101660363 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5a081069b0 con 0x7f5a10108060 2024-09-11T00:02:03.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.772+0000 7f5a0e59c640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f59f80b5330 0x7f59f80b77f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a00007ec0 tx=0x7f5a000075b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:03.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.775+0000 7f59ff7fe640 1 -- 172.21.15.19:0/3101660363 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5a080cd7d0 con 0x7f5a10108060 2024-09-11T00:02:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.976+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5a10063590 con 0x7f59f80b5330 2024-09-11T00:02:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.977+0000 7f59ff7fe640 1 -- 172.21.15.19:0/3101660363 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5a10063590 con 0x7f59f80b5330 2024-09-11T00:02:03.979 INFO:teuthology.orchestra.run.smithi019.stdout:Backend: cephadm 2024-09-11T00:02:03.980 INFO:teuthology.orchestra.run.smithi019.stdout:Available: Yes 2024-09-11T00:02:03.980 INFO:teuthology.orchestra.run.smithi019.stdout:Paused: No 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.979+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f59f80b5330 msgr2=0x7f59f80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.979+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f59f80b5330 0x7f59f80b77f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a00007ec0 tx=0x7f5a000075b0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 msgr2=0x7f5a1019ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1019ab10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5a08004770 tx=0x7f5a08004270 comp rx=0 tx=0).stop 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 shutdown_connections 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f59f80b5330 0x7f59f80b77f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a10108060 0x7f5a1019ab10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a101076e0 0x7f5a1019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 --2- 172.21.15.19:0/3101660363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a10101cd0 0x7f5a1019a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 >> 172.21.15.19:0/3101660363 conn(0x7f5a100fd720 msgr2=0x7f5a100ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 shutdown_connections 2024-09-11T00:02:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:03.980+0000 7f5a14ca3640 1 -- 172.21.15.19:0/3101660363 wait complete. 2024-09-11T00:02:04.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:04 smithi019 ceph-mon[30859]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:04.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:04 smithi131 ceph-mon[35491]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:04 smithi135 ceph-mon[35432]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:04.774 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T00:02:05.037 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:05.291 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:05 smithi019 ceph-mon[30859]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:05.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:05 smithi131 ceph-mon[35491]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:05.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:05 smithi135 ceph-mon[35432]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 -- 172.21.15.19:0/1429691524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc1087d0 msgr2=0x7f65bc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 --2- 172.21.15.19:0/1429691524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc1087d0 0x7f65bc108c10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009900 tx=0x7f65a402a410 comp rx=0 tx=0).stop 2024-09-11T00:02:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 -- 172.21.15.19:0/1429691524 shutdown_connections 2024-09-11T00:02:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 --2- 172.21.15.19:0/1429691524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc109150 0x7f65bc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 --2- 172.21.15.19:0/1429691524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc1087d0 0x7f65bc108c10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 --2- 172.21.15.19:0/1429691524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65bc102dc0 0x7f65bc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 -- 172.21.15.19:0/1429691524 >> 172.21.15.19:0/1429691524 conn(0x7f65bc0fe830 msgr2=0x7f65bc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 -- 172.21.15.19:0/1429691524 shutdown_connections 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.523+0000 7f65c295f640 1 -- 172.21.15.19:0/1429691524 wait complete. 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 Processor -- start 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 -- start start 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65bc102dc0 0x7f65bc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc1087d0 0x7f65bc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc109150 0x7f65bc19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc112e10 con 0x7f65bc109150 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc112c90 con 0x7f65bc102dc0 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c295f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc112f90 con 0x7f65bc1087d0 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c0efc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc109150 0x7f65bc19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c0efc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc109150 0x7f65bc19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50782/0 (socket says 172.21.15.19:50782) 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65c0efc640 1 -- 172.21.15.19:0/638765256 learned_addr learned my addr 172.21.15.19:0/638765256 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65bbfff640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65bc102dc0 0x7f65bc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.524+0000 7f65bb7fe640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc1087d0 0x7f65bc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c0efc640 1 -- 172.21.15.19:0/638765256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc1087d0 msgr2=0x7f65bc1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c0efc640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc1087d0 0x7f65bc1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c0efc640 1 -- 172.21.15.19:0/638765256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65bc102dc0 msgr2=0x7f65bc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c0efc640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65bc102dc0 0x7f65bc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c0efc640 1 -- 172.21.15.19:0/638765256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc19f330 con 0x7f65bc109150 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65bbfff640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65bc102dc0 0x7f65bc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c0efc640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc109150 0x7f65bc19eb60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f65b400b970 tx=0x7f65b400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65b97fa640 1 -- 172.21.15.19:0/638765256 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4019070 con 0x7f65bc109150 2024-09-11T00:02:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc19f620 con 0x7f65bc109150 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65b97fa640 1 -- 172.21.15.19:0/638765256 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65b4014440 con 0x7f65bc109150 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65b97fa640 1 -- 172.21.15.19:0/638765256 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b40075d0 con 0x7f65bc109150 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.525+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc1a5ce0 con 0x7f65bc109150 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.526+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65bc1031a0 con 0x7f65bc109150 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.527+0000 7f65b97fa640 1 -- 172.21.15.19:0/638765256 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f65b400cb40 con 0x7f65bc109150 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.528+0000 7f65b97fa640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f65a80b5330 0x7f65a80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.528+0000 7f65bbfff640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f65a80b5330 0x7f65a80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.528+0000 7f65b97fa640 1 -- 172.21.15.19:0/638765256 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f65b40e55a0 con 0x7f65bc109150 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.529+0000 7f65bbfff640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f65a80b5330 0x7f65a80b77f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00abe0 tx=0x7f65ac00a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.532+0000 7f65b97fa640 1 -- 172.21.15.19:0/638765256 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f65b40ac360 con 0x7f65bc109150 2024-09-11T00:02:05.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.727+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f65bc063590 con 0x7f65a80b5330 2024-09-11T00:02:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.741+0000 7f65b97fa640 1 -- 172.21.15.19:0/638765256 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f65bc063590 con 0x7f65a80b5330 2024-09-11T00:02:05.742 INFO:teuthology.orchestra.run.smithi019.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:02:05.742 INFO:teuthology.orchestra.run.smithi019.stdout:mds.a smithi019 running (109s) 19s ago 108s 14.6M - 19.3.0-4854-g8f219c47 589dd18248e4 448943214c39 2024-09-11T00:02:05.742 INFO:teuthology.orchestra.run.smithi019.stdout:mds.b smithi131 running (106s) 37s ago 105s 18.2M - 19.3.0-4854-g8f219c47 589dd18248e4 63217acb0f42 2024-09-11T00:02:05.742 INFO:teuthology.orchestra.run.smithi019.stdout:mds.c smithi135 running (2m) 37s ago 2m 18.6M - 19.3.0-4854-g8f219c47 589dd18248e4 7ea8e1614f6e 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.d smithi019 running (2m) 19s ago 2m 16.1M - 19.3.0-4854-g8f219c47 589dd18248e4 df7d129f4f45 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.e smithi131 running (2m) 37s ago 2m 13.6M - 19.3.0-4854-g8f219c47 589dd18248e4 9b41a39e69e9 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.f smithi135 running (2m) 37s ago 2m 20.8M - 19.3.0-4854-g8f219c47 589dd18248e4 835edba0c49b 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.g smithi019 running (113s) 19s ago 111s 14.2M - 19.3.0-4854-g8f219c47 589dd18248e4 eafe4497e369 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.h smithi131 running (118s) 37s ago 118s 17.4M - 19.3.0-4854-g8f219c47 589dd18248e4 a994c3e52108 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.i smithi135 running (116s) 37s ago 115s 28.7M - 19.3.0-4854-g8f219c47 589dd18248e4 d9bc917b5ce6 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.j smithi019 running (2m) 19s ago 2m 13.9M - 19.3.0-4854-g8f219c47 589dd18248e4 6eb732705ca9 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.k smithi131 running (2m) 37s ago 2m 14.0M - 19.3.0-4854-g8f219c47 589dd18248e4 02c23f50332e 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mds.l smithi135 running (2m) 37s ago 2m 19.7M - 19.3.0-4854-g8f219c47 589dd18248e4 2bda5cb7268e 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.x smithi019 *:9283,8765 running (9m) 19s ago 9m 520M - 19.3.0-4854-g8f219c47 589dd18248e4 06c2442c6e82 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.y smithi131 *:8443,8765 running (8m) 37s ago 8m 457M - 19.3.0-4854-g8f219c47 589dd18248e4 1bac838ac984 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.z smithi135 *:8443,8765 running (8m) 37s ago 8m 457M - 19.3.0-4854-g8f219c47 589dd18248e4 391ca49c29de 2024-09-11T00:02:05.743 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a smithi019 running (9m) 19s ago 10m 53.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 1f3c34498610 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b smithi131 running (8m) 37s ago 8m 41.7M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 471db5df2c43 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c smithi135 running (8m) 37s ago 8m 42.9M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 bf91465b581a 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 smithi019 running (7m) 19s ago 7m 55.6M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 88fca869e54f 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 smithi131 running (6m) 37s ago 6m 47.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 789848ef3662 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 smithi135 running (6m) 37s ago 6m 56.3M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 7c70ce3e7ab5 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 smithi019 running (6m) 19s ago 6m 53.5M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 9330c1601b57 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 smithi131 running (5m) 37s ago 5m 50.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 aede56d2cbc2 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 smithi135 running (5m) 37s ago 5m 43.4M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 6f3233e09f75 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 smithi019 running (4m) 19s ago 4m 42.1M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 819afec2ddc8 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 smithi131 running (4m) 37s ago 4m 53.8M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 95698f9b1476 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.8 smithi135 running (3m) 37s ago 3m 46.5M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 9e13dbb461a6 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.9 smithi019 running (3m) 19s ago 3m 41.5M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 e89b85cbf15b 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.10 smithi131 running (3m) 37s ago 3m 43.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 fb8b735c1bed 2024-09-11T00:02:05.744 INFO:teuthology.orchestra.run.smithi019.stdout:osd.11 smithi135 running (2m) 37s ago 2m 52.0M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 f7f5bd424d86 2024-09-11T00:02:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f65a80b5330 msgr2=0x7f65a80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f65a80b5330 0x7f65a80b77f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00abe0 tx=0x7f65ac00a5c0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc109150 msgr2=0x7f65bc19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc109150 0x7f65bc19eb60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f65b400b970 tx=0x7f65b400be30 comp rx=0 tx=0).stop 2024-09-11T00:02:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 shutdown_connections 2024-09-11T00:02:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f65a80b5330 0x7f65a80b77f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65bc109150 0x7f65bc19eb60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc1087d0 0x7f65bc1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 --2- 172.21.15.19:0/638765256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65bc102dc0 0x7f65bc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 >> 172.21.15.19:0/638765256 conn(0x7f65bc0fe830 msgr2=0x7f65bc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 shutdown_connections 2024-09-11T00:02:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:05.743+0000 7f65c295f640 1 -- 172.21.15.19:0/638765256 wait complete. 2024-09-11T00:02:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:06 smithi131 ceph-mon[35491]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:06.326 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:06 smithi135 ceph-mon[35432]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:06.406 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:06 smithi019 ceph-mon[30859]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T00:02:06.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T00:02:06.698 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:07.101 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:07 smithi019 ceph-mon[30859]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:07.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.182+0000 7f373c24e640 1 -- 172.21.15.19:0/3142649552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734108060 msgr2=0x7f373410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.182+0000 7f373c24e640 1 --2- 172.21.15.19:0/3142649552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734108060 0x7f373410e860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f372c009ca0 tx=0x7f372c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.182+0000 7f373c24e640 1 -- 172.21.15.19:0/3142649552 shutdown_connections 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.182+0000 7f373c24e640 1 --2- 172.21.15.19:0/3142649552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734108060 0x7f373410e860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.182+0000 7f373c24e640 1 --2- 172.21.15.19:0/3142649552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37341076e0 0x7f3734107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.182+0000 7f373c24e640 1 --2- 172.21.15.19:0/3142649552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3734101cd0 0x7f37341020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.182+0000 7f373c24e640 1 -- 172.21.15.19:0/3142649552 >> 172.21.15.19:0/3142649552 conn(0x7f37340fd700 msgr2=0x7f37340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 -- 172.21.15.19:0/3142649552 shutdown_connections 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 -- 172.21.15.19:0/3142649552 wait complete. 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 Processor -- start 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 -- start start 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734101cd0 0x7f3734199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37341076e0 0x7f37341997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3734108060 0x7f373419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3734111d20 con 0x7f3734101cd0 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.183+0000 7f373c24e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3734111ba0 con 0x7f37341076e0 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f373c24e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3734111ea0 con 0x7f3734108060 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734101cd0 0x7f3734199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734101cd0 0x7f3734199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50808/0 (socket says 172.21.15.19:50808) 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 -- 172.21.15.19:0/467663888 learned_addr learned my addr 172.21.15.19:0/467663888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f37397e9640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37341076e0 0x7f37341997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 -- 172.21.15.19:0/467663888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3734108060 msgr2=0x7f373419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f373a7eb640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3734108060 0x7f373419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3734108060 0x7f373419eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 -- 172.21.15.19:0/467663888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37341076e0 msgr2=0x7f37341997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:07.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37341076e0 0x7f37341997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 -- 172.21.15.19:0/467663888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373419f320 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f3739fea640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734101cd0 0x7f3734199270 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f373000d950 tx=0x7f373000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f372affd640 1 -- 172.21.15.19:0/467663888 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730017070 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373419f610 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f372affd640 1 -- 172.21.15.19:0/467663888 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3730009c30 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f372affd640 1 -- 172.21.15.19:0/467663888 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373000f620 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.184+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37341a5ea0 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.186+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3734102f80 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.187+0000 7f372affd640 1 -- 172.21.15.19:0/467663888 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f3730010460 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.188+0000 7f372affd640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37200b53b0 0x7f37200b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.188+0000 7f37397e9640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37200b53b0 0x7f37200b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.188+0000 7f372affd640 1 -- 172.21.15.19:0/467663888 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f37300e5890 con 0x7f3734101cd0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.188+0000 7f37397e9640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37200b53b0 0x7f37200b7870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3734107460 tx=0x7f372400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:07.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.191+0000 7f372affd640 1 -- 172.21.15.19:0/467663888 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f37300ac730 con 0x7f3734101cd0 2024-09-11T00:02:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:07 smithi131 ceph-mon[35491]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.384+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3734104ca0 con 0x7f37200b53b0 2024-09-11T00:02:07.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.390+0000 7f372affd640 1 -- 172.21.15.19:0/467663888 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3734104ca0 con 0x7f37200b53b0 2024-09-11T00:02:07.392 INFO:teuthology.orchestra.run.smithi019.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T00:02:07.392 INFO:teuthology.orchestra.run.smithi019.stdout:mds.all 12/12 39s ago 2m smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-09-11T00:02:07.392 INFO:teuthology.orchestra.run.smithi019.stdout:mgr 3/3 39s ago 8m smithi019=x;smithi131=y;smithi135=z;count:3 2024-09-11T00:02:07.392 INFO:teuthology.orchestra.run.smithi019.stdout:mon 3/3 39s ago 8m smithi019:172.21.15.19=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c;count:3 2024-09-11T00:02:07.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd 12 39s ago - 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.392+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37200b53b0 msgr2=0x7f37200b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.392+0000 7f373c24e640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37200b53b0 0x7f37200b7870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3734107460 tx=0x7f372400b390 comp rx=0 tx=0).stop 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.392+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734101cd0 msgr2=0x7f3734199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.392+0000 7f373c24e640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734101cd0 0x7f3734199270 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f373000d950 tx=0x7f373000de10 comp rx=0 tx=0).stop 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 shutdown_connections 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3734108060 0x7f373419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37341076e0 0x7f37341997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37200b53b0 0x7f37200b7870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 --2- 172.21.15.19:0/467663888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3734101cd0 0x7f3734199270 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 >> 172.21.15.19:0/467663888 conn(0x7f37340fd700 msgr2=0x7f373406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:07.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 shutdown_connections 2024-09-11T00:02:07.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:07.393+0000 7f373c24e640 1 -- 172.21.15.19:0/467663888 wait complete. 2024-09-11T00:02:07.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:07 smithi135 ceph-mon[35432]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:08.096 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T00:02:08.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:08 smithi131 ceph-mon[35491]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-11T00:02:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:08 smithi135 ceph-mon[35432]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-11T00:02:08.478 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:08 smithi019 ceph-mon[30859]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-11T00:02:08.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.868+0000 7f25d1cf3640 1 -- 172.21.15.19:0/3365081277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 msgr2=0x7f25cc10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:08.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.868+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/3365081277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc10e860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009ca0 tx=0x7f25c402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 -- 172.21.15.19:0/3365081277 shutdown_connections 2024-09-11T00:02:08.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/3365081277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc10e860 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/3365081277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25cc1076e0 0x7f25cc107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/3365081277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc101cd0 0x7f25cc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 -- 172.21.15.19:0/3365081277 >> 172.21.15.19:0/3365081277 conn(0x7f25cc0fd720 msgr2=0x7f25cc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 -- 172.21.15.19:0/3365081277 shutdown_connections 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 -- 172.21.15.19:0/3365081277 wait complete. 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 Processor -- start 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.869+0000 7f25d1cf3640 1 -- start start 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25d1cf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc101cd0 0x7f25cc199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25d1cf3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25cc1076e0 0x7f25cc199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25d1cf3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25d1cf3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc111d70 con 0x7f25cc108060 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25d1cf3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc111bf0 con 0x7f25cc1076e0 2024-09-11T00:02:08.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25d1cf3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc111ef0 con 0x7f25cc101cd0 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc19eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50820/0 (socket says 172.21.15.19:50820) 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 -- 172.21.15.19:0/972369844 learned_addr learned my addr 172.21.15.19:0/972369844 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cb7fe640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc101cd0 0x7f25cc199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25c2ffd640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25cc1076e0 0x7f25cc199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 -- 172.21.15.19:0/972369844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc101cd0 msgr2=0x7f25cc199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc101cd0 0x7f25cc199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 -- 172.21.15.19:0/972369844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25cc1076e0 msgr2=0x7f25cc199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25cc1076e0 0x7f25cc199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 -- 172.21.15.19:0/972369844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc19f300 con 0x7f25cc108060 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25c2ffd640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25cc1076e0 0x7f25cc199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:08.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25cbfff640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc19eb30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009430 tx=0x7f25c40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.870+0000 7f25c97fa640 1 -- 172.21.15.19:0/972369844 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c4003c30 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.871+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc19f590 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.871+0000 7f25c97fa640 1 -- 172.21.15.19:0/972369844 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25c4003dd0 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.871+0000 7f25c97fa640 1 -- 172.21.15.19:0/972369844 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c402faa0 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.871+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc1a5cb0 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.872+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc1020b0 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.873+0000 7f25c97fa640 1 -- 172.21.15.19:0/972369844 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f25c402fc40 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.874+0000 7f25c97fa640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25b80b5330 0x7f25b80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.874+0000 7f25cb7fe640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25b80b5330 0x7f25b80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.874+0000 7f25c97fa640 1 -- 172.21.15.19:0/972369844 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f25c4107240 con 0x7f25cc108060 2024-09-11T00:02:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.874+0000 7f25cb7fe640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25b80b5330 0x7f25b80b77f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0058c0 tx=0x7f25bc00a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:08.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:08.877+0000 7f25c97fa640 1 -- 172.21.15.19:0/972369844 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25c40ce000 con 0x7f25cc108060 2024-09-11T00:02:09.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.070+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f25cc103c90 con 0x7f25b80b5330 2024-09-11T00:02:09.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.072+0000 7f25c97fa640 1 -- 172.21.15.19:0/972369844 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f25cc103c90 con 0x7f25b80b5330 2024-09-11T00:02:09.073 INFO:teuthology.orchestra.run.smithi019.stdout:HOST ADDR LABELS STATUS 2024-09-11T00:02:09.073 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 172.21.15.19 2024-09-11T00:02:09.073 INFO:teuthology.orchestra.run.smithi019.stdout:smithi131 172.21.15.131 2024-09-11T00:02:09.073 INFO:teuthology.orchestra.run.smithi019.stdout:smithi135 172.21.15.135 2024-09-11T00:02:09.073 INFO:teuthology.orchestra.run.smithi019.stdout:3 hosts in cluster 2024-09-11T00:02:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25b80b5330 msgr2=0x7f25b80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25b80b5330 0x7f25b80b77f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0058c0 tx=0x7f25bc00a250 comp rx=0 tx=0).stop 2024-09-11T00:02:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 msgr2=0x7f25cc19eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc19eb30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009430 tx=0x7f25c40319f0 comp rx=0 tx=0).stop 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 shutdown_connections 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f25b80b5330 0x7f25b80b77f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25cc108060 0x7f25cc19eb30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25cc1076e0 0x7f25cc199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 --2- 172.21.15.19:0/972369844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc101cd0 0x7f25cc199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 >> 172.21.15.19:0/972369844 conn(0x7f25cc0fd720 msgr2=0x7f25cc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 shutdown_connections 2024-09-11T00:02:09.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:09.074+0000 7f25d1cf3640 1 -- 172.21.15.19:0/972369844 wait complete. 2024-09-11T00:02:09.389 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:09 smithi019 ceph-mon[30859]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:09 smithi135 ceph-mon[35432]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:09.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:09 smithi131 ceph-mon[35491]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:09.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T00:02:09.971 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:10.393 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:10 smithi019 ceph-mon[30859]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T00:02:10.393 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:10 smithi019 ceph-mon[30859]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:10 smithi135 ceph-mon[35432]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T00:02:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:10 smithi135 ceph-mon[35432]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:10.451 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:10 smithi131 ceph-mon[35491]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T00:02:10.452 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:10 smithi131 ceph-mon[35491]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 -- 172.21.15.19:0/996877495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c1087d0 msgr2=0x7f3a6c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 --2- 172.21.15.19:0/996877495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c1087d0 0x7f3a6c108c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009900 tx=0x7f3a5402a410 comp rx=0 tx=0).stop 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 -- 172.21.15.19:0/996877495 shutdown_connections 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 --2- 172.21.15.19:0/996877495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a6c109150 0x7f3a6c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 --2- 172.21.15.19:0/996877495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c1087d0 0x7f3a6c108c10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 --2- 172.21.15.19:0/996877495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a6c102dc0 0x7f3a6c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 -- 172.21.15.19:0/996877495 >> 172.21.15.19:0/996877495 conn(0x7f3a6c0fe830 msgr2=0x7f3a6c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 -- 172.21.15.19:0/996877495 shutdown_connections 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.475+0000 7f3a71d18640 1 -- 172.21.15.19:0/996877495 wait complete. 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 Processor -- start 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 -- start start 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a6c102dc0 0x7f3a6c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a6c1087d0 0x7f3a6c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c109150 0x7f3a6c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112e20 con 0x7f3a6c109150 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112ca0 con 0x7f3a6c1087d0 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a71d18640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112fa0 con 0x7f3a6c102dc0 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c109150 0x7f3a6c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c109150 0x7f3a6c19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50838/0 (socket says 172.21.15.19:50838) 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a6c102dc0 0x7f3a6c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a6bfff640 1 -- 172.21.15.19:0/568698106 learned_addr learned my addr 172.21.15.19:0/568698106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.476+0000 7f3a6affd640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a6c1087d0 0x7f3a6c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a6bfff640 1 -- 172.21.15.19:0/568698106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a6c102dc0 msgr2=0x7f3a6c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a6bfff640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a6c102dc0 0x7f3a6c1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a6bfff640 1 -- 172.21.15.19:0/568698106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a6c1087d0 msgr2=0x7f3a6c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a6bfff640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a6c1087d0 0x7f3a6c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a6bfff640 1 -- 172.21.15.19:0/568698106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c19f2a0 con 0x7f3a6c109150 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a6bfff640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c109150 0x7f3a6c19ead0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400eaa0 tx=0x7f3a6400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a68ff9640 1 -- 172.21.15.19:0/568698106 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64004d20 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c19f590 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a68ff9640 1 -- 172.21.15.19:0/568698106 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64005020 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a68ff9640 1 -- 172.21.15.19:0/568698106 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a640116b0 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.477+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c1a5c50 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.478+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6c1031a0 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.479+0000 7f3a68ff9640 1 -- 172.21.15.19:0/568698106 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f3a6400f040 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.480+0000 7f3a68ff9640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a580b5330 0x7f3a580b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.480+0000 7f3a6b7fe640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a580b5330 0x7f3a580b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.480+0000 7f3a68ff9640 1 -- 172.21.15.19:0/568698106 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f3a640e5ae0 con 0x7f3a6c109150 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.481+0000 7f3a6b7fe640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a580b5330 0x7f3a580b77f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00abe0 tx=0x7f3a5c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.484+0000 7f3a68ff9640 1 -- 172.21.15.19:0/568698106 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a64016030 con 0x7f3a6c109150 2024-09-11T00:02:10.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.676+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f3a6c063590 con 0x7f3a580b5330 2024-09-11T00:02:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.678+0000 7f3a68ff9640 1 -- 172.21.15.19:0/568698106 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f3a6c063590 con 0x7f3a580b5330 2024-09-11T00:02:10.680 INFO:teuthology.orchestra.run.smithi019.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T00:02:10.680 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330002G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T00:02:10.680 INFO:teuthology.orchestra.run.smithi019.stdout:smithi131 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300N4400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T00:02:10.680 INFO:teuthology.orchestra.run.smithi019.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T00:02:10.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a580b5330 msgr2=0x7f3a580b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:10.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a580b5330 0x7f3a580b77f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00abe0 tx=0x7f3a5c00a2d0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c109150 msgr2=0x7f3a6c19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c109150 0x7f3a6c19ead0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400eaa0 tx=0x7f3a6400eea0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 shutdown_connections 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a580b5330 0x7f3a580b77f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a6c109150 0x7f3a6c19ead0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a6c1087d0 0x7f3a6c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 --2- 172.21.15.19:0/568698106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a6c102dc0 0x7f3a6c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 >> 172.21.15.19:0/568698106 conn(0x7f3a6c0fe830 msgr2=0x7f3a6c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 shutdown_connections 2024-09-11T00:02:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:10.681+0000 7f3a71d18640 1 -- 172.21.15.19:0/568698106 wait complete. 2024-09-11T00:02:11.467 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:02:11.476 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T00:02:11.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T00:02:11.742 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:12.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:12 smithi019 ceph-mon[30859]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:12.195 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:12 smithi019 ceph-mon[30859]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 -- 172.21.15.19:0/1757484170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed5410d100 msgr2=0x7fed5410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 --2- 172.21.15.19:0/1757484170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed5410d100 0x7fed5410f560 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009ca0 tx=0x7fed4c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 -- 172.21.15.19:0/1757484170 shutdown_connections 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 --2- 172.21.15.19:0/1757484170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed5410d100 0x7fed5410f560 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 --2- 172.21.15.19:0/1757484170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed541045c0 0x7fed5410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 --2- 172.21.15.19:0/1757484170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed54103ca0 0x7fed54104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 -- 172.21.15.19:0/1757484170 >> 172.21.15.19:0/1757484170 conn(0x7fed540fd700 msgr2=0x7fed540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 -- 172.21.15.19:0/1757484170 shutdown_connections 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.243+0000 7fed59e9e640 1 -- 172.21.15.19:0/1757484170 wait complete. 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 Processor -- start 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 -- start start 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed54103ca0 0x7fed541992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed541045c0 0x7fed541997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed5410d100 0x7fed5419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fed54112d70 con 0x7fed541045c0 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed54112bf0 con 0x7fed54103ca0 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.244+0000 7fed59e9e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed54112ef0 con 0x7fed5410d100 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed541045c0 0x7fed541997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed537fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed54103ca0 0x7fed541992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed541045c0 0x7fed541997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40984/0 (socket says 172.21.15.19:40984) 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 -- 172.21.15.19:0/2130064589 learned_addr learned my addr 172.21.15.19:0/2130064589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed53fff640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed5410d100 0x7fed5419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 -- 172.21.15.19:0/2130064589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed5410d100 msgr2=0x7fed5419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed5410d100 0x7fed5419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 -- 172.21.15.19:0/2130064589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed54103ca0 msgr2=0x7fed541992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed54103ca0 0x7fed541992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 -- 172.21.15.19:0/2130064589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5419f350 con 0x7fed541045c0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed4bfff640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed541045c0 0x7fed541997e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00d6b0 tx=0x7fed3c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed517fa640 1 -- 172.21.15.19:0/2130064589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c017070 con 0x7fed541045c0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed517fa640 1 -- 172.21.15.19:0/2130064589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed3c010460 con 0x7fed541045c0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5419f640 con 0x7fed541045c0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed517fa640 1 -- 172.21.15.19:0/2130064589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00f620 con 0x7fed541045c0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.245+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed541a5d00 con 0x7fed541045c0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.247+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed54104080 con 0x7fed541045c0 2024-09-11T00:02:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.248+0000 7fed517fa640 1 -- 172.21.15.19:0/2130064589 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fed3c010930 con 0x7fed541045c0 2024-09-11T00:02:12.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.249+0000 7fed517fa640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fed400b5330 0x7fed400b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:12.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.249+0000 7fed537fe640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fed400b5330 0x7fed400b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:12.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.249+0000 7fed517fa640 1 -- 172.21.15.19:0/2130064589 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fed3c0e58f0 con 0x7fed541045c0 2024-09-11T00:02:12.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.250+0000 7fed537fe640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fed400b5330 0x7fed400b77f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fed440058c0 tx=0x7fed4400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:12.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.253+0000 7fed517fa640 1 -- 172.21.15.19:0/2130064589 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fed3c0ac0c0 con 0x7fed541045c0 2024-09-11T00:02:12.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:12 smithi135 ceph-mon[35432]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:12.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:12 smithi135 ceph-mon[35432]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:12.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.478+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fed5402e5c0 con 0x7fed541045c0 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.479+0000 7fed517fa640 1 -- 172.21.15.19:0/2130064589 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3089 (secure 0 0 0) 0x7fed3c0b0af0 con 0x7fed541045c0 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:e24 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:btime 2024-09-11T00:00:41:297551+0000 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:legacy client fscid: 1 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:fs_name cephfs 2024-09-11T00:02:12.481 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 24 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-11T00:00:28.916347+0000 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-11T00:00:40.994067+0000 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:tableserver 0 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:root 0 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:session_timeout 300 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:session_autoclose 300 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:max_file_size 1099511627776 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:max_xattr_size 65536 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:required_client_features {} 2024-09-11T00:02:12.482 INFO:teuthology.orchestra.run.smithi019.stdout:last_failure 0 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:last_failure_osd_epoch 0 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:max_mds 3 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:in 0,1,2 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:up {0=24625,1=24605,2=24604} 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:failed 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:damaged 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:stopped 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:data_pools [3] 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:metadata_pool 2 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:inline_data disabled 2024-09-11T00:02:12.483 INFO:teuthology.orchestra.run.smithi019.stdout:balancer 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:bal_rank_mask -1 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:standby_count_wanted 0 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:qdb_cluster leader: 24625 members: 24604,24605,24625 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.i{0:24625} state up:active seq 6 addr [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.f{0:24598} state up:standby-replay seq 1 addr [v2:172.21.15.135:6834/3910864085,v1:172.21.15.135:6835/3910864085] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b{1:24605} state up:active seq 6 addr [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.h{1:24578} state up:standby-replay seq 1 addr [v2:172.21.15.131:6836/3685381952,v1:172.21.15.131:6837/3685381952] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c{2:24604} state up:active seq 10 addr [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.l{2:24565} state up:standby-replay seq 1 addr [v2:172.21.15.135:6832/324976573,v1:172.21.15.135:6833/324976573] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:12.484 INFO:teuthology.orchestra.run.smithi019.stdout:Standby daemons: 2024-09-11T00:02:12.485 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:12.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.j{-1:14727} state up:standby seq 1 addr [v2:172.21.15.19:6834/2693320130,v1:172.21.15.19:6835/2693320130] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d{-1:14739} state up:standby seq 1 addr [v2:172.21.15.19:6836/2350271990,v1:172.21.15.19:6837/2350271990] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.g{-1:14787} state up:standby seq 1 addr [v2:172.21.15.19:6838/1245997055,v1:172.21.15.19:6839/1245997055] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a{-1:14799} state up:standby seq 1 addr [v2:172.21.15.19:6840/84271943,v1:172.21.15.19:6841/84271943] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.k{-1:24530} state up:standby seq 1 addr [v2:172.21.15.131:6832/173201568,v1:172.21.15.131:6833/173201568] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.e{-1:24554} state up:standby seq 1 addr [v2:172.21.15.131:6834/1584755478,v1:172.21.15.131:6835/1584755478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:02:12.486 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-11T00:02:12.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.481+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fed400b5330 msgr2=0x7fed400b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:12.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.481+0000 7fed59e9e640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fed400b5330 0x7fed400b77f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fed440058c0 tx=0x7fed4400a2d0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed541045c0 msgr2=0x7fed541997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:12.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed541045c0 0x7fed541997e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00d6b0 tx=0x7fed3c00db70 comp rx=0 tx=0).stop 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 shutdown_connections 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed5410d100 0x7fed5419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fed400b5330 0x7fed400b77f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed541045c0 0x7fed541997e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 --2- 172.21.15.19:0/2130064589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed54103ca0 0x7fed541992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 >> 172.21.15.19:0/2130064589 conn(0x7fed540fd700 msgr2=0x7fed540fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 shutdown_connections 2024-09-11T00:02:12.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:12.482+0000 7fed59e9e640 1 -- 172.21.15.19:0/2130064589 wait complete. 2024-09-11T00:02:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:12 smithi131 ceph-mon[35491]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:12 smithi131 ceph-mon[35491]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:13.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:13 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2130064589' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:02:13.309 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T00:02:13.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:13 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2130064589' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:02:13.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:13 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2130064589' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:02:13.573 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 -- 172.21.15.19:0/763640988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c104570 msgr2=0x7f9c4c10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 --2- 172.21.15.19:0/763640988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c104570 0x7f9c4c10cb50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009900 tx=0x7f9c3c02a410 comp rx=0 tx=0).stop 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 -- 172.21.15.19:0/763640988 shutdown_connections 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 --2- 172.21.15.19:0/763640988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c4c10d120 0x7f9c4c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 --2- 172.21.15.19:0/763640988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c104570 0x7f9c4c10cb50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 --2- 172.21.15.19:0/763640988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c4c103b70 0x7f9c4c103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 -- 172.21.15.19:0/763640988 >> 172.21.15.19:0/763640988 conn(0x7f9c4c0fd720 msgr2=0x7f9c4c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 -- 172.21.15.19:0/763640988 shutdown_connections 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.081+0000 7f9c5300e640 1 -- 172.21.15.19:0/763640988 wait complete. 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 Processor -- start 2024-09-11T00:02:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 -- start start 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c4c103b70 0x7f9c4c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c4c104570 0x7f9c4c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c10d120 0x7f9c4c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c112e00 con 0x7f9c4c10d120 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c112c80 con 0x7f9c4c103b70 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c5300e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c112f80 con 0x7f9c4c104570 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c515ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c10d120 0x7f9c4c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c515ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c10d120 0x7f9c4c19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41008/0 (socket says 172.21.15.19:41008) 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c515ab640 1 -- 172.21.15.19:0/4249066129 learned_addr learned my addr 172.21.15.19:0/4249066129 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c50daa640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c4c103b70 0x7f9c4c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c4bfff640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c4c104570 0x7f9c4c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c515ab640 1 -- 172.21.15.19:0/4249066129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c4c104570 msgr2=0x7f9c4c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c515ab640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c4c104570 0x7f9c4c199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c515ab640 1 -- 172.21.15.19:0/4249066129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c4c103b70 msgr2=0x7f9c4c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.082+0000 7f9c515ab640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c4c103b70 0x7f9c4c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c515ab640 1 -- 172.21.15.19:0/4249066129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c19f380 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c50daa640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c4c103b70 0x7f9c4c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c515ab640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c10d120 0x7f9c4c19ebb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400eaa0 tx=0x7f9c4400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c49ffb640 1 -- 172.21.15.19:0/4249066129 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400cdb0 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c49ffb640 1 -- 172.21.15.19:0/4249066129 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c44005020 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c49ffb640 1 -- 172.21.15.19:0/4249066129 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c440116d0 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4c19f670 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.083+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4c1a5db0 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.084+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4c103f50 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.086+0000 7f9c49ffb640 1 -- 172.21.15.19:0/4249066129 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f9c4400f040 con 0x7f9c4c10d120 2024-09-11T00:02:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.086+0000 7f9c49ffb640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c380b53b0 0x7f9c380b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.086+0000 7f9c49ffb640 1 -- 172.21.15.19:0/4249066129 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9c440e5fa0 con 0x7f9c4c10d120 2024-09-11T00:02:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.086+0000 7f9c50daa640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c380b53b0 0x7f9c380b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.087+0000 7f9c50daa640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c380b53b0 0x7f9c380b7870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c34006fd0 tx=0x7f9c34008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.089+0000 7f9c49ffb640 1 -- 172.21.15.19:0/4249066129 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9c44016030 con 0x7f9c4c10d120 2024-09-11T00:02:14.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:14 smithi019 ceph-mon[30859]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:02:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.277+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f9c4c19a400 con 0x7f9c4c10d120 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.278+0000 7f9c49ffb640 1 -- 172.21.15.19:0/4249066129 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v78) ==== 56+0+5633 (secure 0 0 0) 0x7f9c4c19a400 con 0x7f9c4c10d120 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 78 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-10T23:51:51.848622+0000 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-11T00:00:53.600623+0000 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:crush_version 26 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:full_ratio 0.95 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:backfillfull_ratio 0.9 2024-09-11T00:02:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:nearfull_ratio 0.85 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:require_min_compat_client luminous 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:min_compat_client luminous 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:require_osd_release squid 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:stretch_mode_enabled false 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:max_osd 12 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 up in weight 1 up_from 9 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6802/2233994763,v1:172.21.15.19:6803/2233994763] [v2:172.21.15.19:6804/2233994763,v1:172.21.15.19:6805/2233994763] exists,up c65b9f44-41c2-4115-8a1a-db391d0f931a 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 up in weight 1 up_from 14 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6800/832175696,v1:172.21.15.131:6801/832175696] [v2:172.21.15.131:6802/832175696,v1:172.21.15.131:6803/832175696] exists,up a58b033b-2df1-4c5a-a9eb-45a186da817c 2024-09-11T00:02:14.280 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 up in weight 1 up_from 19 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/3850868245,v1:172.21.15.135:6801/3850868245] [v2:172.21.15.135:6802/3850868245,v1:172.21.15.135:6803/3850868245] exists,up b965c6c5-f9c6-4405-a12d-fbbb3a9db549 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 up in weight 1 up_from 26 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6810/1691087553,v1:172.21.15.19:6811/1691087553] [v2:172.21.15.19:6812/1691087553,v1:172.21.15.19:6813/1691087553] exists,up 3e420e13-bffd-43e5-a862-e5d93b92b5fd 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 up in weight 1 up_from 32 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6808/250661719,v1:172.21.15.131:6809/250661719] [v2:172.21.15.131:6810/250661719,v1:172.21.15.131:6811/250661719] exists,up 491c3970-0871-473e-9346-4f960d917f97 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 up in weight 1 up_from 36 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/1638601368,v1:172.21.15.135:6809/1638601368] [v2:172.21.15.135:6810/1638601368,v1:172.21.15.135:6811/1638601368] exists,up cd207285-b240-4e77-a654-99fac9fa4349 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 up in weight 1 up_from 42 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6818/912073333,v1:172.21.15.19:6819/912073333] [v2:172.21.15.19:6820/912073333,v1:172.21.15.19:6821/912073333] exists,up a0306c2d-d4e6-4369-b19c-f3b947a2098a 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 up in weight 1 up_from 47 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6816/844665956,v1:172.21.15.131:6817/844665956] [v2:172.21.15.131:6818/844665956,v1:172.21.15.131:6819/844665956] exists,up a074eb86-fefd-4818-9c8b-0acceff1769c 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.8 up in weight 1 up_from 53 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/1258842145,v1:172.21.15.135:6817/1258842145] [v2:172.21.15.135:6818/1258842145,v1:172.21.15.135:6819/1258842145] exists,up 2127bf94-dfd0-46c0-885d-53f1144476d1 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.9 up in weight 1 up_from 59 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6826/1472748928,v1:172.21.15.19:6827/1472748928] [v2:172.21.15.19:6828/1472748928,v1:172.21.15.19:6829/1472748928] exists,up cccb62ba-6dfe-49a3-9f16-698180c729b2 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.10 up in weight 1 up_from 64 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6824/4074216082,v1:172.21.15.131:6825/4074216082] [v2:172.21.15.131:6826/4074216082,v1:172.21.15.131:6827/4074216082] exists,up 09ffbe08-03ae-468f-bf97-3e4698091550 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:osd.11 up in weight 1 up_from 70 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6824/555413250,v1:172.21.15.135:6825/555413250] [v2:172.21.15.135:6826/555413250,v1:172.21.15.135:6827/555413250] exists,up cc762f9a-dc74-4101-8173-04b4736231d9 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.4 [2,11] 2024-09-11T00:02:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.c [2,4] 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.f [8,11] 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.0 [5,9] 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.11 [4,8] 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.13 [4,9] 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.24 [4,9] 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/3470391779 expires 2024-09-11T23:53:52.390665+0000 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/3913578653 expires 2024-09-11T23:53:52.390665+0000 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6800/2022256684 expires 2024-09-11T23:52:27.323340+0000 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6801/2022256684 expires 2024-09-11T23:52:27.323340+0000 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/1979169918 expires 2024-09-11T23:52:27.323340+0000 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/172869376 expires 2024-09-11T23:52:51.509685+0000 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6800/3829413546 expires 2024-09-11T23:52:51.509685+0000 2024-09-11T00:02:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/2017286086 expires 2024-09-11T23:52:51.509685+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6801/3829413546 expires 2024-09-11T23:52:51.509685+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/963841749 expires 2024-09-11T23:52:51.509685+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/885611356 expires 2024-09-11T23:52:27.323340+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/2168429169 expires 2024-09-11T23:52:27.323340+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6800/3641264705 expires 2024-09-11T23:53:52.390665+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6801/3641264705 expires 2024-09-11T23:53:52.390665+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/3578109266 expires 2024-09-11T23:53:52.390665+0000 2024-09-11T00:02:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c380b53b0 msgr2=0x7f9c380b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c380b53b0 0x7f9c380b7870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c34006fd0 tx=0x7f9c34008040 comp rx=0 tx=0).stop 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c10d120 msgr2=0x7f9c4c19ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c10d120 0x7f9c4c19ebb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400eaa0 tx=0x7f9c4400ef60 comp rx=0 tx=0).stop 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 shutdown_connections 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c380b53b0 0x7f9c380b7870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4c10d120 0x7f9c4c19ebb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c4c104570 0x7f9c4c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 --2- 172.21.15.19:0/4249066129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c4c103b70 0x7f9c4c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 >> 172.21.15.19:0/4249066129 conn(0x7f9c4c0fd720 msgr2=0x7f9c4c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 shutdown_connections 2024-09-11T00:02:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:14.280+0000 7f9c5300e640 1 -- 172.21.15.19:0/4249066129 wait complete. 2024-09-11T00:02:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:14 smithi135 ceph-mon[35432]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:02:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:14 smithi131 ceph-mon[35491]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:02:15.175 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T00:02:15.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:02:15.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:15 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4249066129' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T00:02:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:15.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:15 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4249066129' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T00:02:15.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:15 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4249066129' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T00:02:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 -- 172.21.15.19:0/70263030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 msgr2=0x7fc7f010f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 --2- 172.21.15.19:0/70263030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f010f590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009ca0 tx=0x7fc7e802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 -- 172.21.15.19:0/70263030 shutdown_connections 2024-09-11T00:02:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 --2- 172.21.15.19:0/70263030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f010f590 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 --2- 172.21.15.19:0/70263030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7f0104570 0x7fc7f010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 --2- 172.21.15.19:0/70263030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f0103b70 0x7fc7f0103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 -- 172.21.15.19:0/70263030 >> 172.21.15.19:0/70263030 conn(0x7fc7f00fd700 msgr2=0x7fc7f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 -- 172.21.15.19:0/70263030 shutdown_connections 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.959+0000 7fc7f697e640 1 -- 172.21.15.19:0/70263030 wait complete. 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 Processor -- start 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 -- start start 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f0103b70 0x7fc7f01991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7f0104570 0x7fc7f01996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f019ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0112df0 con 0x7fc7f010d120 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0112c70 con 0x7fc7f0104570 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.960+0000 7fc7f697e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0112f70 con 0x7fc7f0103b70 2024-09-11T00:02:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f019ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f019ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41022/0 (socket says 172.21.15.19:41022) 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 -- 172.21.15.19:0/1906788009 learned_addr learned my addr 172.21.15.19:0/1906788009 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7ef7fe640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7f0104570 0x7fc7f01996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7effff640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f0103b70 0x7fc7f01991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 -- 172.21.15.19:0/1906788009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f0103b70 msgr2=0x7fc7f01991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f0103b70 0x7fc7f01991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 -- 172.21.15.19:0/1906788009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7f0104570 msgr2=0x7fc7f01996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7f0104570 0x7fc7f01996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 -- 172.21.15.19:0/1906788009 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f019f250 con 0x7fc7f010d120 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f4f1b640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f019ea80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8031a20 tx=0x7fc7e8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7ed7fa640 1 -- 172.21.15.19:0/1906788009 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8003c70 con 0x7fc7f010d120 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f019f4e0 con 0x7fc7f010d120 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7ed7fa640 1 -- 172.21.15.19:0/1906788009 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e8003e10 con 0x7fc7f010d120 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7ed7fa640 1 -- 172.21.15.19:0/1906788009 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e802fcb0 con 0x7fc7f010d120 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.961+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01a5c00 con 0x7fc7f010d120 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.962+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f0103f50 con 0x7fc7f010d120 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.964+0000 7fc7ed7fa640 1 -- 172.21.15.19:0/1906788009 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fc7e8004040 con 0x7fc7f010d120 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.964+0000 7fc7ed7fa640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc7d80b5330 0x7fc7d80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.965+0000 7fc7effff640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc7d80b5330 0x7fc7d80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:16.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.965+0000 7fc7ed7fa640 1 -- 172.21.15.19:0/1906788009 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc7e8107270 con 0x7fc7f010d120 2024-09-11T00:02:16.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.965+0000 7fc7effff640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc7d80b5330 0x7fc7d80b77f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00058c0 tx=0x7fc7e000a4c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:16.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:15.967+0000 7fc7ed7fa640 1 -- 172.21.15.19:0/1906788009 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc7e80ce1b0 con 0x7fc7f010d120 2024-09-11T00:02:16.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.190+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7f01a5ec0 con 0x7fc7f010d120 2024-09-11T00:02:16.192 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:16 smithi019 ceph-mon[30859]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:02:16.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.191+0000 7fc7ed7fa640 1 -- 172.21.15.19:0/1906788009 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7fc7e80c9030 con 0x7fc7f010d120 2024-09-11T00:02:16.193 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:16.193 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-11T00:00:41:297551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:00:40.994067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:02:16.194 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-11T00:02:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.193+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc7d80b5330 msgr2=0x7fc7d80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.193+0000 7fc7f697e640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc7d80b5330 0x7fc7d80b77f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00058c0 tx=0x7fc7e000a4c0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 msgr2=0x7fc7f019ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f019ea80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8031a20 tx=0x7fc7e8031a50 comp rx=0 tx=0).stop 2024-09-11T00:02:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 shutdown_connections 2024-09-11T00:02:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc7d80b5330 0x7fc7d80b77f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7f010d120 0x7fc7f019ea80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7f0104570 0x7fc7f01996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 --2- 172.21.15.19:0/1906788009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f0103b70 0x7fc7f01991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 >> 172.21.15.19:0/1906788009 conn(0x7fc7f00fd700 msgr2=0x7fc7f010f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 shutdown_connections 2024-09-11T00:02:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:16.194+0000 7fc7f697e640 1 -- 172.21.15.19:0/1906788009 wait complete. 2024-09-11T00:02:16.429 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:16 smithi135 ceph-mon[35432]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:02:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:16 smithi131 ceph-mon[35491]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:02:16.960 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:02:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:17.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:17 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1906788009' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:17.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:17 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1906788009' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:17 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1906788009' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:17.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 -- 172.21.15.19:0/3196877580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108620 msgr2=0x7f06c8108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 --2- 172.21.15.19:0/3196877580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108620 0x7f06c8108a60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009900 tx=0x7f06bc02a410 comp rx=0 tx=0).stop 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 -- 172.21.15.19:0/3196877580 shutdown_connections 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 --2- 172.21.15.19:0/3196877580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8108fa0 0x7f06c810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 --2- 172.21.15.19:0/3196877580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108620 0x7f06c8108a60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 --2- 172.21.15.19:0/3196877580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8102c10 0x7f06c8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 -- 172.21.15.19:0/3196877580 >> 172.21.15.19:0/3196877580 conn(0x7f06c80fe6c0 msgr2=0x7f06c8100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 -- 172.21.15.19:0/3196877580 shutdown_connections 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.787+0000 7f06c759e640 1 -- 172.21.15.19:0/3196877580 wait complete. 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 Processor -- start 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 -- start start 2024-09-11T00:02:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8102c10 0x7f06c8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8108620 0x7f06c8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108fa0 0x7f06c819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8112ca0 con 0x7f06c8108fa0 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8112b20 con 0x7f06c8108620 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c759e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8112e20 con 0x7f06c8102c10 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108fa0 0x7f06c819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108fa0 0x7f06c819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41034/0 (socket says 172.21.15.19:41034) 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.788+0000 7f06c6d9d640 1 -- 172.21.15.19:0/1260921106 learned_addr learned my addr 172.21.15.19:0/1260921106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c659c640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8102c10 0x7f06c8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c5d9b640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8108620 0x7f06c8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c6d9d640 1 -- 172.21.15.19:0/1260921106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8102c10 msgr2=0x7f06c8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c6d9d640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8102c10 0x7f06c8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c6d9d640 1 -- 172.21.15.19:0/1260921106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8108620 msgr2=0x7f06c8199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c6d9d640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8108620 0x7f06c8199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c6d9d640 1 -- 172.21.15.19:0/1260921106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c819f2e0 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c5d9b640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8108620 0x7f06c8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c6d9d640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108fa0 0x7f06c819eb10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f06c000b970 tx=0x7f06c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06b77fe640 1 -- 172.21.15.19:0/1260921106 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0019070 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06b77fe640 1 -- 172.21.15.19:0/1260921106 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c0014440 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06b77fe640 1 -- 172.21.15.19:0/1260921106 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00075d0 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c819f5d0 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.789+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c81a5c90 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.790+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c8103070 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.792+0000 7f06b77fe640 1 -- 172.21.15.19:0/1260921106 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f06c000cb40 con 0x7f06c8108fa0 2024-09-11T00:02:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.792+0000 7f06b77fe640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06b00b53e0 0x7f06b00b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:17.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.792+0000 7f06c659c640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06b00b53e0 0x7f06b00b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:17.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.792+0000 7f06b77fe640 1 -- 172.21.15.19:0/1260921106 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f06c00e5990 con 0x7f06c8108fa0 2024-09-11T00:02:17.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.793+0000 7f06c659c640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06b00b53e0 0x7f06b00b78a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009890 tx=0x7f06b8008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:17.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:17.795+0000 7f06b77fe640 1 -- 172.21.15.19:0/1260921106 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f06c00ac7b0 con 0x7f06c8108fa0 2024-09-11T00:02:18.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.016+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06c819a360 con 0x7f06c8108fa0 2024-09-11T00:02:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.017+0000 7f06b77fe640 1 -- 172.21.15.19:0/1260921106 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7f06c819a360 con 0x7f06c8108fa0 2024-09-11T00:02:18.018 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:18.018 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-11T00:00:41:297551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:00:40.994067+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:02:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-11T00:02:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06b00b53e0 msgr2=0x7f06b00b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06b00b53e0 0x7f06b00b78a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009890 tx=0x7f06b8008040 comp rx=0 tx=0).stop 2024-09-11T00:02:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108fa0 msgr2=0x7f06c819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108fa0 0x7f06c819eb10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f06c000b970 tx=0x7f06c000be30 comp rx=0 tx=0).stop 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 shutdown_connections 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06b00b53e0 0x7f06b00b78a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8108fa0 0x7f06c819eb10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8108620 0x7f06c8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 --2- 172.21.15.19:0/1260921106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8102c10 0x7f06c8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 >> 172.21.15.19:0/1260921106 conn(0x7f06c80fe6c0 msgr2=0x7f06c8100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 shutdown_connections 2024-09-11T00:02:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:18.019+0000 7f06c759e640 1 -- 172.21.15.19:0/1260921106 wait complete. 2024-09-11T00:02:18.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:18 smithi019 ceph-mon[30859]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:18.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:18 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1260921106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:18 smithi135 ceph-mon[35432]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:18 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1260921106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:18 smithi131 ceph-mon[35491]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:18 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1260921106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:18.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:02:18.907 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 -- 172.21.15.19:0/2350326785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 msgr2=0x7fca041031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 --2- 172.21.15.19:0/2350326785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca041031a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009900 tx=0x7fc9f402a410 comp rx=0 tx=0).stop 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 -- 172.21.15.19:0/2350326785 shutdown_connections 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 --2- 172.21.15.19:0/2350326785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca04109150 0x7fca0410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 --2- 172.21.15.19:0/2350326785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca041087d0 0x7fca04108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 --2- 172.21.15.19:0/2350326785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca041031a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 -- 172.21.15.19:0/2350326785 >> 172.21.15.19:0/2350326785 conn(0x7fca040fe830 msgr2=0x7fca04100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 -- 172.21.15.19:0/2350326785 shutdown_connections 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.404+0000 7fca09ef3640 1 -- 172.21.15.19:0/2350326785 wait complete. 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 Processor -- start 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 -- start start 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca0419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca041087d0 0x7fca0419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca04109150 0x7fca041a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca04112e10 con 0x7fca04102dc0 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fca04112c90 con 0x7fca041087d0 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca09ef3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca04112f90 con 0x7fca04109150 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca0419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca0419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41052/0 (socket says 172.21.15.19:41052) 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 -- 172.21.15.19:0/760862766 learned_addr learned my addr 172.21.15.19:0/760862766 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:19.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca03fff640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca04109150 0x7fca041a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 -- 172.21.15.19:0/760862766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca04109150 msgr2=0x7fca041a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca02ffd640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca041087d0 0x7fca0419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca04109150 0x7fca041a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 -- 172.21.15.19:0/760862766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca041087d0 msgr2=0x7fca0419ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca041087d0 0x7fca0419ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca037fe640 1 -- 172.21.15.19:0/760862766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca041a1580 con 0x7fca04102dc0 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca03fff640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca04109150 0x7fca041a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.405+0000 7fca02ffd640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca041087d0 0x7fca0419ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.406+0000 7fca037fe640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca0419b4d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4005940 tx=0x7fc9f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.406+0000 7fca00ff9640 1 -- 172.21.15.19:0/760862766 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f403f030 con 0x7fca04102dc0 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.406+0000 7fca00ff9640 1 -- 172.21.15.19:0/760862766 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f4003cb0 con 0x7fca04102dc0 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.406+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca041a1810 con 0x7fca04102dc0 2024-09-11T00:02:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.406+0000 7fca00ff9640 1 -- 172.21.15.19:0/760862766 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4035070 con 0x7fca04102dc0 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.406+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca041a7f30 con 0x7fca04102dc0 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.407+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca041031a0 con 0x7fca04102dc0 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.409+0000 7fca00ff9640 1 -- 172.21.15.19:0/760862766 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fc9f403bb50 con 0x7fca04102dc0 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.410+0000 7fca00ff9640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9f00b5330 0x7fc9f00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.410+0000 7fca02ffd640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9f00b5330 0x7fc9f00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.410+0000 7fca00ff9640 1 -- 172.21.15.19:0/760862766 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc9f4106b40 con 0x7fca04102dc0 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.410+0000 7fca02ffd640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9f00b5330 0x7fc9f00b77f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fca041080c0 tx=0x7fc9ec005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:19.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.413+0000 7fca00ff9640 1 -- 172.21.15.19:0/760862766 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9f40cd900 con 0x7fca04102dc0 2024-09-11T00:02:19.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.604+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca0402e5c0 con 0x7fca04102dc0 2024-09-11T00:02:19.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.605+0000 7fca00ff9640 1 -- 172.21.15.19:0/760862766 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22967 (secure 0 0 0) 0x7fc9f40cd200 con 0x7fca04102dc0 2024-09-11T00:02:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:19.607 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:53.600623+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9f00b5330 msgr2=0x7fc9f00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9f00b5330 0x7fc9f00b77f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fca041080c0 tx=0x7fc9ec005e50 comp rx=0 tx=0).stop 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 msgr2=0x7fca0419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca0419b4d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4005940 tx=0x7fc9f40042f0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 shutdown_connections 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca04109150 0x7fca041a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca041087d0 0x7fca0419ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc9f00b5330 0x7fc9f00b77f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 --2- 172.21.15.19:0/760862766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04102dc0 0x7fca0419b4d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 >> 172.21.15.19:0/760862766 conn(0x7fca040fe830 msgr2=0x7fca04104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 shutdown_connections 2024-09-11T00:02:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:19.608+0000 7fca09ef3640 1 -- 172.21.15.19:0/760862766 wait complete. 2024-09-11T00:02:20.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:20 smithi019 ceph-mon[30859]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:02:20.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:20 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/760862766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:20.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T00:00:28.916347+0000', 'modified': '2024-09-11T00:00:40.994067+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24625, 'mds_1': 24605, 'mds_2': 24604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24565': {'gid': 24565, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/324976573', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 324976573}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 324976573}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6837/3685381952', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 3685381952}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 3685381952}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24598': {'gid': 24598, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/3910864085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3910864085}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3910864085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24604': {'gid': 24604, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.135:6837/3873679773', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 3873679773}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 3873679773}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24605': {'gid': 24605, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6839/3500650127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6838', 'nonce': 3500650127}, {'type': 'v1', 'addr': '172.21.15.131:6839', 'nonce': 3500650127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.135:6839/2927257252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2927257252}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2927257252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24625, 'qdb_cluster': [24604, 24605, 24625]} 2024-09-11T00:02:20.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T00:02:20.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T00:02:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:20 smithi135 ceph-mon[35432]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:02:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:20 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/760862766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:20 smithi131 ceph-mon[35491]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:02:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:20 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/760862766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:20.675 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 -- 172.21.15.19:0/645683964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93501076a0 msgr2=0x7f9350107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 --2- 172.21.15.19:0/645683964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93501076a0 0x7f9350107ae0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9338009900 tx=0x7f933802a410 comp rx=0 tx=0).stop 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 -- 172.21.15.19:0/645683964 shutdown_connections 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 --2- 172.21.15.19:0/645683964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9350108020 0x7f935010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 --2- 172.21.15.19:0/645683964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93501076a0 0x7f9350107ae0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 --2- 172.21.15.19:0/645683964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9350101c90 0x7f9350102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 -- 172.21.15.19:0/645683964 >> 172.21.15.19:0/645683964 conn(0x7f93500fd700 msgr2=0x7f93500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 -- 172.21.15.19:0/645683964 shutdown_connections 2024-09-11T00:02:21.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 -- 172.21.15.19:0/645683964 wait complete. 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 Processor -- start 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.156+0000 7f9355b7a640 1 -- start start 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9355b7a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9350101c90 0x7f935019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9355b7a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93501076a0 0x7f935019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9355b7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350108020 0x7f935019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9355b7a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9350111d30 con 0x7f9350108020 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9355b7a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9350111bb0 con 0x7f93501076a0 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9355b7a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9350111eb0 con 0x7f9350101c90 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350108020 0x7f935019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350108020 0x7f935019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41080/0 (socket says 172.21.15.19:41080) 2024-09-11T00:02:21.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 -- 172.21.15.19:0/3933152919 learned_addr learned my addr 172.21.15.19:0/3933152919 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934f7fe640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9350101c90 0x7f935019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9346ffd640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93501076a0 0x7f935019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 -- 172.21.15.19:0/3933152919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9350101c90 msgr2=0x7f935019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9350101c90 0x7f935019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 -- 172.21.15.19:0/3933152919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93501076a0 msgr2=0x7f935019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93501076a0 0x7f935019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f934ffff640 1 -- 172.21.15.19:0/3933152919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93501a5520 con 0x7f9350108020 2024-09-11T00:02:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.157+0000 7f9346ffd640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93501076a0 0x7f935019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.158+0000 7f934ffff640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350108020 0x7f935019abe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f934800b970 tx=0x7f934800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.158+0000 7f934d7fa640 1 -- 172.21.15.19:0/3933152919 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348019070 con 0x7f9350108020 2024-09-11T00:02:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.158+0000 7f934d7fa640 1 -- 172.21.15.19:0/3933152919 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9348014440 con 0x7f9350108020 2024-09-11T00:02:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.158+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93501a5810 con 0x7f9350108020 2024-09-11T00:02:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.158+0000 7f934d7fa640 1 -- 172.21.15.19:0/3933152919 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93480075d0 con 0x7f9350108020 2024-09-11T00:02:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.158+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93501a5dd0 con 0x7f9350108020 2024-09-11T00:02:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.160+0000 7f934d7fa640 1 -- 172.21.15.19:0/3933152919 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f934800cb40 con 0x7f9350108020 2024-09-11T00:02:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.160+0000 7f9357f4f740 1 Processor -- start 2024-09-11T00:02:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.160+0000 7f9357f4f740 1 -- start start 2024-09-11T00:02:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aead110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeb95e0 0x55bb1aebb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9357f4f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bb1ae24c10 con 0x55bb1aeacd30 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9357f4f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55bb1ae14040 con 0x55bb1aead650 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9357f4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb1ae17e50 con 0x55bb1aeb95e0 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aead110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aead110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41088/0 (socket says 172.21.15.19:41088) 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 -- 172.21.15.19:0/4222887911 learned_addr learned my addr 172.21.15.19:0/4222887911 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeb95e0 0x55bb1aebb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f934f7fe640 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 -- 172.21.15.19:0/4222887911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeb95e0 msgr2=0x55bb1aebb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeb95e0 0x55bb1aebb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 -- 172.21.15.19:0/4222887911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 msgr2=0x55bb1aeb90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 -- 172.21.15.19:0/4222887911 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb1ab72540 con 0x55bb1aeacd30 2024-09-11T00:02:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f934f7fe640 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:02:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f934d7fa640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f933c0b53b0 0x7f933c0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f934f7fe640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f933c0b53b0 0x7f933c0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.161+0000 7f9346ffd640 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aead110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9338005390 tx=0x7f9338005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e02866c579727a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f934d7fa640 1 -- 172.21.15.19:0/3933152919 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f93480e5410 con 0x7f9350108020 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9345ffb640 1 -- 172.21.15.19:0/4222887911 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338035030 con 0x55bb1aeacd30 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9345ffb640 1 -- 172.21.15.19:0/4222887911 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93380055f0 con 0x55bb1aeacd30 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9345ffb640 1 -- 172.21.15.19:0/4222887911 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338003a30 con 0x55bb1aeacd30 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 -- 172.21.15.19:0/4222887911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 msgr2=0x55bb1aead110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f934f7fe640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f933c0b53b0 0x7f933c0b7870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55bb1aeafeb0 tx=0x7f934000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aead110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9338005390 tx=0x7f9338005bc0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 -- 172.21.15.19:0/4222887911 shutdown_connections 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeb95e0 0x55bb1aebb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 --2- 172.21.15.19:0/4222887911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aead110 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 -- 172.21.15.19:0/4222887911 >> 172.21.15.19:0/4222887911 conn(0x55bb1aeaab60 msgr2=0x55bb1aeabd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 -- 172.21.15.19:0/4222887911 shutdown_connections 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.162+0000 7f9357f4f740 1 -- 172.21.15.19:0/4222887911 wait complete. 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 -- start start 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 Processor -- start 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bb1ac755f0 con 0x55bb1aeb95e0 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55bb1adaf010 con 0x55bb1aead650 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb1aebc230 con 0x55bb1aeacd30 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f9357f4f740 10 client.0 _ll_register_callbacks cb 0x55bb1ae0e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f934ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f934ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41100/0 (socket says 172.21.15.19:41100) 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.163+0000 7f934ffff640 1 -- 172.21.15.19:0/634427976 learned_addr learned my addr 172.21.15.19:0/634427976 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f934f7fe640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f9346ffd640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f934ffff640 1 -- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeacd30 msgr2=0x55bb1aeb65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f934ffff640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f934ffff640 1 -- 172.21.15.19:0/634427976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 msgr2=0x55bb1aeb6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f934ffff640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f934ffff640 1 -- 172.21.15.19:0/634427976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb1addca00 con 0x55bb1aeb95e0 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f9346ffd640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f934ffff640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb7020 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f934800b940 tx=0x7f93480ab410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e885104acdd095ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f932effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f932effd640 1 -- 172.21.15.19:0/634427976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93480ace60 con 0x55bb1aeb95e0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f932effd640 1 -- 172.21.15.19:0/634427976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f93480b4e30 con 0x55bb1aeb95e0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93380055f0 con 0x55bb1aeb95e0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f932effd640 1 -- 172.21.15.19:0/634427976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f93480abbe0 con 0x55bb1aeb95e0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f9357f4f740 10 client.15297 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bb1aec7e50 con 0x55bb1aeb95e0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.164+0000 7f932effd640 1 -- 172.21.15.19:0/634427976 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93380055f0 con 0x55bb1aeb95e0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f932effd640 1 -- 172.21.15.19:0/634427976 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f93480a7530 con 0x55bb1aeb95e0 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f9357f4f740 10 client.15297 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f9357f4f740 10 client.15297 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f9357f4f740 20 client.15297 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f9357f4f740 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1aeca4a0 0x55bb1aecb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f9357f4f740 4 client.15297 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb1ae26b60 con 0x55bb1aeca4a0 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.165+0000 7f934f7fe640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1aeca4a0 0x55bb1aecb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f934f7fe640 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1aeca4a0 0x55bb1aecb910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=42a7f2d735d5194 server_cookie=ceea9321591c10eb in_seq=0 out_seq=0 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f932effd640 10 client.15297 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f932effd640 1 -- 172.21.15.19:0/634427976 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb1ae26b60 con 0x55bb1aeca4a0 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f932effd640 10 client.15297 handle_command_reply: tid=0 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 client.15297 shutdown 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeb95e0 msgr2=0x55bb1aeb7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb7020 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f934800b940 tx=0x7f93480ab410 comp rx=0 tx=0).stop 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 shutdown_connections 2024-09-11T00:02:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1aeca4a0 0x55bb1aecb910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb7020 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aead650 0x55bb1aeb6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f932effd640 0 client.15297 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.166+0000 7f9357f4f740 1 --2- 172.21.15.19:0/634427976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.167+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 >> 172.21.15.19:0/634427976 conn(0x55bb1aeaab60 msgr2=0x55bb1aeb0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.167+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 shutdown_connections 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.167+0000 7f9357f4f740 1 -- 172.21.15.19:0/634427976 wait complete. 2024-09-11T00:02:21.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.167+0000 7f9357f4f740 20 client.15297 trim_cache size 0 max 16384 2024-09-11T00:02:21.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.185+0000 7f9357f4f740 1 Processor -- start 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.185+0000 7f9357f4f740 1 -- start start 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aeb1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f9357f4f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bb1aec9c50 con 0x55bb1aeacd30 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f9357f4f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55bb1aeca320 con 0x55bb1aeb95e0 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f9357f4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb1aeca9f0 con 0x55bb1aead650 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41110/0 (socket says 172.21.15.19:41110) 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 -- 172.21.15.19:0/3037776486 learned_addr learned my addr 172.21.15.19:0/3037776486 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:21.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f9346ffd640 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aeb1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934ffff640 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 -- 172.21.15.19:0/3037776486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 msgr2=0x55bb1aeb1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aeb1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 -- 172.21.15.19:0/3037776486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 msgr2=0x55bb1aeb1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 -- 172.21.15.19:0/3037776486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb1aeaa990 con 0x55bb1aeacd30 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.186+0000 7f934f7fe640 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb5a90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9340005fd0 tx=0x7f9340019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9ccf6ab97b27b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f93457fa640 1 -- 172.21.15.19:0/3037776486 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934001eb30 con 0x55bb1aeacd30 2024-09-11T00:02:21.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f93457fa640 1 -- 172.21.15.19:0/3037776486 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93400054d0 con 0x55bb1aeacd30 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f93457fa640 1 -- 172.21.15.19:0/3037776486 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340004c10 con 0x55bb1aeacd30 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 -- 172.21.15.19:0/3037776486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 msgr2=0x55bb1aeb5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb5a90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9340005fd0 tx=0x7f9340019000 comp rx=0 tx=0).stop 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 -- 172.21.15.19:0/3037776486 shutdown_connections 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aeb1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aeb1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 --2- 172.21.15.19:0/3037776486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aeb5a90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 -- 172.21.15.19:0/3037776486 >> 172.21.15.19:0/3037776486 conn(0x55bb1aeaab60 msgr2=0x55bb1aec9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 -- 172.21.15.19:0/3037776486 shutdown_connections 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.187+0000 7f9357f4f740 1 -- 172.21.15.19:0/3037776486 wait complete. 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 -- start start 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 Processor -- start 2024-09-11T00:02:21.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aecf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aecf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aed35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bb1aecb790 con 0x55bb1aeacd30 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55bb1aecb0c0 con 0x55bb1aeb95e0 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb1aecbe60 con 0x55bb1aead650 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f9357f4f740 10 client.0 _ll_register_callbacks cb 0x7f9348014c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.188+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aecf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aecf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41114/0 (socket says 172.21.15.19:41114) 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 -- 172.21.15.19:0/2557219674 learned_addr learned my addr 172.21.15.19:0/2557219674 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:21.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934ffff640 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aed35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f9346ffd640 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aecf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 -- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 msgr2=0x55bb1aecf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aecf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 -- 172.21.15.19:0/2557219674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 msgr2=0x55bb1aed35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aed35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 -- 172.21.15.19:0/2557219674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb1aed3b30 con 0x55bb1aeacd30 2024-09-11T00:02:21.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f934f7fe640 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aecf3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9340005730 tx=0x7f9340005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dd7f97de52147b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f932effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f932effd640 1 -- 172.21.15.19:0/2557219674 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934003f060 con 0x55bb1aeacd30 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f932effd640 1 -- 172.21.15.19:0/2557219674 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f934001eb30 con 0x55bb1aeacd30 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93400054d0 con 0x55bb1aeacd30 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f932effd640 1 -- 172.21.15.19:0/2557219674 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9340004780 con 0x55bb1aeacd30 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f9357f4f740 10 client.15303 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.189+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bb1af37470 con 0x55bb1aeacd30 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f932effd640 1 -- 172.21.15.19:0/2557219674 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93400054d0 con 0x55bb1aeacd30 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f932effd640 1 -- 172.21.15.19:0/2557219674 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f934002a420 con 0x55bb1aeacd30 2024-09-11T00:02:21.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f9357f4f740 10 client.15303 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f9357f4f740 10 client.15303 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f9357f4f740 20 client.15303 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f9357f4f740 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1af3be30 0x55bb1af3ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f9357f4f740 4 client.15303 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "status"}) -- 0x55bb1ae22610 con 0x55bb1af3be30 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.190+0000 7f9346ffd640 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1af3be30 0x55bb1af3ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9346ffd640 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1af3be30 0x55bb1af3ab40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=61c7460b3c738cb8 server_cookie=54eabba9a9e35932 in_seq=0 out_seq=0 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f932effd640 10 client.15303 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f932effd640 1 -- 172.21.15.19:0/2557219674 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55bb1ae22610 con 0x55bb1af3be30 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f932effd640 10 client.15303 handle_command_reply: tid=0 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 client.15303 shutdown 2024-09-11T00:02:21.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 msgr2=0x55bb1aecf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aecf3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9340005730 tx=0x7f9340005760 comp rx=0 tx=0).stop 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 shutdown_connections 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55bb1af3be30 0x55bb1af3ab40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb1aeb95e0 0x55bb1aed35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb1aead650 0x55bb1aecf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 --2- 172.21.15.19:0/2557219674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bb1aeacd30 0x55bb1aecf3f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 >> 172.21.15.19:0/2557219674 conn(0x55bb1aeaab60 msgr2=0x55bb1aeb1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f932effd640 0 client.15303 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 shutdown_connections 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 1 -- 172.21.15.19:0/2557219674 wait complete. 2024-09-11T00:02:21.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.191+0000 7f9357f4f740 20 client.15303 trim_cache size 0 max 16384 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24604, 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 102.901299317, 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 78, 2024-09-11T00:02:21.212 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 76, 2024-09-11T00:02:21.213 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 136.556017771 2024-09-11T00:02:21.213 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:02:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f933c0b53b0 msgr2=0x7f933c0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f933c0b53b0 0x7f933c0b7870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55bb1aeafeb0 tx=0x7f934000b390 comp rx=0 tx=0).stop 2024-09-11T00:02:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350108020 msgr2=0x7f935019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350108020 0x7f935019abe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f934800b970 tx=0x7f934800be30 comp rx=0 tx=0).stop 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 shutdown_connections 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f933c0b53b0 0x7f933c0b7870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350108020 0x7f935019abe0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93501076a0 0x7f935019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 --2- 172.21.15.19:0/3933152919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9350101c90 0x7f935019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 >> 172.21.15.19:0/3933152919 conn(0x7f93500fd700 msgr2=0x7f93500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 shutdown_connections 2024-09-11T00:02:21.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:21.192+0000 7f9355b7a640 1 -- 172.21.15.19:0/3933152919 wait complete. 2024-09-11T00:02:22.140 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T00:02:22.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:22 smithi019 ceph-mon[30859]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:22.404 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:22 smithi135 ceph-mon[35432]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:22 smithi131 ceph-mon[35491]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:22.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 -- 172.21.15.19:0/621364706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 msgr2=0x7ff5941031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/621364706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff5941031a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff584009900 tx=0x7ff58402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 -- 172.21.15.19:0/621364706 shutdown_connections 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/621364706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff594109150 0x7ff59410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/621364706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5941087d0 0x7ff594108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/621364706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff5941031a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 -- 172.21.15.19:0/621364706 >> 172.21.15.19:0/621364706 conn(0x7ff5940fe830 msgr2=0x7ff594100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 -- 172.21.15.19:0/621364706 shutdown_connections 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.890+0000 7ff59a3bc640 1 -- 172.21.15.19:0/621364706 wait complete. 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.891+0000 7ff59a3bc640 1 Processor -- start 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.891+0000 7ff59a3bc640 1 -- start start 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff59a3bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff594199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff59a3bc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5941087d0 0x7ff594199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff59a3bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff594109150 0x7ff59419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff59a3bc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff594112dd0 con 0x7ff594102dc0 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff59a3bc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff594112c50 con 0x7ff5941087d0 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff59a3bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff594112f50 con 0x7ff594109150 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff594199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff594199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56824/0 (socket says 172.21.15.19:56824) 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 -- 172.21.15.19:0/166009502 learned_addr learned my addr 172.21.15.19:0/166009502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff598959640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff594109150 0x7ff59419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff5937fe640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5941087d0 0x7ff594199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 -- 172.21.15.19:0/166009502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff594109150 msgr2=0x7ff59419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff594109150 0x7ff59419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 -- 172.21.15.19:0/166009502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5941087d0 msgr2=0x7ff594199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5941087d0 0x7ff594199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 -- 172.21.15.19:0/166009502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59419f2d0 con 0x7ff594102dc0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.892+0000 7ff593fff640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff594199220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff584005940 tx=0x7ff5840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.893+0000 7ff5917fa640 1 -- 172.21.15.19:0/166009502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58403f030 con 0x7ff594102dc0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.893+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59419f560 con 0x7ff594102dc0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.893+0000 7ff5917fa640 1 -- 172.21.15.19:0/166009502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff584003cb0 con 0x7ff594102dc0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.893+0000 7ff5917fa640 1 -- 172.21.15.19:0/166009502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584035070 con 0x7ff594102dc0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.893+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5941a5c80 con 0x7ff594102dc0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.895+0000 7ff5917fa640 1 -- 172.21.15.19:0/166009502 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7ff58403bbf0 con 0x7ff594102dc0 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.895+0000 7ff59c791740 1 Processor -- start 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.895+0000 7ff59c791740 1 -- start start 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff59c791740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d41214a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff59c791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d4121560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff59c791740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4121565e0 0x55d4121589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff59c791740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d4120c1c10 con 0x55d412149d30 2024-09-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff59c791740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d4120b1040 con 0x55d4121565e0 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff59c791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d4120b4e50 con 0x55d41214a650 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d41214a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d41214a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56834/0 (socket says 172.21.15.19:56834) 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 -- 172.21.15.19:0/306782261 learned_addr learned my addr 172.21.15.19:0/306782261 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff593fff640 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d4121560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff5937fe640 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4121565e0 0x55d4121589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 -- 172.21.15.19:0/306782261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 msgr2=0x55d4121560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d4121560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 -- 172.21.15.19:0/306782261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4121565e0 msgr2=0x55d4121589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4121565e0 0x55d4121589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 -- 172.21.15.19:0/306782261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d411e0f540 con 0x55d412149d30 2024-09-11T00:02:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff5937fe640 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4121565e0 0x55d4121589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff5917fa640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff57c0b5330 0x7ff57c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff593fff640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff57c0b5330 0x7ff57c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff598959640 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d41214a110 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0103a0 tx=0x7ff58c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48910d7433d19090 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff5917fa640 1 -- 172.21.15.19:0/166009502 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7ff584106850 con 0x7ff594102dc0 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.896+0000 7ff57a7fc640 1 -- 172.21.15.19:0/306782261 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c016070 con 0x55d412149d30 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff57a7fc640 1 -- 172.21.15.19:0/306782261 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff58c004d20 con 0x55d412149d30 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff57a7fc640 1 -- 172.21.15.19:0/306782261 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c005420 con 0x55d412149d30 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 -- 172.21.15.19:0/306782261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 msgr2=0x55d41214a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff593fff640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff57c0b5330 0x7ff57c0b77f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff584104620 tx=0x7ff5840045a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d41214a110 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0103a0 tx=0x7ff58c010860 comp rx=0 tx=0).stop 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 -- 172.21.15.19:0/306782261 shutdown_connections 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4121565e0 0x55d4121589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d4121560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 --2- 172.21.15.19:0/306782261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d41214a110 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 -- 172.21.15.19:0/306782261 >> 172.21.15.19:0/306782261 conn(0x55d412147b60 msgr2=0x55d412148d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 -- 172.21.15.19:0/306782261 shutdown_connections 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.897+0000 7ff59c791740 1 -- 172.21.15.19:0/306782261 wait complete. 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 -- start start 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 Processor -- start 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d412153620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d41214a650 0x55d412153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4121565e0 0x55d4121540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d411f125f0 con 0x55d412149d30 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d41204c010 con 0x55d41214a650 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d412159290 con 0x55d4121565e0 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff59c791740 10 client.0 _ll_register_callbacks cb 0x55d4120ab340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:22.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d412153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d412153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56840/0 (socket says 172.21.15.19:56840) 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 -- 172.21.15.19:0/3554976932 learned_addr learned my addr 172.21.15.19:0/3554976932 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4121565e0 0x55d4121540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff5937fe640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d41214a650 0x55d412153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 -- 172.21.15.19:0/3554976932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4121565e0 msgr2=0x55d4121540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4121565e0 0x55d4121540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 -- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d41214a650 msgr2=0x55d412153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d41214a650 0x55d412153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.898+0000 7ff598959640 1 -- 172.21.15.19:0/3554976932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d412079a00 con 0x55d412149d30 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff5937fe640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d41214a650 0x55d412153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff598959640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d412153620 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff58c012ed0 tx=0x7ff58c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf709df177630dde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:22.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff5737fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff5737fe640 1 -- 172.21.15.19:0/3554976932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c016070 con 0x55d412149d30 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff5737fe640 1 -- 172.21.15.19:0/3554976932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7ff58c022040 con 0x55d412149d30 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff58c004d20 con 0x55d412149d30 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff5737fe640 1 -- 172.21.15.19:0/3554976932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff58c003d90 con 0x55d412149d30 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff59c791740 10 client.15315 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d412164e40 con 0x55d412149d30 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff5737fe640 1 -- 172.21.15.19:0/3554976932 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff58c004d20 con 0x55d412149d30 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff5737fe640 1 -- 172.21.15.19:0/3554976932 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff58c025070 con 0x55d412149d30 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff59c791740 10 client.15315 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff59c791740 10 client.15315 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff59c791740 20 client.15315 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.899+0000 7ff59c791740 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d412167010 0x55d412168480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.900+0000 7ff59c791740 4 client.15315 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.900+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4120c3b60 con 0x55d412167010 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.900+0000 7ff5937fe640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d412167010 0x55d412168480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.900+0000 7ff5737fe640 10 client.15315 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.900+0000 7ff5937fe640 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d412167010 0x55d412168480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=843db1cb4bd298de server_cookie=a4e8e7a3d9de561b in_seq=0 out_seq=0 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff5737fe640 1 -- 172.21.15.19:0/3554976932 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4120c3b60 con 0x55d412167010 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff5737fe640 10 client.15315 handle_command_reply: tid=0 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 client.15315 shutdown 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 msgr2=0x55d412153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d412153620 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff58c012ed0 tx=0x7ff58c005c50 comp rx=0 tx=0).stop 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 shutdown_connections 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d412167010 0x55d412168480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4121565e0 0x55d4121540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d41214a650 0x55d412153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff5737fe640 0 client.15315 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:22.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 --2- 172.21.15.19:0/3554976932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d412149d30 0x55d412153620 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 >> 172.21.15.19:0/3554976932 conn(0x55d412147b60 msgr2=0x55d41214d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:22.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 shutdown_connections 2024-09-11T00:02:22.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 1 -- 172.21.15.19:0/3554976932 wait complete. 2024-09-11T00:02:22.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.901+0000 7ff59c791740 20 client.15315 trim_cache size 0 max 16384 2024-09-11T00:02:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.919+0000 7ff59c791740 1 Processor -- start 2024-09-11T00:02:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.919+0000 7ff59c791740 1 -- start start 2024-09-11T00:02:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff59c791740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41214def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff59c791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d412152b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff59c791740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d412151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff59c791740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d4121667c0 con 0x55d4121565e0 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff59c791740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d412166e90 con 0x55d412149d30 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff59c791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d412167560 con 0x55d41214a650 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d412151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d412151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56848/0 (socket says 172.21.15.19:56848) 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 -- 172.21.15.19:0/2336417179 learned_addr learned my addr 172.21.15.19:0/2336417179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41214def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 -- 172.21.15.19:0/2336417179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 msgr2=0x55d412152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff5937fe640 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d412152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d412152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 -- 172.21.15.19:0/2336417179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 msgr2=0x55d41214def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41214def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 -- 172.21.15.19:0/2336417179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4121485e0 con 0x55d4121565e0 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff5937fe640 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d412152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff598959640 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d412151ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff58c004bb0 tx=0x7ff58c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedc139e29aa4639 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff579ffb640 1 -- 172.21.15.19:0/2336417179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c016070 con 0x55d4121565e0 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff579ffb640 1 -- 172.21.15.19:0/2336417179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff58c039070 con 0x55d4121565e0 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.920+0000 7ff579ffb640 1 -- 172.21.15.19:0/2336417179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0129c0 con 0x55d4121565e0 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 -- 172.21.15.19:0/2336417179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 msgr2=0x55d412151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d412151ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff58c004bb0 tx=0x7ff58c0021f0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 -- 172.21.15.19:0/2336417179 shutdown_connections 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d412151ea0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d412152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 --2- 172.21.15.19:0/2336417179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41214def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 -- 172.21.15.19:0/2336417179 >> 172.21.15.19:0/2336417179 conn(0x55d412147b60 msgr2=0x55d41214e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 -- 172.21.15.19:0/2336417179 shutdown_connections 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 -- 172.21.15.19:0/2336417179 wait complete. 2024-09-11T00:02:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.921+0000 7ff59c791740 1 -- start start 2024-09-11T00:02:22.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 1 Processor -- start 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41216a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d41216ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d41216b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d412168300 con 0x55d4121565e0 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d412167c30 con 0x55d412149d30 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d4121689d0 con 0x55d41214a650 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff59c791740 10 client.0 _ll_register_callbacks cb 0x7ff58c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d41216b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d41216b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56860/0 (socket says 172.21.15.19:56860) 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 -- 172.21.15.19:0/2214202467 learned_addr learned my addr 172.21.15.19:0/2214202467 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff5937fe640 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d41216ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41216a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 -- 172.21.15.19:0/2214202467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 msgr2=0x55d41216ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d41216ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 -- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 msgr2=0x55d41216a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41216a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.922+0000 7ff598959640 1 -- 172.21.15.19:0/2214202467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4121702b0 con 0x55d4121565e0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff598959640 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d41216b350 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff58c003b50 tx=0x7ff58c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bccc0bc2fd7a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff5737fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff5737fe640 1 -- 172.21.15.19:0/2214202467 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c016070 con 0x55d4121565e0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff5737fe640 1 -- 172.21.15.19:0/2214202467 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7ff58c012510 con 0x55d4121565e0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff58c039070 con 0x55d4121565e0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff5737fe640 1 -- 172.21.15.19:0/2214202467 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff58c012710 con 0x55d4121565e0 2024-09-11T00:02:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 10 client.15321 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d4121d3df0 con 0x55d4121565e0 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff5737fe640 1 -- 172.21.15.19:0/2214202467 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff58c039070 con 0x55d4121565e0 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff5737fe640 1 -- 172.21.15.19:0/2214202467 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff58c025050 con 0x55d4121565e0 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 10 client.15321 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 10 client.15321 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 20 client.15321 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d4121d8540 0x55d4121d7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 4 client.15321 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.923+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "status"}) -- 0x55d4120bf610 con 0x55d4121d8540 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.924+0000 7ff5937fe640 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d4121d8540 0x55d4121d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.924+0000 7ff5737fe640 10 client.15321 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.924+0000 7ff5937fe640 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d4121d8540 0x55d4121d7250 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f768561de83e0e96 server_cookie=28c9a8347b5e29d0 in_seq=0 out_seq=0 2024-09-11T00:02:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.924+0000 7ff5737fe640 1 -- 172.21.15.19:0/2214202467 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d4120bf610 con 0x55d4121d8540 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.924+0000 7ff5737fe640 10 client.15321 handle_command_reply: tid=0 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.924+0000 7ff59c791740 1 client.15321 shutdown 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 msgr2=0x55d41216b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d41216b350 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff58c003b50 tx=0x7ff58c0047f0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 shutdown_connections 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d4121d8540 0x55d4121d7250 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4121565e0 0x55d41216b350 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d41214a650 0x55d41216ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 --2- 172.21.15.19:0/2214202467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d412149d30 0x55d41216a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 >> 172.21.15.19:0/2214202467 conn(0x55d412147b60 msgr2=0x55d412154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff5737fe640 0 client.15321 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 shutdown_connections 2024-09-11T00:02:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 1 -- 172.21.15.19:0/2214202467 wait complete. 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59c791740 20 client.15321 trim_cache size 0 max 16384 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24605, 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-11T00:02:22.933 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 105.640093978, 2024-09-11T00:02:22.934 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-11T00:02:22.934 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 78, 2024-09-11T00:02:22.934 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 76, 2024-09-11T00:02:22.934 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 122.88442409300001 2024-09-11T00:02:22.934 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff57c0b5330 msgr2=0x7ff57c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff57c0b5330 0x7ff57c0b77f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff584104620 tx=0x7ff5840045a0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 msgr2=0x7ff594199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff594199220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff584005940 tx=0x7ff5840042f0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 shutdown_connections 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff594109150 0x7ff59419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5941087d0 0x7ff594199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff57c0b5330 0x7ff57c0b77f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 --2- 172.21.15.19:0/166009502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594102dc0 0x7ff594199220 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.925+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 >> 172.21.15.19:0/166009502 conn(0x7ff5940fe830 msgr2=0x7ff594100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.926+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 shutdown_connections 2024-09-11T00:02:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:22.926+0000 7ff59a3bc640 1 -- 172.21.15.19:0/166009502 wait complete. 2024-09-11T00:02:23.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T00:02:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:24.349 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:24 smithi019 ceph-mon[30859]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:02:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:24 smithi135 ceph-mon[35432]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:02:24.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.431+0000 7f9e1836d640 1 -- 172.21.15.19:0/372401082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10104600 msgr2=0x7f9e1010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.431+0000 7f9e1836d640 1 --2- 172.21.15.19:0/372401082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10104600 0x7f9e1010caf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009900 tx=0x7f9e0002a410 comp rx=0 tx=0).stop 2024-09-11T00:02:24.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 -- 172.21.15.19:0/372401082 shutdown_connections 2024-09-11T00:02:24.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 --2- 172.21.15.19:0/372401082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e1010d140 0x7f9e1010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 --2- 172.21.15.19:0/372401082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10104600 0x7f9e1010caf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 --2- 172.21.15.19:0/372401082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e10103ce0 0x7f9e101040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 -- 172.21.15.19:0/372401082 >> 172.21.15.19:0/372401082 conn(0x7f9e100fd720 msgr2=0x7f9e100ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 -- 172.21.15.19:0/372401082 shutdown_connections 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 -- 172.21.15.19:0/372401082 wait complete. 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 Processor -- start 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.432+0000 7f9e1836d640 1 -- start start 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10103ce0 0x7f9e101992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e10104600 0x7f9e10199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e1010d140 0x7f9e1019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e10112db0 con 0x7f9e10103ce0 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e10112c30 con 0x7f9e10104600 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e10112f30 con 0x7f9e1010d140 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10103ce0 0x7f9e101992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10103ce0 0x7f9e101992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56870/0 (socket says 172.21.15.19:56870) 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 -- 172.21.15.19:0/3156455810 learned_addr learned my addr 172.21.15.19:0/3156455810 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e15908640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e10104600 0x7f9e10199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1690a640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e1010d140 0x7f9e1019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 -- 172.21.15.19:0/3156455810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e1010d140 msgr2=0x7f9e1019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e1010d140 0x7f9e1019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 -- 172.21.15.19:0/3156455810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e10104600 msgr2=0x7f9e10199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e10104600 0x7f9e10199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 -- 172.21.15.19:0/3156455810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1019f3a0 con 0x7f9e10103ce0 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e15908640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e10104600 0x7f9e10199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1690a640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e1010d140 0x7f9e1019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e16109640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10103ce0 0x7f9e101992f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00d770 tx=0x7f9e0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e077fe640 1 -- 172.21.15.19:0/3156455810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c017070 con 0x7f9e10103ce0 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e077fe640 1 -- 172.21.15.19:0/3156455810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e0c0054d0 con 0x7f9e10103ce0 2024-09-11T00:02:24.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1019f690 con 0x7f9e10103ce0 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e077fe640 1 -- 172.21.15.19:0/3156455810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c004c30 con 0x7f9e10103ce0 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.433+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e101a5d50 con 0x7f9e10103ce0 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 Processor -- start 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e077fe640 1 -- 172.21.15.19:0/3156455810 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f9e0c004e10 con 0x7f9e10103ce0 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 -- start start 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee707f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707f650 0x55cee708b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee708b5e0 0x55cee708d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cee6ff6c10 con 0x55cee707f650 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cee6fe6040 con 0x55cee707ed30 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.436+0000 7f9e1a742740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee6fe9e50 con 0x55cee708b5e0 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707f650 0x55cee708b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707f650 0x55cee708b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56876/0 (socket says 172.21.15.19:56876) 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 -- 172.21.15.19:0/2097800775 learned_addr learned my addr 172.21.15.19:0/2097800775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e1690a640 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee707f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e15908640 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee708b5e0 0x55cee708d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 -- 172.21.15.19:0/2097800775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee708b5e0 msgr2=0x55cee708d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee708b5e0 0x55cee708d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 -- 172.21.15.19:0/2097800775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 msgr2=0x55cee707f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee707f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 -- 172.21.15.19:0/2097800775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee6d44540 con 0x55cee707f650 2024-09-11T00:02:24.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e16109640 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707f650 0x55cee708b0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0ebd20 tx=0x7f9e0c0ebe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bd0dcd5ab7e8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e077fe640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9dfc0b53b0 0x7f9dfc0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.437+0000 7f9e1690a640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9dfc0b53b0 0x7f9dfc0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e04de6640 1 -- 172.21.15.19:0/2097800775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0a8570 con 0x55cee707f650 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e04de6640 1 -- 172.21.15.19:0/2097800775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e0c0f2070 con 0x55cee707f650 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e04de6640 1 -- 172.21.15.19:0/2097800775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0ab690 con 0x55cee707f650 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e077fe640 1 -- 172.21.15.19:0/3156455810 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9e0c0e5800 con 0x7f9e10103ce0 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1a742740 1 -- 172.21.15.19:0/2097800775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707f650 msgr2=0x55cee708b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1690a640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9dfc0b53b0 0x7f9dfc0b7870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9e08005fd0 tx=0x7f9e08009700 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707f650 0x55cee708b0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0ebd20 tx=0x7f9e0c0ebe10 comp rx=0 tx=0).stop 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1a742740 1 -- 172.21.15.19:0/2097800775 shutdown_connections 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee708b5e0 0x55cee708d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707f650 0x55cee708b0a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2097800775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee707f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.438+0000 7f9e1a742740 1 -- 172.21.15.19:0/2097800775 >> 172.21.15.19:0/2097800775 conn(0x55cee707cb60 msgr2=0x55cee707dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 -- 172.21.15.19:0/2097800775 shutdown_connections 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 -- 172.21.15.19:0/2097800775 wait complete. 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 -- start start 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 Processor -- start 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707ed30 0x55cee7088580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee7088ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee708b5e0 0x55cee7089000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cee6e475f0 con 0x55cee707ed30 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cee6f81010 con 0x55cee708b5e0 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee708e290 con 0x55cee707f650 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e16109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707ed30 0x55cee7088580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e16109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707ed30 0x55cee7088580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56880/0 (socket says 172.21.15.19:56880) 2024-09-11T00:02:24.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e1a742740 10 client.0 _ll_register_callbacks cb 0x55cee6fe0340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.439+0000 7f9e16109640 1 -- 172.21.15.19:0/489732443 learned_addr learned my addr 172.21.15.19:0/489732443 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e15908640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee7088ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e1690a640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee708b5e0 0x55cee7089000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e16109640 1 -- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 msgr2=0x55cee7088ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e16109640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee7088ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e16109640 1 -- 172.21.15.19:0/489732443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee708b5e0 msgr2=0x55cee7089000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e16109640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee708b5e0 0x55cee7089000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e16109640 1 -- 172.21.15.19:0/489732443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee6faea00 con 0x55cee707ed30 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e15908640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee7088ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e1690a640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee708b5e0 0x55cee7089000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e16109640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707ed30 0x55cee7088580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00d740 tx=0x7f9e0c010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768daf07c587722a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9df9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:24.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9df9ffb640 1 -- 172.21.15.19:0/489732443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c020020 con 0x55cee707ed30 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9df9ffb640 1 -- 172.21.15.19:0/489732443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9e0c009c30 con 0x55cee707ed30 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e0c0f2070 con 0x55cee707ed30 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9df9ffb640 1 -- 172.21.15.19:0/489732443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e0c0ab870 con 0x55cee707ed30 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e1a742740 10 client.15333 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cee7099e20 con 0x55cee707ed30 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.440+0000 7f9df9ffb640 1 -- 172.21.15.19:0/489732443 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e0c0f2070 con 0x55cee707ed30 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9df9ffb640 1 -- 172.21.15.19:0/489732443 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e0c0d1070 con 0x55cee707ed30 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e1a742740 10 client.15333 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e1a742740 10 client.15333 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e1a742740 20 client.15333 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e1a742740 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee709b170 0x55cee709d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e1a742740 4 client.15333 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cee6ff8b60 con 0x55cee709b170 2024-09-11T00:02:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e15908640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee709b170 0x55cee709d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9e15908640 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee709b170 0x55cee709d360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2f609ff8288af server_cookie=311743fa188349eb in_seq=0 out_seq=0 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.441+0000 7f9df9ffb640 10 client.15333 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9df9ffb640 1 -- 172.21.15.19:0/489732443 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cee6ff8b60 con 0x55cee709b170 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9df9ffb640 10 client.15333 handle_command_reply: tid=0 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 client.15333 shutdown 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707ed30 msgr2=0x55cee7088580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707ed30 0x55cee7088580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00d740 tx=0x7f9e0c010f20 comp rx=0 tx=0).stop 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 shutdown_connections 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee708b5e0 0x55cee7089000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee7088ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee709b170 0x55cee709d360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 --2- 172.21.15.19:0/489732443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee707ed30 0x55cee7088580 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 >> 172.21.15.19:0/489732443 conn(0x55cee707cb60 msgr2=0x55cee7082700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:24.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9df9ffb640 0 client.15333 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 shutdown_connections 2024-09-11T00:02:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.442+0000 7f9e1a742740 1 -- 172.21.15.19:0/489732443 wait complete. 2024-09-11T00:02:24.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.443+0000 7f9e1a742740 20 client.15333 trim_cache size 0 max 16384 2024-09-11T00:02:24.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.467+0000 7f9e1a742740 1 Processor -- start 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.467+0000 7f9e1a742740 1 -- start start 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.467+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee709d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70838c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee7089340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1a742740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cee709b6a0 con 0x55cee708b5e0 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1a742740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cee709bd70 con 0x55cee707ed30 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1a742740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee709c440 con 0x55cee707f650 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee7089340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee7089340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56896/0 (socket says 172.21.15.19:56896) 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 -- 172.21.15.19:0/279003053 learned_addr learned my addr 172.21.15.19:0/279003053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:24.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e16109640 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee709d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e15908640 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70838c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 -- 172.21.15.19:0/279003053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 msgr2=0x55cee70838c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70838c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 -- 172.21.15.19:0/279003053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 msgr2=0x55cee709d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee709d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 -- 172.21.15.19:0/279003053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee707d5e0 con 0x55cee708b5e0 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e16109640 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee709d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9e1690a640 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee7089340 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e08013fd0 tx=0x7f9e08015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced7482e742e0d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9dfbfff640 1 -- 172.21.15.19:0/279003053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08027640 con 0x55cee708b5e0 2024-09-11T00:02:24.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9dfbfff640 1 -- 172.21.15.19:0/279003053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e0801d8b0 con 0x55cee708b5e0 2024-09-11T00:02:24.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.468+0000 7f9dfbfff640 1 -- 172.21.15.19:0/279003053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0801c960 con 0x55cee708b5e0 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 -- 172.21.15.19:0/279003053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 msgr2=0x55cee7089340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee7089340 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e08013fd0 tx=0x7f9e08015000 comp rx=0 tx=0).stop 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 -- 172.21.15.19:0/279003053 shutdown_connections 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee7089340 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70838c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 --2- 172.21.15.19:0/279003053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee709d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 -- 172.21.15.19:0/279003053 >> 172.21.15.19:0/279003053 conn(0x55cee707cb60 msgr2=0x55cee7089bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 -- 172.21.15.19:0/279003053 shutdown_connections 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.469+0000 7f9e1a742740 1 -- 172.21.15.19:0/279003053 wait complete. 2024-09-11T00:02:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 -- start start 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 Processor -- start 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee70a0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee70a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cee709d1e0 con 0x55cee708b5e0 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cee709cb10 con 0x55cee707ed30 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee709d8b0 con 0x55cee707f650 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1a742740 10 client.0 _ll_register_callbacks cb 0x7f9e080095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee70a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee70a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56906/0 (socket says 172.21.15.19:56906) 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 -- 172.21.15.19:0/2623862100 learned_addr learned my addr 172.21.15.19:0/2623862100 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e15908640 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e16109640 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee70a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 -- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 msgr2=0x55cee70a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 -- 172.21.15.19:0/2623862100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 msgr2=0x55cee70a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee70a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.470+0000 7f9e1690a640 1 -- 172.21.15.19:0/2623862100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee70a59b0 con 0x55cee708b5e0 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1690a640 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee70a5470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9e0801c440 tx=0x7f9e0801d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2b6ea37e2e638e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9df9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9df9ffb640 1 -- 172.21.15.19:0/2623862100 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0801dc70 con 0x55cee708b5e0 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9df9ffb640 1 -- 172.21.15.19:0/2623862100 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9e0801c5e0 con 0x55cee708b5e0 2024-09-11T00:02:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e0801d8b0 con 0x55cee708b5e0 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9df9ffb640 1 -- 172.21.15.19:0/2623862100 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e0801c7e0 con 0x55cee708b5e0 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 10 client.15339 fetch_fsmap learned FSMap version 24 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cee7109070 con 0x55cee708b5e0 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9df9ffb640 1 -- 172.21.15.19:0/2623862100 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e0801d8b0 con 0x55cee708b5e0 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9df9ffb640 1 -- 172.21.15.19:0/2623862100 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e08025070 con 0x55cee708b5e0 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 10 client.15339 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 10 client.15339 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 20 client.15339 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee710da90 0x55cee710c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 4 client.15339 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.471+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "status"}) -- 0x55cee6ff4610 con 0x55cee710da90 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e16109640 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee710da90 0x55cee710c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9df9ffb640 10 client.15339 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e16109640 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee710da90 0x55cee710c7a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=479adf407303da31 server_cookie=1bea284c644f29e6 in_seq=0 out_seq=0 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9df9ffb640 1 -- 172.21.15.19:0/2623862100 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x7f9e0c0f2150 con 0x55cee710da90 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9df9ffb640 10 client.15339 handle_command_reply: tid=0 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e1a742740 1 client.15339 shutdown 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 msgr2=0x55cee70a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee70a5470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9e0801c440 tx=0x7f9e0801d6b0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 shutdown_connections 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55cee710da90 0x55cee710c7a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cee708b5e0 0x55cee70a5470 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.472+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee707f650 0x55cee70a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9df9ffb640 0 client.15339 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1a742740 1 --2- 172.21.15.19:0/2623862100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee707ed30 0x55cee70a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 >> 172.21.15.19:0/2623862100 conn(0x55cee707cb60 msgr2=0x55cee7096d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 shutdown_connections 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1a742740 1 -- 172.21.15.19:0/2623862100 wait complete. 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1a742740 20 client.15339 trim_cache size 0 max 16384 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "8be8ba00-6fcf-11ef-bcea-c7b262605968", 2024-09-11T00:02:24.481 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24625, 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 115.230428551, 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 78, 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 76, 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 134.57339604000001 2024-09-11T00:02:24.482 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9dfc0b53b0 msgr2=0x7f9dfc0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9dfc0b53b0 0x7f9dfc0b7870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9e08005fd0 tx=0x7f9e08009700 comp rx=0 tx=0).stop 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10103ce0 msgr2=0x7f9e101992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10103ce0 0x7f9e101992f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00d770 tx=0x7f9e0c00dc30 comp rx=0 tx=0).stop 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 shutdown_connections 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e1010d140 0x7f9e1019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e10104600 0x7f9e10199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9dfc0b53b0 0x7f9dfc0b7870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 --2- 172.21.15.19:0/3156455810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e10103ce0 0x7f9e101992f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 >> 172.21.15.19:0/3156455810 conn(0x7f9e100fd720 msgr2=0x7f9e100fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 shutdown_connections 2024-09-11T00:02:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:24.473+0000 7f9e1836d640 1 -- 172.21.15.19:0/3156455810 wait complete. 2024-09-11T00:02:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:24 smithi131 ceph-mon[35491]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:02:25.283 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T00:02:25.332 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T00:02:25.332 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T00:02:25.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:25.333 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-11T00:02:25.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:25.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-11T00:02:25.423 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-09-11T00:02:25.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:02:25.425 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-11T00:02:25.425 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:02:25.425 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:25.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T00:02:25.726 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:26.142 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:26 smithi019 ceph-mon[30859]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:02:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.223+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1984590545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0109130 msgr2=0x7f75c010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.223+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1984590545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0109130 0x7f75c010f930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009ca0 tx=0x7f75b802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.223+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1984590545 shutdown_connections 2024-09-11T00:02:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.223+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1984590545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0109130 0x7f75c010f930 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.223+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1984590545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01087b0 0x7f75c0108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.223+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1984590545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c0102da0 0x7f75c0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.223+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1984590545 >> 172.21.15.19:0/1984590545 conn(0x7f75c00fe850 msgr2=0x7f75c0100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.224+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1984590545 shutdown_connections 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.224+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1984590545 wait complete. 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.224+0000 7f75c6eb1640 1 Processor -- start 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.224+0000 7f75c6eb1640 1 -- start start 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.224+0000 7f75c6eb1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0102da0 0x7f75c00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.224+0000 7f75c6eb1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01087b0 0x7f75c00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.224+0000 7f75c6eb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c0109130 0x7f75c0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c6eb1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0112df0 con 0x7f75c0102da0 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c6eb1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0112c70 con 0x7f75c01087b0 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c6eb1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0112f70 con 0x7f75c0109130 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c4c4d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0102da0 0x7f75c00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c4c4d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0102da0 0x7f75c00754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56938/0 (socket says 172.21.15.19:56938) 2024-09-11T00:02:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c4c4d640 1 -- 172.21.15.19:0/1291640717 learned_addr learned my addr 172.21.15.19:0/1291640717 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75bffff640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01087b0 0x7f75c00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c544e640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c0109130 0x7f75c0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75bffff640 1 -- 172.21.15.19:0/1291640717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c0109130 msgr2=0x7f75c0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75bffff640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c0109130 0x7f75c0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75bffff640 1 -- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0102da0 msgr2=0x7f75c00754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75bffff640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0102da0 0x7f75c00754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75bffff640 1 -- 172.21.15.19:0/1291640717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c01a7620 con 0x7f75c01087b0 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75c4c4d640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0102da0 0x7f75c00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.225+0000 7f75bffff640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01087b0 0x7f75c00759e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00e9f0 tx=0x7f75ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.226+0000 7f75bdffb640 1 -- 172.21.15.19:0/1291640717 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00ccc0 con 0x7f75c01087b0 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.226+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c01a7910 con 0x7f75c01087b0 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.226+0000 7f75bdffb640 1 -- 172.21.15.19:0/1291640717 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ac0108e0 con 0x7f75c01087b0 2024-09-11T00:02:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.226+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c01a7ea0 con 0x7f75c01087b0 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.226+0000 7f75bdffb640 1 -- 172.21.15.19:0/1291640717 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac018750 con 0x7f75c01087b0 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.227+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a40052c0 con 0x7f75c01087b0 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.228+0000 7f75bdffb640 1 -- 172.21.15.19:0/1291640717 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f75ac010430 con 0x7f75c01087b0 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.229+0000 7f75bdffb640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f75b00b53b0 0x7f75b00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.229+0000 7f75c4c4d640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f75b00b53b0 0x7f75b00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.229+0000 7f75bdffb640 1 -- 172.21.15.19:0/1291640717 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f75ac0e5cf0 con 0x7f75c01087b0 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.230+0000 7f75c4c4d640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f75b00b53b0 0x7f75b00b7870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f75b4011500 tx=0x7f75b4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.232+0000 7f75bdffb640 1 -- 172.21.15.19:0/1291640717 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f75ac0ac4c0 con 0x7f75c01087b0 2024-09-11T00:02:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:26 smithi135 ceph-mon[35432]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:02:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.458+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f75a4005880 con 0x7f75c01087b0 2024-09-11T00:02:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.459+0000 7f75bdffb640 1 -- 172.21.15.19:0/1291640717 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f75ac0b0ef0 con 0x7f75c01087b0 2024-09-11T00:02:26.461 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:02:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f75b00b53b0 msgr2=0x7f75b00b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f75b00b53b0 0x7f75b00b7870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f75b4011500 tx=0x7f75b4005f90 comp rx=0 tx=0).stop 2024-09-11T00:02:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01087b0 msgr2=0x7f75c00759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01087b0 0x7f75c00759e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00e9f0 tx=0x7f75ac00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 shutdown_connections 2024-09-11T00:02:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c0109130 0x7f75c0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01087b0 0x7f75c00759e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f75b00b53b0 0x7f75b00b7870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 --2- 172.21.15.19:0/1291640717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75c0102da0 0x7f75c00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 >> 172.21.15.19:0/1291640717 conn(0x7f75c00fe850 msgr2=0x7f75c0100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 shutdown_connections 2024-09-11T00:02:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:26.461+0000 7f75c6eb1640 1 -- 172.21.15.19:0/1291640717 wait complete. 2024-09-11T00:02:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:26 smithi131 ceph-mon[35491]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T00:02:27.283 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:02:27.283 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:02:27.283 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-11T00:02:27.283 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:02:27.283 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:27.284 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:02:27.284 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:02:27.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:02:27.284 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:02:27.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:27.284 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-11T00:02:27.303 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:02:27.303 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:02:27.303 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:02:27.303 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:02:27.303 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-11T00:02:27.303 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:02:27.303 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:02:27.304 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:02:27.304 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-11T00:02:27.304 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:02:27.304 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:02:27.304 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-11T00:02:27.304 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42096sec preferred_lft 42096sec 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-11T00:02:27.305 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-11T00:02:27.306 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:02:27.306 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:02:27.306 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-11T00:02:27.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:02:27.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-09-11T00:02:27.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-09-11T00:02:27.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:02:27.306 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-11T00:02:27.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:02:27.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:27 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1291640717' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T00:02:27.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:27 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1291640717' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T00:02:27.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:27.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:27.512 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:02:27.537 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-11T00:02:27.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:27.539 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-11T00:02:27.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:27 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1291640717' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T00:02:27.610 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-11T00:02:27.611 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:02:27.611 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T00:02:27.611 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T00:02:27.611 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:02:27.611 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:02:27.611 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-11T00:02:27.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T00:02:27.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T00:02:27.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T00:02:27.612 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-11T00:02:27.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:02:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:27.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:27.897 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-11T00:02:27.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:27.914 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-11T00:02:27.970 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:02:27.970 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-11T00:02:27.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:02:27.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T00:02:27.971 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-11T00:02:28.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:02:28.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:28.090 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T00:02:28.090 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:02:28.090 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-11T00:02:28.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T00:02:28.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:02:28.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T00:02:28.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T00:02:28.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T00:02:28.091 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-11T00:02:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:02:28.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:28.241 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:02:28.241 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-11T00:02:28.241 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-11T00:02:28.241 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:02:28.242 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-11T00:02:28.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:02:28.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:28.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:02:28.322 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:28.338 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:02:28.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:02:28.338 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:28.394 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T00:02:28.394 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T00:02:28.394 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/1ebe79f0-92c6-4491-8575-597db5c1194b 2024-09-11T00:02:28.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:28.394 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/1ebe79f0-92c6-4491-8575-597db5c1194b /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-11T00:02:28.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:28 smithi135 ceph-mon[35432]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:28.456 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:28 smithi019 ceph-mon[30859]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:28.501 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-11T00:02:28.501 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-11T00:02:28.501 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-11T00:02:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:28 smithi131 ceph-mon[35491]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:28.635 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-11T00:02:28.635 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-11T00:02:28.635 INFO:teuthology.orchestra.run.smithi019.stdout:invalid new device string format 2024-09-11T00:02:28.636 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.131:3300,172.21.15.135:3300" 2024-09-11T00:02:28.636 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.19:3300,172.21.15.131:3300,172.21.15.135:3300:/volumes/qa/sv_1/1ebe79f0-92c6-4491-8575-597db5c1194b 2024-09-11T00:02:28.636 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=8be8ba00-6fcf-11ef-bcea-c7b262605968" will pass to kernel 2024-09-11T00:02:28.636 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T00:02:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-11T00:02:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T00:02:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T00:02:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T00:02:28.638 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T00:02:28.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:02:28.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:28.706 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:02:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:02:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:28.804 INFO:teuthology.orchestra.run.smithi019.stdout:client24994 2024-09-11T00:02:28.804 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-11T00:02:28.804 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:02:28.822 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:02:28.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:02:28.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:28.919 INFO:teuthology.orchestra.run.smithi019.stdout:client24994 2024-09-11T00:02:28.919 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:02:28.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:02:28.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:28.977 INFO:teuthology.orchestra.run.smithi019.stdout:client24994 2024-09-11T00:02:28.977 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968.client24994/status') 2024-09-11T00:02:29.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:02:29.037 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.24994 (3)172.21.15.19:0/3340749823 2024-09-11T00:02:29.037 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-09-11T00:02:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-09-11T00:02:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-09-11T00:02:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:71 bytes copied, 2.4363e-05 s, 2.9 MB/s 2024-09-11T00:02:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:02:29.045 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T00:02:29.081 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T00:02:29.081 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T00:02:29.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 -- 172.21.15.19:0/1064130117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac102010 msgr2=0x7f37ac1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/1064130117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac102010 0x7f37ac1023f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f379c009900 tx=0x7f379c02a410 comp rx=0 tx=0).stop 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 -- 172.21.15.19:0/1064130117 shutdown_connections 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/1064130117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37ac104d70 0x7f37ac10e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/1064130117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37ac1043d0 0x7f37ac104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/1064130117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac102010 0x7f37ac1023f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 -- 172.21.15.19:0/1064130117 >> 172.21.15.19:0/1064130117 conn(0x7f37ac077720 msgr2=0x7f37ac077b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 -- 172.21.15.19:0/1064130117 shutdown_connections 2024-09-11T00:02:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.186+0000 7f37b1c4f640 1 -- 172.21.15.19:0/1064130117 wait complete. 2024-09-11T00:02:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 Processor -- start 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 -- start start 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37ac102010 0x7f37ac199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac1043d0 0x7f37ac199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37ac104d70 0x7f37ac19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac111c00 con 0x7f37ac1043d0 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac111a80 con 0x7f37ac102010 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37b1c4f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac111d80 con 0x7f37ac104d70 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37aaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac1043d0 0x7f37ac199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.187+0000 7f37aaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac1043d0 0x7f37ac199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56948/0 (socket says 172.21.15.19:56948) 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37aaffd640 1 -- 172.21.15.19:0/3487483706 learned_addr learned my addr 172.21.15.19:0/3487483706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37ab7fe640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37ac102010 0x7f37ac199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37abfff640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37ac104d70 0x7f37ac19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37aaffd640 1 -- 172.21.15.19:0/3487483706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37ac104d70 msgr2=0x7f37ac19ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37aaffd640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37ac104d70 0x7f37ac19ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37aaffd640 1 -- 172.21.15.19:0/3487483706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37ac102010 msgr2=0x7f37ac199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37aaffd640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37ac102010 0x7f37ac199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37aaffd640 1 -- 172.21.15.19:0/3487483706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ac19f1d0 con 0x7f37ac1043d0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37abfff640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37ac104d70 0x7f37ac19ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37aaffd640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac1043d0 0x7f37ac199670 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c920 tx=0x7f37a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37a8ff9640 1 -- 172.21.15.19:0/3487483706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0007c70 con 0x7f37ac1043d0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37a8ff9640 1 -- 172.21.15.19:0/3487483706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37a0007e10 con 0x7f37ac1043d0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ac19f4c0 con 0x7f37ac1043d0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37a8ff9640 1 -- 172.21.15.19:0/3487483706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0018820 con 0x7f37ac1043d0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.188+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ac1a5d60 con 0x7f37ac1043d0 2024-09-11T00:02:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.189+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ac1023f0 con 0x7f37ac1043d0 2024-09-11T00:02:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.191+0000 7f37a8ff9640 1 -- 172.21.15.19:0/3487483706 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f37a000f450 con 0x7f37ac1043d0 2024-09-11T00:02:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.191+0000 7f37a8ff9640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37940b53b0 0x7f37940b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.192+0000 7f37ab7fe640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37940b53b0 0x7f37940b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.192+0000 7f37a8ff9640 1 -- 172.21.15.19:0/3487483706 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f37a00e6000 con 0x7f37ac1043d0 2024-09-11T00:02:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.192+0000 7f37ab7fe640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37940b53b0 0x7f37940b7870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f379c031440 tx=0x7f379c005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.194+0000 7f37a8ff9640 1 -- 172.21.15.19:0/3487483706 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f37a0014030 con 0x7f37ac1043d0 2024-09-11T00:02:29.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:29.419+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f37ac19a250 con 0x7f37ac1043d0 2024-09-11T00:02:30.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.107+0000 7f37a8ff9640 1 -- 172.21.15.19:0/3487483706 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f37a00acf30 con 0x7f37ac1043d0 2024-09-11T00:02:30.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37940b53b0 msgr2=0x7f37940b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37940b53b0 0x7f37940b7870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f379c031440 tx=0x7f379c005e80 comp rx=0 tx=0).stop 2024-09-11T00:02:30.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac1043d0 msgr2=0x7f37ac199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac1043d0 0x7f37ac199670 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c920 tx=0x7f37a000cde0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 shutdown_connections 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37ac104d70 0x7f37ac19ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f37940b53b0 0x7f37940b7870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac1043d0 0x7f37ac199670 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 --2- 172.21.15.19:0/3487483706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37ac102010 0x7f37ac199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 >> 172.21.15.19:0/3487483706 conn(0x7f37ac077720 msgr2=0x7f37ac06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 shutdown_connections 2024-09-11T00:02:30.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.110+0000 7f37b1c4f640 1 -- 172.21.15.19:0/3487483706 wait complete. 2024-09-11T00:02:30.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 -- 172.21.15.19:0/1670147047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8107f80 msgr2=0x7f5ca810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 --2- 172.21.15.19:0/1670147047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8107f80 0x7f5ca810e780 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009ca0 tx=0x7f5ca002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 -- 172.21.15.19:0/1670147047 shutdown_connections 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 --2- 172.21.15.19:0/1670147047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8107f80 0x7f5ca810e780 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 --2- 172.21.15.19:0/1670147047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca8107600 0x7f5ca8107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 --2- 172.21.15.19:0/1670147047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca8101c00 0x7f5ca8101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 -- 172.21.15.19:0/1670147047 >> 172.21.15.19:0/1670147047 conn(0x7f5ca80fd660 msgr2=0x7f5ca80ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:30.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 -- 172.21.15.19:0/1670147047 shutdown_connections 2024-09-11T00:02:30.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.237+0000 7f5cad7da640 1 -- 172.21.15.19:0/1670147047 wait complete. 2024-09-11T00:02:30.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 Processor -- start 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 -- start start 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8101c00 0x7f5ca8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca8107600 0x7f5ca8199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca8107f80 0x7f5ca819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8111c40 con 0x7f5ca8101c00 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8111ac0 con 0x7f5ca8107f80 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5cad7da640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8111dc0 con 0x7f5ca8107600 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5ca6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8101c00 0x7f5ca8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5ca6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8101c00 0x7f5ca8199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56968/0 (socket says 172.21.15.19:56968) 2024-09-11T00:02:30.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.238+0000 7f5ca6ffd640 1 -- 172.21.15.19:0/488420403 learned_addr learned my addr 172.21.15.19:0/488420403 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5c9e7fc640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca8107600 0x7f5ca8199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca77fe640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca8107f80 0x7f5ca819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca6ffd640 1 -- 172.21.15.19:0/488420403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca8107600 msgr2=0x7f5ca8199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca6ffd640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca8107600 0x7f5ca8199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca6ffd640 1 -- 172.21.15.19:0/488420403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca8107f80 msgr2=0x7f5ca819eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca6ffd640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca8107f80 0x7f5ca819eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca6ffd640 1 -- 172.21.15.19:0/488420403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca819f2e0 con 0x7f5ca8101c00 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca77fe640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca8107f80 0x7f5ca819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca6ffd640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8101c00 0x7f5ca8199240 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800d950 tx=0x7f5c9800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:30.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca4ff9640 1 -- 172.21.15.19:0/488420403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98017030 con 0x7f5ca8101c00 2024-09-11T00:02:30.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca4ff9640 1 -- 172.21.15.19:0/488420403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c98004020 con 0x7f5ca8101c00 2024-09-11T00:02:30.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca819f5d0 con 0x7f5ca8101c00 2024-09-11T00:02:30.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5ca4ff9640 1 -- 172.21.15.19:0/488420403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98005560 con 0x7f5ca8101c00 2024-09-11T00:02:30.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.239+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca81a5c90 con 0x7f5ca8101c00 2024-09-11T00:02:30.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.240+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca8102ea0 con 0x7f5ca8101c00 2024-09-11T00:02:30.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.242+0000 7f5ca4ff9640 1 -- 172.21.15.19:0/488420403 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f5c98009a30 con 0x7f5ca8101c00 2024-09-11T00:02:30.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.243+0000 7f5ca4ff9640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5c940b5330 0x7f5c940b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.243+0000 7f5c9e7fc640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5c940b5330 0x7f5c940b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.244+0000 7f5ca4ff9640 1 -- 172.21.15.19:0/488420403 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5c980e5cd0 con 0x7f5ca8101c00 2024-09-11T00:02:30.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.244+0000 7f5c9e7fc640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5c940b5330 0x7f5c940b77f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8103db0 tx=0x7f5c90009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.246+0000 7f5ca4ff9640 1 -- 172.21.15.19:0/488420403 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5c980acaf0 con 0x7f5ca8101c00 2024-09-11T00:02:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:30 smithi135 ceph-mon[35432]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:02:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:30 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3487483706' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-11T00:02:30.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.459+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f5ca8100230 con 0x7f5c940b5330 2024-09-11T00:02:30.466 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:30 smithi019 ceph-mon[30859]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:02:30.466 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:30 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3487483706' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-11T00:02:30.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.476+0000 7f5ca4ff9640 1 -- 172.21.15.19:0/488420403 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f5ca8100230 con 0x7f5c940b5330 2024-09-11T00:02:30.478 INFO:teuthology.orchestra.run.smithi019.stdout:{} 2024-09-11T00:02:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5c940b5330 msgr2=0x7f5c940b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5c940b5330 0x7f5c940b77f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8103db0 tx=0x7f5c90009110 comp rx=0 tx=0).stop 2024-09-11T00:02:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8101c00 msgr2=0x7f5ca8199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8101c00 0x7f5ca8199240 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800d950 tx=0x7f5c9800dd50 comp rx=0 tx=0).stop 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 shutdown_connections 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ca8107f80 0x7f5ca819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca8107600 0x7f5ca8199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5c940b5330 0x7f5c940b77f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 --2- 172.21.15.19:0/488420403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ca8101c00 0x7f5ca8199240 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 >> 172.21.15.19:0/488420403 conn(0x7f5ca80fd660 msgr2=0x7f5ca806b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 shutdown_connections 2024-09-11T00:02:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.479+0000 7f5cad7da640 1 -- 172.21.15.19:0/488420403 wait complete. 2024-09-11T00:02:30.491 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T00:02:30.639 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-11T00:02:30.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:02:30.657 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:30 smithi131 ceph-mon[35491]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:02:30.657 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:30 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3487483706' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-11T00:02:30.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 -- 172.21.15.19:0/877193373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 msgr2=0x7fdde010e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/877193373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde010e740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009900 tx=0x7fddd802a410 comp rx=0 tx=0).stop 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 -- 172.21.15.19:0/877193373 shutdown_connections 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/877193373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde010e740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/877193373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdde01075c0 0x7fdde0107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/877193373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdde0101fe0 0x7fdde01023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 -- 172.21.15.19:0/877193373 >> 172.21.15.19:0/877193373 conn(0x7fdde0077670 msgr2=0x7fdde0077a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 -- 172.21.15.19:0/877193373 shutdown_connections 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 -- 172.21.15.19:0/877193373 wait complete. 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 Processor -- start 2024-09-11T00:02:30.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.759+0000 7fdde5b2b640 1 -- start start 2024-09-11T00:02:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdde0101fe0 0x7fdde019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdde01075c0 0x7fdde019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde01a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0112d70 con 0x7fdde0107f40 2024-09-11T00:02:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0112bf0 con 0x7fdde01075c0 2024-09-11T00:02:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0112ef0 con 0x7fdde0101fe0 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde01a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde01a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57000/0 (socket says 172.21.15.19:57000) 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 -- 172.21.15.19:0/4077927846 learned_addr learned my addr 172.21.15.19:0/4077927846 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddeffd640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdde01075c0 0x7fdde019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddf7fe640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdde0101fe0 0x7fdde019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 -- 172.21.15.19:0/4077927846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdde0101fe0 msgr2=0x7fdde019b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdde0101fe0 0x7fdde019b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 -- 172.21.15.19:0/4077927846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdde01075c0 msgr2=0x7fdde019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdde01075c0 0x7fdde019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 -- 172.21.15.19:0/4077927846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde01a1410 con 0x7fdde0107f40 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddeffd640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdde01075c0 0x7fdde019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddffff640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde01a0c40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fddd8004770 tx=0x7fddd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddcff9640 1 -- 172.21.15.19:0/4077927846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd803f030 con 0x7fdde0107f40 2024-09-11T00:02:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde01a16a0 con 0x7fdde0107f40 2024-09-11T00:02:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddcff9640 1 -- 172.21.15.19:0/4077927846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddd8003aa0 con 0x7fdde0107f40 2024-09-11T00:02:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdddcff9640 1 -- 172.21.15.19:0/4077927846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8035070 con 0x7fdde0107f40 2024-09-11T00:02:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.760+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde01a7dc0 con 0x7fdde0107f40 2024-09-11T00:02:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.761+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde01023c0 con 0x7fdde0107f40 2024-09-11T00:02:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.763+0000 7fdddcff9640 1 -- 172.21.15.19:0/4077927846 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fddd80035f0 con 0x7fdde0107f40 2024-09-11T00:02:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.763+0000 7fdddcff9640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fddc80b5330 0x7fddc80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.764+0000 7fdddf7fe640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fddc80b5330 0x7fddc80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.764+0000 7fdddcff9640 1 -- 172.21.15.19:0/4077927846 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fddd8106a60 con 0x7fdde0107f40 2024-09-11T00:02:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.764+0000 7fdddf7fe640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fddc80b5330 0x7fddc80b77f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fddd0005fd0 tx=0x7fddd0009870 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:30.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.766+0000 7fdddcff9640 1 -- 172.21.15.19:0/4077927846 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fddd80cd880 con 0x7fdde0107f40 2024-09-11T00:02:30.772 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:02:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:02:30.464+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:02:30.772 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:02:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:02:30.464+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:02:30.772 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:02:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:02:30.464+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:02:30.772 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:02:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:02:30.464+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:02:30.773 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:02:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:02:30.464+0000 7f13a0147640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:02:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.955+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdde01a80c0 con 0x7fdde0107f40 2024-09-11T00:02:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.956+0000 7fdddcff9640 1 -- 172.21.15.19:0/4077927846 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22967 (secure 0 0 0) 0x7fddd80cd180 con 0x7fdde0107f40 2024-09-11T00:02:30.958 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:30.958 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:53.600623+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:02:30.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fddc80b5330 msgr2=0x7fddc80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fddc80b5330 0x7fddc80b77f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fddd0005fd0 tx=0x7fddd0009870 comp rx=0 tx=0).stop 2024-09-11T00:02:30.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 msgr2=0x7fdde01a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:30.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde01a0c40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fddd8004770 tx=0x7fddd8004270 comp rx=0 tx=0).stop 2024-09-11T00:02:30.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 shutdown_connections 2024-09-11T00:02:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fddc80b5330 0x7fddc80b77f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdde0107f40 0x7fdde01a0c40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdde01075c0 0x7fdde019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 --2- 172.21.15.19:0/4077927846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdde0101fe0 0x7fdde019b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 >> 172.21.15.19:0/4077927846 conn(0x7fdde0077670 msgr2=0x7fdde01033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 shutdown_connections 2024-09-11T00:02:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:30.959+0000 7fdde5b2b640 1 -- 172.21.15.19:0/4077927846 wait complete. 2024-09-11T00:02:30.971 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:55:46.863932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T00:00:24.308239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T00:00:26.972884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T00:02:30.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T00:02:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 -- 172.21.15.19:0/15592359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8102d00 msgr2=0x7f4bf81030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 --2- 172.21.15.19:0/15592359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8102d00 0x7f4bf81030e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009900 tx=0x7f4be802a410 comp rx=0 tx=0).stop 2024-09-11T00:02:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 -- 172.21.15.19:0/15592359 shutdown_connections 2024-09-11T00:02:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 --2- 172.21.15.19:0/15592359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf8109080 0x7f4bf810f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 --2- 172.21.15.19:0/15592359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf8108700 0x7f4bf8108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 --2- 172.21.15.19:0/15592359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8102d00 0x7f4bf81030e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 -- 172.21.15.19:0/15592359 >> 172.21.15.19:0/15592359 conn(0x7f4bf80fe740 msgr2=0x7f4bf8100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 -- 172.21.15.19:0/15592359 shutdown_connections 2024-09-11T00:02:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 -- 172.21.15.19:0/15592359 wait complete. 2024-09-11T00:02:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.077+0000 7f4bfd552640 1 Processor -- start 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bfd552640 1 -- start start 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bfd552640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf8102d00 0x7f4bf80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bfd552640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf8108700 0x7f4bf80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bfd552640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8109080 0x7f4bf8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bfd552640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8112d40 con 0x7f4bf8109080 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bfd552640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8112bc0 con 0x7f4bf8108700 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bfd552640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8112ec0 con 0x7f4bf8102d00 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8109080 0x7f4bf8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8109080 0x7f4bf8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57022/0 (socket says 172.21.15.19:57022) 2024-09-11T00:02:31.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 -- 172.21.15.19:0/4154876175 learned_addr learned my addr 172.21.15.19:0/4154876175 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf6ffd640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf8102d00 0x7f4bf80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bee7fc640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf8108700 0x7f4bf80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 -- 172.21.15.19:0/4154876175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf8102d00 msgr2=0x7f4bf80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf8102d00 0x7f4bf80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 -- 172.21.15.19:0/4154876175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf8108700 msgr2=0x7f4bf80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf8108700 0x7f4bf80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 -- 172.21.15.19:0/4154876175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf81a7610 con 0x7f4bf8109080 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf77fe640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8109080 0x7f4bf8075f20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000cce0 tx=0x7f4bf000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.078+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000f450 con 0x7f4bf8109080 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.079+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bf000faa0 con 0x7f4bf8109080 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.079+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf81a7900 con 0x7f4bf8109080 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.079+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0018b70 con 0x7f4bf8109080 2024-09-11T00:02:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.079+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf81a7e80 con 0x7f4bf8109080 2024-09-11T00:02:31.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.080+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf81030e0 con 0x7f4bf8109080 2024-09-11T00:02:31.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.081+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f4bf000f5f0 con 0x7f4bf8109080 2024-09-11T00:02:31.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.082+0000 7f4bf4ff9640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4be40b5330 0x7f4be40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.082+0000 7f4bf6ffd640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4be40b5330 0x7f4be40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.082+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f4bf00e6460 con 0x7f4bf8109080 2024-09-11T00:02:31.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.083+0000 7f4bf6ffd640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4be40b5330 0x7f4be40b77f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4be8031440 tx=0x7f4be8005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:31.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.086+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4bf0014030 con 0x7f4bf8109080 2024-09-11T00:02:31.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.125+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f4bf00a8d90 con 0x7f4bf8109080 2024-09-11T00:02:31.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:31 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3487483706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T00:02:31.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:31 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:02:31.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:31 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4077927846' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.276+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4bf802e5c0 con 0x7f4bf8109080 2024-09-11T00:02:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.276+0000 7f4bf4ff9640 1 -- 172.21.15.19:0/4154876175 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f4bf00203a0 con 0x7f4bf8109080 2024-09-11T00:02:31.278 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.278+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4be40b5330 msgr2=0x7f4be40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.278+0000 7f4bfd552640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4be40b5330 0x7f4be40b77f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4be8031440 tx=0x7f4be8005e80 comp rx=0 tx=0).stop 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.278+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8109080 msgr2=0x7f4bf8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.278+0000 7f4bfd552640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8109080 0x7f4bf8075f20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000cce0 tx=0x7f4bf000a620 comp rx=0 tx=0).stop 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.278+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 shutdown_connections 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.278+0000 7f4bfd552640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4be40b5330 0x7f4be40b77f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.278+0000 7f4bfd552640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf8109080 0x7f4bf8075f20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.279+0000 7f4bfd552640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bf8108700 0x7f4bf80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.279+0000 7f4bfd552640 1 --2- 172.21.15.19:0/4154876175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf8102d00 0x7f4bf80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.279+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 >> 172.21.15.19:0/4154876175 conn(0x7f4bf80fe740 msgr2=0x7f4bf8100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.279+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 shutdown_connections 2024-09-11T00:02:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.279+0000 7f4bfd552640 1 -- 172.21.15.19:0/4154876175 wait complete. 2024-09-11T00:02:31.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- 172.21.15.19:0/1114488511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 msgr2=0x7f31d0104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1114488511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0104800 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009ca0 tx=0x7f31c002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- 172.21.15.19:0/1114488511 shutdown_connections 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1114488511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d0104d40 0x7f31d010e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1114488511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0104800 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1114488511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d0101f80 0x7f31d0102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- 172.21.15.19:0/1114488511 >> 172.21.15.19:0/1114488511 conn(0x7f31d00776b0 msgr2=0x7f31d0077ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- 172.21.15.19:0/1114488511 shutdown_connections 2024-09-11T00:02:31.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- 172.21.15.19:0/1114488511 wait complete. 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 Processor -- start 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- start start 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d0101f80 0x7f31d0198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d0104d40 0x7f31d019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0111c00 con 0x7f31d01043a0 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0111a80 con 0x7f31d0104d40 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.396+0000 7f31d6d82640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0111d80 con 0x7f31d0101f80 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33270/0 (socket says 172.21.15.19:33270) 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 -- 172.21.15.19:0/1939576953 learned_addr learned my addr 172.21.15.19:0/1939576953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31d4b1e640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d0101f80 0x7f31d0198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31d531f640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d0104d40 0x7f31d019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 -- 172.21.15.19:0/1939576953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d0101f80 msgr2=0x7f31d0198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d0101f80 0x7f31d0198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 -- 172.21.15.19:0/1939576953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d0104d40 msgr2=0x7f31d019dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d0104d40 0x7f31d019dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 -- 172.21.15.19:0/1939576953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d019e2a0 con 0x7f31d01043a0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31d531f640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d0104d40 0x7f31d019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cffff640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0198740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f31c0006010 tx=0x7f31c00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cdffb640 1 -- 172.21.15.19:0/1939576953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0003bf0 con 0x7f31d01043a0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cdffb640 1 -- 172.21.15.19:0/1939576953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c0003d90 con 0x7f31d01043a0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d019e530 con 0x7f31d01043a0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31cdffb640 1 -- 172.21.15.19:0/1939576953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c002fc20 con 0x7f31d01043a0 2024-09-11T00:02:31.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.397+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d01a4c50 con 0x7f31d01043a0 2024-09-11T00:02:31.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.399+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0102360 con 0x7f31d01043a0 2024-09-11T00:02:31.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.400+0000 7f31cdffb640 1 -- 172.21.15.19:0/1939576953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f31c00046a0 con 0x7f31d01043a0 2024-09-11T00:02:31.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.401+0000 7f31cdffb640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f31bc0b5440 0x7f31bc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.401+0000 7f31d4b1e640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f31bc0b5440 0x7f31bc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.401+0000 7f31cdffb640 1 -- 172.21.15.19:0/1939576953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f31c0107370 con 0x7f31d01043a0 2024-09-11T00:02:31.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.401+0000 7f31d4b1e640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f31bc0b5440 0x7f31bc0b7900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f31b80058c0 tx=0x7f31b800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:31.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.405+0000 7f31cdffb640 1 -- 172.21.15.19:0/1939576953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f31c00cdfd0 con 0x7f31d01043a0 2024-09-11T00:02:31.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:31 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3487483706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T00:02:31.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:31 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:02:31.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:31 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4077927846' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:31.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:31 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3487483706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T00:02:31.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:31 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:02:31.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:31 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4077927846' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:31.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.589+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f31d0109d20 con 0x7f31d01043a0 2024-09-11T00:02:31.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.590+0000 7f31cdffb640 1 -- 172.21.15.19:0/1939576953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) ==== 104+0+11 (secure 0 0 0) 0x7f31c00cd8d0 con 0x7f31d01043a0 2024-09-11T00:02:31.591 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-11T00:02:31.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f31bc0b5440 msgr2=0x7f31bc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f31bc0b5440 0x7f31bc0b7900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f31b80058c0 tx=0x7f31b800a2d0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 msgr2=0x7f31d0198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0198740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f31c0006010 tx=0x7f31c00319f0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 shutdown_connections 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d0104d40 0x7f31d019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f31bc0b5440 0x7f31bc0b7900 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31d01043a0 0x7f31d0198740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 --2- 172.21.15.19:0/1939576953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d0101f80 0x7f31d0198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 >> 172.21.15.19:0/1939576953 conn(0x7f31d00776b0 msgr2=0x7f31d01055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 shutdown_connections 2024-09-11T00:02:31.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.592+0000 7f31d6d82640 1 -- 172.21.15.19:0/1939576953 wait complete. 2024-09-11T00:02:31.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T00:02:31.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.710+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4140575802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab6410ce80 msgr2=0x7fab6410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.710+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4140575802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab6410ce80 0x7fab6410f300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009900 tx=0x7fab5c02a410 comp rx=0 tx=0).stop 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.710+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4140575802 shutdown_connections 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.710+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4140575802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab6410ce80 0x7fab6410f300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.710+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4140575802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab64104350 0x7fab6410c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.710+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4140575802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab64103a30 0x7fab64103e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.710+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4140575802 >> 172.21.15.19:0/4140575802 conn(0x7fab640fd480 msgr2=0x7fab640ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4140575802 shutdown_connections 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4140575802 wait complete. 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 Processor -- start 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 -- start start 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab64103a30 0x7fab641016d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab64104350 0x7fab64101c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab6410ce80 0x7fab64102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fab64112b10 con 0x7fab64104350 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fab64112990 con 0x7fab64103a30 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.711+0000 7fab6a3a1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab64112c90 con 0x7fab6410ce80 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab64104350 0x7fab64101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab64104350 0x7fab64101c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33294/0 (socket says 172.21.15.19:33294) 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 -- 172.21.15.19:0/4076623043 learned_addr learned my addr 172.21.15.19:0/4076623043 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab6939f640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab64103a30 0x7fab641016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab69ba0640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab6410ce80 0x7fab64102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 -- 172.21.15.19:0/4076623043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab6410ce80 msgr2=0x7fab64102150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab6410ce80 0x7fab64102150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 -- 172.21.15.19:0/4076623043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab64103a30 msgr2=0x7fab641016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab64103a30 0x7fab641016d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 -- 172.21.15.19:0/4076623043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab641a7360 con 0x7fab64104350 2024-09-11T00:02:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab68b9e640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab64104350 0x7fab64101c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00eb00 tx=0x7fab4c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab627fc640 1 -- 172.21.15.19:0/4076623043 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00ce40 con 0x7fab64104350 2024-09-11T00:02:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab627fc640 1 -- 172.21.15.19:0/4076623043 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab4c003e20 con 0x7fab64104350 2024-09-11T00:02:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab641a7650 con 0x7fab64104350 2024-09-11T00:02:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab627fc640 1 -- 172.21.15.19:0/4076623043 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c010690 con 0x7fab64104350 2024-09-11T00:02:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.712+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab641a7b50 con 0x7fab64104350 2024-09-11T00:02:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.713+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6406b780 con 0x7fab64104350 2024-09-11T00:02:31.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.715+0000 7fab627fc640 1 -- 172.21.15.19:0/4076623043 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7fab4c0041b0 con 0x7fab64104350 2024-09-11T00:02:31.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.716+0000 7fab627fc640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab500b53c0 0x7fab500b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:31.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.716+0000 7fab6939f640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab500b53c0 0x7fab500b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:31.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.716+0000 7fab627fc640 1 -- 172.21.15.19:0/4076623043 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fab4c0e6560 con 0x7fab64104350 2024-09-11T00:02:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.716+0000 7fab6939f640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab500b53c0 0x7fab500b7880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab5400abe0 tx=0x7fab5400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:31.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.719+0000 7fab627fc640 1 -- 172.21.15.19:0/4076623043 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fab4c0ad220 con 0x7fab64104350 2024-09-11T00:02:31.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.905+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fab64103e10 con 0x7fab64104350 2024-09-11T00:02:31.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.906+0000 7fab627fc640 1 -- 172.21.15.19:0/4076623043 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) ==== 100+0+11 (secure 0 0 0) 0x7fab4c0acb20 con 0x7fab64104350 2024-09-11T00:02:31.907 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-09-11T00:02:31.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab500b53c0 msgr2=0x7fab500b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab500b53c0 0x7fab500b7880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab5400abe0 tx=0x7fab5400a2d0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab64104350 msgr2=0x7fab64101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab64104350 0x7fab64101c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00eb00 tx=0x7fab4c00ef00 comp rx=0 tx=0).stop 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 shutdown_connections 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab6410ce80 0x7fab64102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab500b53c0 0x7fab500b7880 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab64104350 0x7fab64101c10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 --2- 172.21.15.19:0/4076623043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab64103a30 0x7fab641016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 >> 172.21.15.19:0/4076623043 conn(0x7fab640fd480 msgr2=0x7fab6410f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 shutdown_connections 2024-09-11T00:02:31.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:31.908+0000 7fab6a3a1640 1 -- 172.21.15.19:0/4076623043 wait complete. 2024-09-11T00:02:31.920 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-11T00:02:31.921 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:02:32.179 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:32.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:32 smithi019 ceph-mon[30859]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:32 smithi019 ceph-mon[30859]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:32 smithi019 ceph-mon[30859]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-11T00:02:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4154876175' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1939576953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:32 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/4076623043' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:32 smithi135 ceph-mon[35432]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:32.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:32 smithi135 ceph-mon[35432]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:32.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:32 smithi135 ceph-mon[35432]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-11T00:02:32.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4154876175' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.649 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1939576953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:32 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/4076623043' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.650 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:32 smithi131 ceph-mon[35491]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:32.650 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:32 smithi131 ceph-mon[35491]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:32.650 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:32 smithi131 ceph-mon[35491]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-11T00:02:32.650 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4154876175' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.651 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1939576953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.651 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:32 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/4076623043' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 -- 172.21.15.19:0/110297646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 msgr2=0x7fd8dc104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 --2- 172.21.15.19:0/110297646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc104080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009900 tx=0x7fd8d802a410 comp rx=0 tx=0).stop 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 -- 172.21.15.19:0/110297646 shutdown_connections 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 --2- 172.21.15.19:0/110297646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc10d100 0x7fd8dc10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 --2- 172.21.15.19:0/110297646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc1045c0 0x7fd8dc10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 --2- 172.21.15.19:0/110297646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc104080 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 -- 172.21.15.19:0/110297646 >> 172.21.15.19:0/110297646 conn(0x7fd8dc0fd700 msgr2=0x7fd8dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 -- 172.21.15.19:0/110297646 shutdown_connections 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.686+0000 7fd8e369c640 1 -- 172.21.15.19:0/110297646 wait complete. 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 Processor -- start 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 -- start start 2024-09-11T00:02:32.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc1045c0 0x7fd8dc19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc10d100 0x7fd8dc1a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc112e50 con 0x7fd8dc103ca0 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc112cd0 con 0x7fd8dc1045c0 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e369c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc112fd0 con 0x7fd8dc10d100 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e1438640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e1438640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33310/0 (socket says 172.21.15.19:33310) 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e1438640 1 -- 172.21.15.19:0/1117366953 learned_addr learned my addr 172.21.15.19:0/1117366953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.687+0000 7fd8e0c37640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc1045c0 0x7fd8dc19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e1c39640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc10d100 0x7fd8dc1a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e1438640 1 -- 172.21.15.19:0/1117366953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc10d100 msgr2=0x7fd8dc1a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e1438640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc10d100 0x7fd8dc1a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e1438640 1 -- 172.21.15.19:0/1117366953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc1045c0 msgr2=0x7fd8dc19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e1438640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc1045c0 0x7fd8dc19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e1438640 1 -- 172.21.15.19:0/1117366953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc1a1710 con 0x7fd8dc103ca0 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e0c37640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc1045c0 0x7fd8dc19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e1438640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc19b660 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8006010 tx=0x7fd8d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8d27fc640 1 -- 172.21.15.19:0/1117366953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d803f030 con 0x7fd8dc103ca0 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8d27fc640 1 -- 172.21.15.19:0/1117366953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d8003800 con 0x7fd8dc103ca0 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc1a19a0 con 0x7fd8dc103ca0 2024-09-11T00:02:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8d27fc640 1 -- 172.21.15.19:0/1117366953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8035070 con 0x7fd8dc103ca0 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.688+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc1a80c0 con 0x7fd8dc103ca0 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.689+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8dc104100 con 0x7fd8dc103ca0 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.692+0000 7fd8d27fc640 1 -- 172.21.15.19:0/1117366953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7fd8d8031b10 con 0x7fd8dc103ca0 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.692+0000 7fd8d27fc640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8c80b5440 0x7fd8c80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.692+0000 7fd8e0c37640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8c80b5440 0x7fd8c80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.692+0000 7fd8d27fc640 1 -- 172.21.15.19:0/1117366953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd8d8106ae0 con 0x7fd8dc103ca0 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.693+0000 7fd8e0c37640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8c80b5440 0x7fd8c80b7900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc10e630 tx=0x7fd8cc008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.695+0000 7fd8d27fc640 1 -- 172.21.15.19:0/1117366953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd8d80cd740 con 0x7fd8dc103ca0 2024-09-11T00:02:32.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.916+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8dc1a83e0 con 0x7fd8dc103ca0 2024-09-11T00:02:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.916+0000 7fd8d27fc640 1 -- 172.21.15.19:0/1117366953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7fd8d80cd040 con 0x7fd8dc103ca0 2024-09-11T00:02:32.918 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:32.918 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"btime":"2024-09-11T00:02:30:097777+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:02:29.420729+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:02:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 25 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8c80b5440 msgr2=0x7fd8c80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8c80b5440 0x7fd8c80b7900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc10e630 tx=0x7fd8cc008040 comp rx=0 tx=0).stop 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 msgr2=0x7fd8dc19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc19b660 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8006010 tx=0x7fd8d80042f0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 shutdown_connections 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc10d100 0x7fd8dc1a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc1045c0 0x7fd8dc19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8c80b5440 0x7fd8c80b7900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 --2- 172.21.15.19:0/1117366953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8dc103ca0 0x7fd8dc19b660 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 >> 172.21.15.19:0/1117366953 conn(0x7fd8dc0fd700 msgr2=0x7fd8dc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 shutdown_connections 2024-09-11T00:02:32.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:32.919+0000 7fd8e369c640 1 -- 172.21.15.19:0/1117366953 wait complete. 2024-09-11T00:02:33.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:33 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1117366953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:33.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:33 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1117366953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:33.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:33 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1117366953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:33.745 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-11T00:02:33.746 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-11T00:02:33.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:02:33.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 -- 172.21.15.19:0/2544125014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e38103ab0 msgr2=0x7f5e38103e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:33.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/2544125014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e38103ab0 0x7f5e38103e90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009900 tx=0x7f5e2802a410 comp rx=0 tx=0).stop 2024-09-11T00:02:33.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 -- 172.21.15.19:0/2544125014 shutdown_connections 2024-09-11T00:02:33.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/2544125014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e3810d060 0x7f5e3810f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/2544125014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e381044b0 0x7f5e3810ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/2544125014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e38103ab0 0x7f5e38103e90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 -- 172.21.15.19:0/2544125014 >> 172.21.15.19:0/2544125014 conn(0x7f5e380fd660 msgr2=0x7f5e380ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 -- 172.21.15.19:0/2544125014 shutdown_connections 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 -- 172.21.15.19:0/2544125014 wait complete. 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 Processor -- start 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.858+0000 7f5e3efe8640 1 -- start start 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3efe8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e38103ab0 0x7f5e38199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3efe8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e381044b0 0x7f5e38199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3efe8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3810d060 0x7f5e3819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3efe8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e38112cf0 con 0x7f5e3810d060 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3efe8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5e38112b70 con 0x7f5e38103ab0 2024-09-11T00:02:33.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3efe8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e38112e70 con 0x7f5e381044b0 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3810d060 0x7f5e3819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3810d060 0x7f5e3819eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33324/0 (socket says 172.21.15.19:33324) 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 -- 172.21.15.19:0/3524229950 learned_addr learned my addr 172.21.15.19:0/3524229950 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e37fff640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e381044b0 0x7f5e38199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3cd84640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e38103ab0 0x7f5e38199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 -- 172.21.15.19:0/3524229950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e381044b0 msgr2=0x7f5e38199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e381044b0 0x7f5e38199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 -- 172.21.15.19:0/3524229950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e38103ab0 msgr2=0x7f5e38199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e38103ab0 0x7f5e38199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 -- 172.21.15.19:0/3524229950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3819f2d0 con 0x7f5e3810d060 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3d585640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3810d060 0x7f5e3819eb00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000eb10 tx=0x7f5e3000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e35ffb640 1 -- 172.21.15.19:0/3524229950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30004b20 con 0x7f5e3810d060 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e35ffb640 1 -- 172.21.15.19:0/3524229950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e30004cc0 con 0x7f5e3810d060 2024-09-11T00:02:33.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.859+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3819f5c0 con 0x7f5e3810d060 2024-09-11T00:02:33.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.860+0000 7f5e35ffb640 1 -- 172.21.15.19:0/3524229950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30010670 con 0x7f5e3810d060 2024-09-11T00:02:33.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.860+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e381a5c80 con 0x7f5e3810d060 2024-09-11T00:02:33.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.861+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e38103e90 con 0x7f5e3810d060 2024-09-11T00:02:33.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.862+0000 7f5e35ffb640 1 -- 172.21.15.19:0/3524229950 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f5e30005020 con 0x7f5e3810d060 2024-09-11T00:02:33.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.863+0000 7f5e35ffb640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e200b53c0 0x7f5e200b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:33.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.863+0000 7f5e35ffb640 1 -- 172.21.15.19:0/3524229950 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5e300e6500 con 0x7f5e3810d060 2024-09-11T00:02:33.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.863+0000 7f5e3cd84640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e200b53c0 0x7f5e200b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:33.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.864+0000 7f5e3cd84640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e200b53c0 0x7f5e200b7880 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e28031440 tx=0x7f5e280095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:33.867+0000 7f5e35ffb640 1 -- 172.21.15.19:0/3524229950 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5e300ad1c0 con 0x7f5e3810d060 2024-09-11T00:02:34.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.049+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e38063590 con 0x7f5e200b53c0 2024-09-11T00:02:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.053+0000 7f5e35ffb640 1 -- 172.21.15.19:0/3524229950 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259075 (secure 0 0 0) 0x7f5e38063590 con 0x7f5e200b53c0 2024-09-11T00:02:34.057 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:02:34.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e200b53c0 msgr2=0x7f5e200b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e200b53c0 0x7f5e200b7880 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e28031440 tx=0x7f5e280095f0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3810d060 msgr2=0x7f5e3819eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3810d060 0x7f5e3819eb00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000eb10 tx=0x7f5e3000c2d0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 shutdown_connections 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5e200b53c0 0x7f5e200b7880 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3810d060 0x7f5e3819eb00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e381044b0 0x7f5e38199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 --2- 172.21.15.19:0/3524229950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e38103ab0 0x7f5e38199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 >> 172.21.15.19:0/3524229950 conn(0x7f5e380fd660 msgr2=0x7f5e380fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 shutdown_connections 2024-09-11T00:02:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.057+0000 7f5e3efe8640 1 -- 172.21.15.19:0/3524229950 wait complete. 2024-09-11T00:02:34.069 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-11T00:02:32.519305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660274,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":779,"num_read_kb":494,"num_write":300,"num_write_kb":2276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":742,"ondisk_log_size":742,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363828,"kb_used_data":10420,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577996,"statfs":{"total":1151940427776,"available":1151567867904,"internally_reserved":0,"allocated":10670080,"data_stored":7027253,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6072,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002962"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887900+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:01:52.887900+0000","last_peered":"2024-09-11T00:01:52.887900+0000","last_clean":"2024-09-11T00:01:52.887900+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:01:52.887900+0000","last_undegraded":"2024-09-11T00:01:52.887900+0000","last_fullsized":"2024-09-11T00:01:52.887900+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884200+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:01:52.884200+0000","last_peered":"2024-09-11T00:01:52.884200+0000","last_clean":"2024-09-11T00:01:52.884200+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:01:52.884200+0000","last_undegraded":"2024-09-11T00:01:52.884200+0000","last_fullsized":"2024-09-11T00:01:52.884200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.888305+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:01:52.888305+0000","last_peered":"2024-09-11T00:01:52.888305+0000","last_clean":"2024-09-11T00:01:52.888305+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:01:52.888305+0000","last_undegraded":"2024-09-11T00:01:52.888305+0000","last_fullsized":"2024-09-11T00:01:52.888305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:01:52.887506+0000","last_peered":"2024-09-11T00:01:52.887506+0000","last_clean":"2024-09-11T00:01:52.887506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:01:52.887506+0000","last_undegraded":"2024-09-11T00:01:52.887506+0000","last_fullsized":"2024-09-11T00:01:52.887506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.880125+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:01:52.880125+0000","last_peered":"2024-09-11T00:01:52.880125+0000","last_clean":"2024-09-11T00:01:52.880125+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:01:52.880125+0000","last_undegraded":"2024-09-11T00:01:52.880125+0000","last_fullsized":"2024-09-11T00:01:52.880125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.876164+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:01:52.876164+0000","last_peered":"2024-09-11T00:01:52.876164+0000","last_clean":"2024-09-11T00:01:52.876164+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:01:52.876164+0000","last_undegraded":"2024-09-11T00:01:52.876164+0000","last_fullsized":"2024-09-11T00:01:52.876164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878226+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:01:52.878226+0000","last_peered":"2024-09-11T00:01:52.878226+0000","last_clean":"2024-09-11T00:01:52.878226+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:01:52.878226+0000","last_undegraded":"2024-09-11T00:01:52.878226+0000","last_fullsized":"2024-09-11T00:01:52.878226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884654+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:01:52.884654+0000","last_peered":"2024-09-11T00:01:52.884654+0000","last_clean":"2024-09-11T00:01:52.884654+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:01:52.884654+0000","last_undegraded":"2024-09-11T00:01:52.884654+0000","last_fullsized":"2024-09-11T00:01:52.884654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891837+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:01:52.891837+0000","last_peered":"2024-09-11T00:01:52.891837+0000","last_clean":"2024-09-11T00:01:52.891837+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:01:52.891837+0000","last_undegraded":"2024-09-11T00:01:52.891837+0000","last_fullsized":"2024-09-11T00:01:52.891837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884749+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:01:52.884749+0000","last_peered":"2024-09-11T00:01:52.884749+0000","last_clean":"2024-09-11T00:01:52.884749+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:01:52.884749+0000","last_undegraded":"2024-09-11T00:01:52.884749+0000","last_fullsized":"2024-09-11T00:01:52.884749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890142+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:01:52.890142+0000","last_peered":"2024-09-11T00:01:52.890142+0000","last_clean":"2024-09-11T00:01:52.890142+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:01:52.890142+0000","last_undegraded":"2024-09-11T00:01:52.890142+0000","last_fullsized":"2024-09-11T00:01:52.890142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870158+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:01:52.870158+0000","last_peered":"2024-09-11T00:01:52.870158+0000","last_clean":"2024-09-11T00:01:52.870158+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:01:52.870158+0000","last_undegraded":"2024-09-11T00:01:52.870158+0000","last_fullsized":"2024-09-11T00:01:52.870158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885516+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:01:52.885516+0000","last_peered":"2024-09-11T00:01:52.885516+0000","last_clean":"2024-09-11T00:01:52.885516+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:01:52.885516+0000","last_undegraded":"2024-09-11T00:01:52.885516+0000","last_fullsized":"2024-09-11T00:01:52.885516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886565+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:01:52.886565+0000","last_peered":"2024-09-11T00:01:52.886565+0000","last_clean":"2024-09-11T00:01:52.886565+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:01:52.886565+0000","last_undegraded":"2024-09-11T00:01:52.886565+0000","last_fullsized":"2024-09-11T00:01:52.886565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887122+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:01:52.887122+0000","last_peered":"2024-09-11T00:01:52.887122+0000","last_clean":"2024-09-11T00:01:52.887122+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:01:52.887122+0000","last_undegraded":"2024-09-11T00:01:52.887122+0000","last_fullsized":"2024-09-11T00:01:52.887122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887902+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:01:52.887902+0000","last_peered":"2024-09-11T00:01:52.887902+0000","last_clean":"2024-09-11T00:01:52.887902+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:01:52.887902+0000","last_undegraded":"2024-09-11T00:01:52.887902+0000","last_fullsized":"2024-09-11T00:01:52.887902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887965+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:01:52.887965+0000","last_peered":"2024-09-11T00:01:52.887965+0000","last_clean":"2024-09-11T00:01:52.887965+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:01:52.887965+0000","last_undegraded":"2024-09-11T00:01:52.887965+0000","last_fullsized":"2024-09-11T00:01:52.887965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887640+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:01:52.887640+0000","last_peered":"2024-09-11T00:01:52.887640+0000","last_clean":"2024-09-11T00:01:52.887640+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:01:52.887640+0000","last_undegraded":"2024-09-11T00:01:52.887640+0000","last_fullsized":"2024-09-11T00:01:52.887640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885127+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:01:52.885127+0000","last_peered":"2024-09-11T00:01:52.885127+0000","last_clean":"2024-09-11T00:01:52.885127+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:01:52.885127+0000","last_undegraded":"2024-09-11T00:01:52.885127+0000","last_fullsized":"2024-09-11T00:01:52.885127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.874083+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:01:52.874083+0000","last_peered":"2024-09-11T00:01:52.874083+0000","last_clean":"2024-09-11T00:01:52.874083+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:01:52.874083+0000","last_undegraded":"2024-09-11T00:01:52.874083+0000","last_fullsized":"2024-09-11T00:01:52.874083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882199+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:01:52.882199+0000","last_peered":"2024-09-11T00:01:52.882199+0000","last_clean":"2024-09-11T00:01:52.882199+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:01:52.882199+0000","last_undegraded":"2024-09-11T00:01:52.882199+0000","last_fullsized":"2024-09-11T00:01:52.882199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891557+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:01:52.891557+0000","last_peered":"2024-09-11T00:01:52.891557+0000","last_clean":"2024-09-11T00:01:52.891557+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:01:52.891557+0000","last_undegraded":"2024-09-11T00:01:52.891557+0000","last_fullsized":"2024-09-11T00:01:52.891557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882465+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:01:52.882465+0000","last_peered":"2024-09-11T00:01:52.882465+0000","last_clean":"2024-09-11T00:01:52.882465+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:01:52.882465+0000","last_undegraded":"2024-09-11T00:01:52.882465+0000","last_fullsized":"2024-09-11T00:01:52.882465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881842+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:01:52.881842+0000","last_peered":"2024-09-11T00:01:52.881842+0000","last_clean":"2024-09-11T00:01:52.881842+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:01:52.881842+0000","last_undegraded":"2024-09-11T00:01:52.881842+0000","last_fullsized":"2024-09-11T00:01:52.881842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.875498+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:01:52.875498+0000","last_peered":"2024-09-11T00:01:52.875498+0000","last_clean":"2024-09-11T00:01:52.875498+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:01:52.875498+0000","last_undegraded":"2024-09-11T00:01:52.875498+0000","last_fullsized":"2024-09-11T00:01:52.875498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891930+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:01:52.891930+0000","last_peered":"2024-09-11T00:01:52.891930+0000","last_clean":"2024-09-11T00:01:52.891930+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:01:52.891930+0000","last_undegraded":"2024-09-11T00:01:52.891930+0000","last_fullsized":"2024-09-11T00:01:52.891930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.880183+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:01:52.880183+0000","last_peered":"2024-09-11T00:01:52.880183+0000","last_clean":"2024-09-11T00:01:52.880183+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:01:52.880183+0000","last_undegraded":"2024-09-11T00:01:52.880183+0000","last_fullsized":"2024-09-11T00:01:52.880183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.883179+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:01:52.883179+0000","last_peered":"2024-09-11T00:01:52.883179+0000","last_clean":"2024-09-11T00:01:52.883179+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:01:52.883179+0000","last_undegraded":"2024-09-11T00:01:52.883179+0000","last_fullsized":"2024-09-11T00:01:52.883179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885014+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:01:52.885014+0000","last_peered":"2024-09-11T00:01:52.885014+0000","last_clean":"2024-09-11T00:01:52.885014+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:01:52.885014+0000","last_undegraded":"2024-09-11T00:01:52.885014+0000","last_fullsized":"2024-09-11T00:01:52.885014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884768+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:01:52.884768+0000","last_peered":"2024-09-11T00:01:52.884768+0000","last_clean":"2024-09-11T00:01:52.884768+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:01:52.884768+0000","last_undegraded":"2024-09-11T00:01:52.884768+0000","last_fullsized":"2024-09-11T00:01:52.884768+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886302+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:01:52.886302+0000","last_peered":"2024-09-11T00:01:52.886302+0000","last_clean":"2024-09-11T00:01:52.886302+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:01:52.886302+0000","last_undegraded":"2024-09-11T00:01:52.886302+0000","last_fullsized":"2024-09-11T00:01:52.886302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881240+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:01:52.881240+0000","last_peered":"2024-09-11T00:01:52.881240+0000","last_clean":"2024-09-11T00:01:52.881240+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:01:52.881240+0000","last_undegraded":"2024-09-11T00:01:52.881240+0000","last_fullsized":"2024-09-11T00:01:52.881240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879982+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:01:52.879982+0000","last_peered":"2024-09-11T00:01:52.879982+0000","last_clean":"2024-09-11T00:01:52.879982+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:01:52.879982+0000","last_undegraded":"2024-09-11T00:01:52.879982+0000","last_fullsized":"2024-09-11T00:01:52.879982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:26.459433+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:02:26.459433+0000","last_peered":"2024-09-11T00:02:26.459433+0000","last_clean":"2024-09-11T00:02:26.459433+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:02:26.459433+0000","last_undegraded":"2024-09-11T00:02:26.459433+0000","last_fullsized":"2024-09-11T00:02:26.459433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884259+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:01:52.884259+0000","last_peered":"2024-09-11T00:01:52.884259+0000","last_clean":"2024-09-11T00:01:52.884259+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:01:52.884259+0000","last_undegraded":"2024-09-11T00:01:52.884259+0000","last_fullsized":"2024-09-11T00:01:52.884259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.877643+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:01:52.877643+0000","last_peered":"2024-09-11T00:01:52.877643+0000","last_clean":"2024-09-11T00:01:52.877643+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:01:52.877643+0000","last_undegraded":"2024-09-11T00:01:52.877643+0000","last_fullsized":"2024-09-11T00:01:52.877643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879277+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:01:52.879277+0000","last_peered":"2024-09-11T00:01:52.879277+0000","last_clean":"2024-09-11T00:01:52.879277+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:01:52.879277+0000","last_undegraded":"2024-09-11T00:01:52.879277+0000","last_fullsized":"2024-09-11T00:01:52.879277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:30.469620+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:02:30.469620+0000","last_peered":"2024-09-11T00:02:30.469620+0000","last_clean":"2024-09-11T00:02:30.469620+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:02:30.469620+0000","last_undegraded":"2024-09-11T00:02:30.469620+0000","last_fullsized":"2024-09-11T00:02:30.469620+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889091+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:01:52.889091+0000","last_peered":"2024-09-11T00:01:52.889091+0000","last_clean":"2024-09-11T00:01:52.889091+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:01:52.889091+0000","last_undegraded":"2024-09-11T00:01:52.889091+0000","last_fullsized":"2024-09-11T00:01:52.889091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886398+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:01:52.886398+0000","last_peered":"2024-09-11T00:01:52.886398+0000","last_clean":"2024-09-11T00:01:52.886398+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:01:52.886398+0000","last_undegraded":"2024-09-11T00:01:52.886398+0000","last_fullsized":"2024-09-11T00:01:52.886398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891618+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:01:52.891618+0000","last_peered":"2024-09-11T00:01:52.891618+0000","last_clean":"2024-09-11T00:01:52.891618+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:01:52.891618+0000","last_undegraded":"2024-09-11T00:01:52.891618+0000","last_fullsized":"2024-09-11T00:01:52.891618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'33","reported_seq":294,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:31.467908+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:02:31.467908+0000","last_peered":"2024-09-11T00:02:31.467908+0000","last_clean":"2024-09-11T00:02:31.467908+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:02:31.467908+0000","last_undegraded":"2024-09-11T00:02:31.467908+0000","last_fullsized":"2024-09-11T00:02:31.467908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65530,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":183,"num_write":34,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870369+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:01:52.870369+0000","last_peered":"2024-09-11T00:01:52.870369+0000","last_clean":"2024-09-11T00:01:52.870369+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:01:52.870369+0000","last_undegraded":"2024-09-11T00:01:52.870369+0000","last_fullsized":"2024-09-11T00:01:52.870369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.875766+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:01:52.875766+0000","last_peered":"2024-09-11T00:01:52.875766+0000","last_clean":"2024-09-11T00:01:52.875766+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:01:52.875766+0000","last_undegraded":"2024-09-11T00:01:52.875766+0000","last_fullsized":"2024-09-11T00:01:52.875766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":40,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881210+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:01:52.881210+0000","last_peered":"2024-09-11T00:01:52.881210+0000","last_clean":"2024-09-11T00:01:52.881210+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:01:52.881210+0000","last_undegraded":"2024-09-11T00:01:52.881210+0000","last_fullsized":"2024-09-11T00:01:52.881210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'5","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:26.465069+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:02:26.465069+0000","last_peered":"2024-09-11T00:02:26.465069+0000","last_clean":"2024-09-11T00:02:26.465069+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:02:26.465069+0000","last_undegraded":"2024-09-11T00:02:26.465069+0000","last_fullsized":"2024-09-11T00:02:26.465069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878439+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:01:52.878439+0000","last_peered":"2024-09-11T00:01:52.878439+0000","last_clean":"2024-09-11T00:01:52.878439+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:01:52.878439+0000","last_undegraded":"2024-09-11T00:01:52.878439+0000","last_fullsized":"2024-09-11T00:01:52.878439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889807+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:01:52.889807+0000","last_peered":"2024-09-11T00:01:52.889807+0000","last_clean":"2024-09-11T00:01:52.889807+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:01:52.889807+0000","last_undegraded":"2024-09-11T00:01:52.889807+0000","last_fullsized":"2024-09-11T00:01:52.889807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878443+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:01:52.878443+0000","last_peered":"2024-09-11T00:01:52.878443+0000","last_clean":"2024-09-11T00:01:52.878443+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:01:52.878443+0000","last_undegraded":"2024-09-11T00:01:52.878443+0000","last_fullsized":"2024-09-11T00:01:52.878443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.872864+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:01:52.872864+0000","last_peered":"2024-09-11T00:01:52.872864+0000","last_clean":"2024-09-11T00:01:52.872864+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:01:52.872864+0000","last_undegraded":"2024-09-11T00:01:52.872864+0000","last_fullsized":"2024-09-11T00:01:52.872864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878190+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:01:52.878190+0000","last_peered":"2024-09-11T00:01:52.878190+0000","last_clean":"2024-09-11T00:01:52.878190+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:01:52.878190+0000","last_undegraded":"2024-09-11T00:01:52.878190+0000","last_fullsized":"2024-09-11T00:01:52.878190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890272+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:01:52.890272+0000","last_peered":"2024-09-11T00:01:52.890272+0000","last_clean":"2024-09-11T00:01:52.890272+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:01:52.890272+0000","last_undegraded":"2024-09-11T00:01:52.890272+0000","last_fullsized":"2024-09-11T00:01:52.890272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607398+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607398+0000","last_peered":"2024-09-11T00:00:53.607398+0000","last_clean":"2024-09-11T00:00:53.607398+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607398+0000","last_undegraded":"2024-09-11T00:00:53.607398+0000","last_fullsized":"2024-09-11T00:00:53.607398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605463+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605463+0000","last_peered":"2024-09-11T00:00:53.605463+0000","last_clean":"2024-09-11T00:00:53.605463+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605463+0000","last_undegraded":"2024-09-11T00:00:53.605463+0000","last_fullsized":"2024-09-11T00:00:53.605463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886459+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:01:52.886459+0000","last_peered":"2024-09-11T00:01:52.886459+0000","last_clean":"2024-09-11T00:01:52.886459+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:01:52.886459+0000","last_undegraded":"2024-09-11T00:01:52.886459+0000","last_fullsized":"2024-09-11T00:01:52.886459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607303+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607303+0000","last_peered":"2024-09-11T00:00:53.607303+0000","last_clean":"2024-09-11T00:00:53.607303+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607303+0000","last_undegraded":"2024-09-11T00:00:53.607303+0000","last_fullsized":"2024-09-11T00:00:53.607303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879698+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:01:52.879698+0000","last_peered":"2024-09-11T00:01:52.879698+0000","last_clean":"2024-09-11T00:01:52.879698+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:01:52.879698+0000","last_undegraded":"2024-09-11T00:01:52.879698+0000","last_fullsized":"2024-09-11T00:01:52.879698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:28.467618+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:02:28.467618+0000","last_peered":"2024-09-11T00:02:28.467618+0000","last_clean":"2024-09-11T00:02:28.467618+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:02:28.467618+0000","last_undegraded":"2024-09-11T00:02:28.467618+0000","last_fullsized":"2024-09-11T00:02:28.467618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.864150+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:01:52.864150+0000","last_peered":"2024-09-11T00:01:52.864150+0000","last_clean":"2024-09-11T00:01:52.864150+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:01:52.864150+0000","last_undegraded":"2024-09-11T00:01:52.864150+0000","last_fullsized":"2024-09-11T00:01:52.864150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607859+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607859+0000","last_peered":"2024-09-11T00:00:53.607859+0000","last_clean":"2024-09-11T00:00:53.607859+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607859+0000","last_undegraded":"2024-09-11T00:00:53.607859+0000","last_fullsized":"2024-09-11T00:00:53.607859+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.871115+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:01:52.871115+0000","last_peered":"2024-09-11T00:01:52.871115+0000","last_clean":"2024-09-11T00:01:52.871115+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:01:52.871115+0000","last_undegraded":"2024-09-11T00:01:52.871115+0000","last_fullsized":"2024-09-11T00:01:52.871115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612530+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.612530+0000","last_peered":"2024-09-11T00:00:53.612530+0000","last_clean":"2024-09-11T00:00:53.612530+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.612530+0000","last_undegraded":"2024-09-11T00:00:53.612530+0000","last_fullsized":"2024-09-11T00:00:53.612530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.877630+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:01:52.877630+0000","last_peered":"2024-09-11T00:01:52.877630+0000","last_clean":"2024-09-11T00:01:52.877630+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:01:52.877630+0000","last_undegraded":"2024-09-11T00:01:52.877630+0000","last_fullsized":"2024-09-11T00:01:52.877630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882853+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:01:52.882853+0000","last_peered":"2024-09-11T00:01:52.882853+0000","last_clean":"2024-09-11T00:01:52.882853+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:01:52.882853+0000","last_undegraded":"2024-09-11T00:01:52.882853+0000","last_fullsized":"2024-09-11T00:01:52.882853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:29.264004+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:02:29.264004+0000","last_peered":"2024-09-11T00:02:29.264004+0000","last_clean":"2024-09-11T00:02:29.264004+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:02:29.264004+0000","last_undegraded":"2024-09-11T00:02:29.264004+0000","last_fullsized":"2024-09-11T00:02:29.264004+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870163+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:01:52.870163+0000","last_peered":"2024-09-11T00:01:52.870163+0000","last_clean":"2024-09-11T00:01:52.870163+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:01:52.870163+0000","last_undegraded":"2024-09-11T00:01:52.870163+0000","last_fullsized":"2024-09-11T00:01:52.870163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885223+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:01:52.885223+0000","last_peered":"2024-09-11T00:01:52.885223+0000","last_clean":"2024-09-11T00:01:52.885223+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:01:52.885223+0000","last_undegraded":"2024-09-11T00:01:52.885223+0000","last_fullsized":"2024-09-11T00:01:52.885223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.859253+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:01:52.859253+0000","last_peered":"2024-09-11T00:01:52.859253+0000","last_clean":"2024-09-11T00:01:52.859253+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:01:52.859253+0000","last_undegraded":"2024-09-11T00:01:52.859253+0000","last_fullsized":"2024-09-11T00:01:52.859253+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886475+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:01:52.886475+0000","last_peered":"2024-09-11T00:01:52.886475+0000","last_clean":"2024-09-11T00:01:52.886475+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:01:52.886475+0000","last_undegraded":"2024-09-11T00:01:52.886475+0000","last_fullsized":"2024-09-11T00:01:52.886475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878986+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:01:52.878986+0000","last_peered":"2024-09-11T00:01:52.878986+0000","last_clean":"2024-09-11T00:01:52.878986+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:01:52.878986+0000","last_undegraded":"2024-09-11T00:01:52.878986+0000","last_fullsized":"2024-09-11T00:01:52.878986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890344+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:01:52.890344+0000","last_peered":"2024-09-11T00:01:52.890344+0000","last_clean":"2024-09-11T00:01:52.890344+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:01:52.890344+0000","last_undegraded":"2024-09-11T00:01:52.890344+0000","last_fullsized":"2024-09-11T00:01:52.890344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891153+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:01:52.891153+0000","last_peered":"2024-09-11T00:01:52.891153+0000","last_clean":"2024-09-11T00:01:52.891153+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:01:52.891153+0000","last_undegraded":"2024-09-11T00:01:52.891153+0000","last_fullsized":"2024-09-11T00:01:52.891153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889337+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:01:52.889337+0000","last_peered":"2024-09-11T00:01:52.889337+0000","last_clean":"2024-09-11T00:01:52.889337+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:01:52.889337+0000","last_undegraded":"2024-09-11T00:01:52.889337+0000","last_fullsized":"2024-09-11T00:01:52.889337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889030+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:01:52.889030+0000","last_peered":"2024-09-11T00:01:52.889030+0000","last_clean":"2024-09-11T00:01:52.889030+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:01:52.889030+0000","last_undegraded":"2024-09-11T00:01:52.889030+0000","last_fullsized":"2024-09-11T00:01:52.889030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697983+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697983+0000","last_peered":"2024-09-11T00:00:53.697983+0000","last_clean":"2024-09-11T00:00:53.697983+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697983+0000","last_undegraded":"2024-09-11T00:00:53.697983+0000","last_fullsized":"2024-09-11T00:00:53.697983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884753+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:01:52.884753+0000","last_peered":"2024-09-11T00:01:52.884753+0000","last_clean":"2024-09-11T00:01:52.884753+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:01:52.884753+0000","last_undegraded":"2024-09-11T00:01:52.884753+0000","last_fullsized":"2024-09-11T00:01:52.884753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604797+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604797+0000","last_peered":"2024-09-11T00:00:53.604797+0000","last_clean":"2024-09-11T00:00:53.604797+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604797+0000","last_undegraded":"2024-09-11T00:00:53.604797+0000","last_fullsized":"2024-09-11T00:00:53.604797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69672,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":698,"num_read_kb":425,"num_write":175,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710759,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1079589,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":1014664,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626495,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1013425,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":423222,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378709,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":481998,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":481230,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705759,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:02:34.074 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:02:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 -- 172.21.15.19:0/2485288594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c107620 msgr2=0x7ff43c107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2485288594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c107620 0x7ff43c107a60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009900 tx=0x7ff42c02a410 comp rx=0 tx=0).stop 2024-09-11T00:02:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 -- 172.21.15.19:0/2485288594 shutdown_connections 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2485288594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c107fa0 0x7ff43c10e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2485288594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c107620 0x7ff43c107a60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2485288594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c101c20 0x7ff43c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 -- 172.21.15.19:0/2485288594 >> 172.21.15.19:0/2485288594 conn(0x7ff43c0fd660 msgr2=0x7ff43c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 -- 172.21.15.19:0/2485288594 shutdown_connections 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 -- 172.21.15.19:0/2485288594 wait complete. 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 Processor -- start 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.213+0000 7ff4444b0640 1 -- start start 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4444b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c101c20 0x7ff43c19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4444b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c107620 0x7ff43c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4444b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c107fa0 0x7ff43c1a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4444b0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c111c60 con 0x7ff43c101c20 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4444b0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c111ae0 con 0x7ff43c107620 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4444b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c111de0 con 0x7ff43c107fa0 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c101c20 0x7ff43c19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c101c20 0x7ff43c19a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33338/0 (socket says 172.21.15.19:33338) 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 -- 172.21.15.19:0/2707886479 learned_addr learned my addr 172.21.15.19:0/2707886479 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff441a4b640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c107620 0x7ff43c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 -- 172.21.15.19:0/2707886479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c107fa0 msgr2=0x7ff43c1a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff442a4d640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c107fa0 0x7ff43c1a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c107fa0 0x7ff43c1a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 -- 172.21.15.19:0/2707886479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c107620 msgr2=0x7ff43c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c107620 0x7ff43c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 -- 172.21.15.19:0/2707886479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c1a55d0 con 0x7ff43c101c20 2024-09-11T00:02:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff441a4b640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c107620 0x7ff43c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff44224c640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c101c20 0x7ff43c19a010 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e9f0 tx=0x7ff43800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4337fe640 1 -- 172.21.15.19:0/2707886479 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43800cd80 con 0x7ff43c101c20 2024-09-11T00:02:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4337fe640 1 -- 172.21.15.19:0/2707886479 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4380108e0 con 0x7ff43c101c20 2024-09-11T00:02:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c1a57a0 con 0x7ff43c101c20 2024-09-11T00:02:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.214+0000 7ff4337fe640 1 -- 172.21.15.19:0/2707886479 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438018980 con 0x7ff43c101c20 2024-09-11T00:02:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.215+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c1a5cb0 con 0x7ff43c101c20 2024-09-11T00:02:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.216+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c102000 con 0x7ff43c101c20 2024-09-11T00:02:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.217+0000 7ff4337fe640 1 -- 172.21.15.19:0/2707886479 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7ff438010430 con 0x7ff43c101c20 2024-09-11T00:02:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.218+0000 7ff4337fe640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff4280b5440 0x7ff4280b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.218+0000 7ff4337fe640 1 -- 172.21.15.19:0/2707886479 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7ff4380e6710 con 0x7ff43c101c20 2024-09-11T00:02:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.218+0000 7ff441a4b640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff4280b5440 0x7ff4280b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.219+0000 7ff441a4b640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff4280b5440 0x7ff4280b7900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff42c031440 tx=0x7ff42c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.221+0000 7ff4337fe640 1 -- 172.21.15.19:0/2707886479 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff4380ad3d0 con 0x7ff43c101c20 2024-09-11T00:02:34.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.403+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff43c063590 con 0x7ff4280b5440 2024-09-11T00:02:34.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.408+0000 7ff4337fe640 1 -- 172.21.15.19:0/2707886479 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259075 (secure 0 0 0) 0x7ff43c063590 con 0x7ff4280b5440 2024-09-11T00:02:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:34.413 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff4280b5440 msgr2=0x7ff4280b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff4280b5440 0x7ff4280b7900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff42c031440 tx=0x7ff42c005a20 comp rx=0 tx=0).stop 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c101c20 msgr2=0x7ff43c19a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c101c20 0x7ff43c19a010 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e9f0 tx=0x7ff43800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 shutdown_connections 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff43c107fa0 0x7ff43c1a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c107620 0x7ff43c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff4280b5440 0x7ff4280b7900 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 --2- 172.21.15.19:0/2707886479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff43c101c20 0x7ff43c19a010 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 >> 172.21.15.19:0/2707886479 conn(0x7ff43c0fd660 msgr2=0x7ff43c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 shutdown_connections 2024-09-11T00:02:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.411+0000 7ff4444b0640 1 -- 172.21.15.19:0/2707886479 wait complete. 2024-09-11T00:02:34.422 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:34 smithi019 ceph-mon[30859]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T00:02:34.423 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-11T00:02:32.519305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660274,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":779,"num_read_kb":494,"num_write":300,"num_write_kb":2276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":742,"ondisk_log_size":742,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363828,"kb_used_data":10420,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577996,"statfs":{"total":1151940427776,"available":1151567867904,"internally_reserved":0,"allocated":10670080,"data_stored":7027253,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6072,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002962"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887900+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:01:52.887900+0000","last_peered":"2024-09-11T00:01:52.887900+0000","last_clean":"2024-09-11T00:01:52.887900+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:01:52.887900+0000","last_undegraded":"2024-09-11T00:01:52.887900+0000","last_fullsized":"2024-09-11T00:01:52.887900+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884200+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:01:52.884200+0000","last_peered":"2024-09-11T00:01:52.884200+0000","last_clean":"2024-09-11T00:01:52.884200+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:01:52.884200+0000","last_undegraded":"2024-09-11T00:01:52.884200+0000","last_fullsized":"2024-09-11T00:01:52.884200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.888305+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:01:52.888305+0000","last_peered":"2024-09-11T00:01:52.888305+0000","last_clean":"2024-09-11T00:01:52.888305+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:01:52.888305+0000","last_undegraded":"2024-09-11T00:01:52.888305+0000","last_fullsized":"2024-09-11T00:01:52.888305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:01:52.887506+0000","last_peered":"2024-09-11T00:01:52.887506+0000","last_clean":"2024-09-11T00:01:52.887506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:01:52.887506+0000","last_undegraded":"2024-09-11T00:01:52.887506+0000","last_fullsized":"2024-09-11T00:01:52.887506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.880125+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:01:52.880125+0000","last_peered":"2024-09-11T00:01:52.880125+0000","last_clean":"2024-09-11T00:01:52.880125+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:01:52.880125+0000","last_undegraded":"2024-09-11T00:01:52.880125+0000","last_fullsized":"2024-09-11T00:01:52.880125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.876164+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:01:52.876164+0000","last_peered":"2024-09-11T00:01:52.876164+0000","last_clean":"2024-09-11T00:01:52.876164+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:01:52.876164+0000","last_undegraded":"2024-09-11T00:01:52.876164+0000","last_fullsized":"2024-09-11T00:01:52.876164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878226+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:01:52.878226+0000","last_peered":"2024-09-11T00:01:52.878226+0000","last_clean":"2024-09-11T00:01:52.878226+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:01:52.878226+0000","last_undegraded":"2024-09-11T00:01:52.878226+0000","last_fullsized":"2024-09-11T00:01:52.878226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884654+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:01:52.884654+0000","last_peered":"2024-09-11T00:01:52.884654+0000","last_clean":"2024-09-11T00:01:52.884654+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:01:52.884654+0000","last_undegraded":"2024-09-11T00:01:52.884654+0000","last_fullsized":"2024-09-11T00:01:52.884654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891837+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:01:52.891837+0000","last_peered":"2024-09-11T00:01:52.891837+0000","last_clean":"2024-09-11T00:01:52.891837+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:01:52.891837+0000","last_undegraded":"2024-09-11T00:01:52.891837+0000","last_fullsized":"2024-09-11T00:01:52.891837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884749+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:01:52.884749+0000","last_peered":"2024-09-11T00:01:52.884749+0000","last_clean":"2024-09-11T00:01:52.884749+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:01:52.884749+0000","last_undegraded":"2024-09-11T00:01:52.884749+0000","last_fullsized":"2024-09-11T00:01:52.884749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890142+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:01:52.890142+0000","last_peered":"2024-09-11T00:01:52.890142+0000","last_clean":"2024-09-11T00:01:52.890142+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:01:52.890142+0000","last_undegraded":"2024-09-11T00:01:52.890142+0000","last_fullsized":"2024-09-11T00:01:52.890142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870158+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:01:52.870158+0000","last_peered":"2024-09-11T00:01:52.870158+0000","last_clean":"2024-09-11T00:01:52.870158+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:01:52.870158+0000","last_undegraded":"2024-09-11T00:01:52.870158+0000","last_fullsized":"2024-09-11T00:01:52.870158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885516+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:01:52.885516+0000","last_peered":"2024-09-11T00:01:52.885516+0000","last_clean":"2024-09-11T00:01:52.885516+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:01:52.885516+0000","last_undegraded":"2024-09-11T00:01:52.885516+0000","last_fullsized":"2024-09-11T00:01:52.885516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886565+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:01:52.886565+0000","last_peered":"2024-09-11T00:01:52.886565+0000","last_clean":"2024-09-11T00:01:52.886565+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:01:52.886565+0000","last_undegraded":"2024-09-11T00:01:52.886565+0000","last_fullsized":"2024-09-11T00:01:52.886565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887122+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:01:52.887122+0000","last_peered":"2024-09-11T00:01:52.887122+0000","last_clean":"2024-09-11T00:01:52.887122+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:01:52.887122+0000","last_undegraded":"2024-09-11T00:01:52.887122+0000","last_fullsized":"2024-09-11T00:01:52.887122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887902+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:01:52.887902+0000","last_peered":"2024-09-11T00:01:52.887902+0000","last_clean":"2024-09-11T00:01:52.887902+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:01:52.887902+0000","last_undegraded":"2024-09-11T00:01:52.887902+0000","last_fullsized":"2024-09-11T00:01:52.887902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887965+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:01:52.887965+0000","last_peered":"2024-09-11T00:01:52.887965+0000","last_clean":"2024-09-11T00:01:52.887965+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:01:52.887965+0000","last_undegraded":"2024-09-11T00:01:52.887965+0000","last_fullsized":"2024-09-11T00:01:52.887965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887640+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:01:52.887640+0000","last_peered":"2024-09-11T00:01:52.887640+0000","last_clean":"2024-09-11T00:01:52.887640+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:01:52.887640+0000","last_undegraded":"2024-09-11T00:01:52.887640+0000","last_fullsized":"2024-09-11T00:01:52.887640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885127+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:01:52.885127+0000","last_peered":"2024-09-11T00:01:52.885127+0000","last_clean":"2024-09-11T00:01:52.885127+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:01:52.885127+0000","last_undegraded":"2024-09-11T00:01:52.885127+0000","last_fullsized":"2024-09-11T00:01:52.885127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.874083+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:01:52.874083+0000","last_peered":"2024-09-11T00:01:52.874083+0000","last_clean":"2024-09-11T00:01:52.874083+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:01:52.874083+0000","last_undegraded":"2024-09-11T00:01:52.874083+0000","last_fullsized":"2024-09-11T00:01:52.874083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882199+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:01:52.882199+0000","last_peered":"2024-09-11T00:01:52.882199+0000","last_clean":"2024-09-11T00:01:52.882199+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:01:52.882199+0000","last_undegraded":"2024-09-11T00:01:52.882199+0000","last_fullsized":"2024-09-11T00:01:52.882199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891557+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:01:52.891557+0000","last_peered":"2024-09-11T00:01:52.891557+0000","last_clean":"2024-09-11T00:01:52.891557+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:01:52.891557+0000","last_undegraded":"2024-09-11T00:01:52.891557+0000","last_fullsized":"2024-09-11T00:01:52.891557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882465+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:01:52.882465+0000","last_peered":"2024-09-11T00:01:52.882465+0000","last_clean":"2024-09-11T00:01:52.882465+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:01:52.882465+0000","last_undegraded":"2024-09-11T00:01:52.882465+0000","last_fullsized":"2024-09-11T00:01:52.882465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881842+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:01:52.881842+0000","last_peered":"2024-09-11T00:01:52.881842+0000","last_clean":"2024-09-11T00:01:52.881842+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:01:52.881842+0000","last_undegraded":"2024-09-11T00:01:52.881842+0000","last_fullsized":"2024-09-11T00:01:52.881842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.875498+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:01:52.875498+0000","last_peered":"2024-09-11T00:01:52.875498+0000","last_clean":"2024-09-11T00:01:52.875498+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:01:52.875498+0000","last_undegraded":"2024-09-11T00:01:52.875498+0000","last_fullsized":"2024-09-11T00:01:52.875498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891930+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:01:52.891930+0000","last_peered":"2024-09-11T00:01:52.891930+0000","last_clean":"2024-09-11T00:01:52.891930+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:01:52.891930+0000","last_undegraded":"2024-09-11T00:01:52.891930+0000","last_fullsized":"2024-09-11T00:01:52.891930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.880183+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:01:52.880183+0000","last_peered":"2024-09-11T00:01:52.880183+0000","last_clean":"2024-09-11T00:01:52.880183+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:01:52.880183+0000","last_undegraded":"2024-09-11T00:01:52.880183+0000","last_fullsized":"2024-09-11T00:01:52.880183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.883179+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:01:52.883179+0000","last_peered":"2024-09-11T00:01:52.883179+0000","last_clean":"2024-09-11T00:01:52.883179+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:01:52.883179+0000","last_undegraded":"2024-09-11T00:01:52.883179+0000","last_fullsized":"2024-09-11T00:01:52.883179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885014+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:01:52.885014+0000","last_peered":"2024-09-11T00:01:52.885014+0000","last_clean":"2024-09-11T00:01:52.885014+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:01:52.885014+0000","last_undegraded":"2024-09-11T00:01:52.885014+0000","last_fullsized":"2024-09-11T00:01:52.885014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884768+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:01:52.884768+0000","last_peered":"2024-09-11T00:01:52.884768+0000","last_clean":"2024-09-11T00:01:52.884768+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:01:52.884768+0000","last_undegraded":"2024-09-11T00:01:52.884768+0000","last_fullsized":"2024-09-11T00:01:52.884768+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886302+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:01:52.886302+0000","last_peered":"2024-09-11T00:01:52.886302+0000","last_clean":"2024-09-11T00:01:52.886302+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:01:52.886302+0000","last_undegraded":"2024-09-11T00:01:52.886302+0000","last_fullsized":"2024-09-11T00:01:52.886302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881240+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:01:52.881240+0000","last_peered":"2024-09-11T00:01:52.881240+0000","last_clean":"2024-09-11T00:01:52.881240+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:01:52.881240+0000","last_undegraded":"2024-09-11T00:01:52.881240+0000","last_fullsized":"2024-09-11T00:01:52.881240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879982+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:01:52.879982+0000","last_peered":"2024-09-11T00:01:52.879982+0000","last_clean":"2024-09-11T00:01:52.879982+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:01:52.879982+0000","last_undegraded":"2024-09-11T00:01:52.879982+0000","last_fullsized":"2024-09-11T00:01:52.879982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:26.459433+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:02:26.459433+0000","last_peered":"2024-09-11T00:02:26.459433+0000","last_clean":"2024-09-11T00:02:26.459433+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:02:26.459433+0000","last_undegraded":"2024-09-11T00:02:26.459433+0000","last_fullsized":"2024-09-11T00:02:26.459433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884259+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:01:52.884259+0000","last_peered":"2024-09-11T00:01:52.884259+0000","last_clean":"2024-09-11T00:01:52.884259+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:01:52.884259+0000","last_undegraded":"2024-09-11T00:01:52.884259+0000","last_fullsized":"2024-09-11T00:01:52.884259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.877643+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:01:52.877643+0000","last_peered":"2024-09-11T00:01:52.877643+0000","last_clean":"2024-09-11T00:01:52.877643+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:01:52.877643+0000","last_undegraded":"2024-09-11T00:01:52.877643+0000","last_fullsized":"2024-09-11T00:01:52.877643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879277+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:01:52.879277+0000","last_peered":"2024-09-11T00:01:52.879277+0000","last_clean":"2024-09-11T00:01:52.879277+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:01:52.879277+0000","last_undegraded":"2024-09-11T00:01:52.879277+0000","last_fullsized":"2024-09-11T00:01:52.879277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:30.469620+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:02:30.469620+0000","last_peered":"2024-09-11T00:02:30.469620+0000","last_clean":"2024-09-11T00:02:30.469620+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:02:30.469620+0000","last_undegraded":"2024-09-11T00:02:30.469620+0000","last_fullsized":"2024-09-11T00:02:30.469620+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889091+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:01:52.889091+0000","last_peered":"2024-09-11T00:01:52.889091+0000","last_clean":"2024-09-11T00:01:52.889091+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:01:52.889091+0000","last_undegraded":"2024-09-11T00:01:52.889091+0000","last_fullsized":"2024-09-11T00:01:52.889091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886398+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:01:52.886398+0000","last_peered":"2024-09-11T00:01:52.886398+0000","last_clean":"2024-09-11T00:01:52.886398+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:01:52.886398+0000","last_undegraded":"2024-09-11T00:01:52.886398+0000","last_fullsized":"2024-09-11T00:01:52.886398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891618+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:01:52.891618+0000","last_peered":"2024-09-11T00:01:52.891618+0000","last_clean":"2024-09-11T00:01:52.891618+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:01:52.891618+0000","last_undegraded":"2024-09-11T00:01:52.891618+0000","last_fullsized":"2024-09-11T00:01:52.891618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'33","reported_seq":294,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:31.467908+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:02:31.467908+0000","last_peered":"2024-09-11T00:02:31.467908+0000","last_clean":"2024-09-11T00:02:31.467908+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:02:31.467908+0000","last_undegraded":"2024-09-11T00:02:31.467908+0000","last_fullsized":"2024-09-11T00:02:31.467908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65530,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":183,"num_write":34,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870369+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:01:52.870369+0000","last_peered":"2024-09-11T00:01:52.870369+0000","last_clean":"2024-09-11T00:01:52.870369+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:01:52.870369+0000","last_undegraded":"2024-09-11T00:01:52.870369+0000","last_fullsized":"2024-09-11T00:01:52.870369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.875766+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:01:52.875766+0000","last_peered":"2024-09-11T00:01:52.875766+0000","last_clean":"2024-09-11T00:01:52.875766+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:01:52.875766+0000","last_undegraded":"2024-09-11T00:01:52.875766+0000","last_fullsized":"2024-09-11T00:01:52.875766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":40,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881210+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:01:52.881210+0000","last_peered":"2024-09-11T00:01:52.881210+0000","last_clean":"2024-09-11T00:01:52.881210+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:01:52.881210+0000","last_undegraded":"2024-09-11T00:01:52.881210+0000","last_fullsized":"2024-09-11T00:01:52.881210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'5","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:26.465069+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:02:26.465069+0000","last_peered":"2024-09-11T00:02:26.465069+0000","last_clean":"2024-09-11T00:02:26.465069+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:02:26.465069+0000","last_undegraded":"2024-09-11T00:02:26.465069+0000","last_fullsized":"2024-09-11T00:02:26.465069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878439+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:01:52.878439+0000","last_peered":"2024-09-11T00:01:52.878439+0000","last_clean":"2024-09-11T00:01:52.878439+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:01:52.878439+0000","last_undegraded":"2024-09-11T00:01:52.878439+0000","last_fullsized":"2024-09-11T00:01:52.878439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889807+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:01:52.889807+0000","last_peered":"2024-09-11T00:01:52.889807+0000","last_clean":"2024-09-11T00:01:52.889807+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:01:52.889807+0000","last_undegraded":"2024-09-11T00:01:52.889807+0000","last_fullsized":"2024-09-11T00:01:52.889807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878443+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:01:52.878443+0000","last_peered":"2024-09-11T00:01:52.878443+0000","last_clean":"2024-09-11T00:01:52.878443+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:01:52.878443+0000","last_undegraded":"2024-09-11T00:01:52.878443+0000","last_fullsized":"2024-09-11T00:01:52.878443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.872864+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:01:52.872864+0000","last_peered":"2024-09-11T00:01:52.872864+0000","last_clean":"2024-09-11T00:01:52.872864+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:01:52.872864+0000","last_undegraded":"2024-09-11T00:01:52.872864+0000","last_fullsized":"2024-09-11T00:01:52.872864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878190+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:01:52.878190+0000","last_peered":"2024-09-11T00:01:52.878190+0000","last_clean":"2024-09-11T00:01:52.878190+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:01:52.878190+0000","last_undegraded":"2024-09-11T00:01:52.878190+0000","last_fullsized":"2024-09-11T00:01:52.878190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890272+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:01:52.890272+0000","last_peered":"2024-09-11T00:01:52.890272+0000","last_clean":"2024-09-11T00:01:52.890272+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:01:52.890272+0000","last_undegraded":"2024-09-11T00:01:52.890272+0000","last_fullsized":"2024-09-11T00:01:52.890272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607398+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607398+0000","last_peered":"2024-09-11T00:00:53.607398+0000","last_clean":"2024-09-11T00:00:53.607398+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607398+0000","last_undegraded":"2024-09-11T00:00:53.607398+0000","last_fullsized":"2024-09-11T00:00:53.607398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605463+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605463+0000","last_peered":"2024-09-11T00:00:53.605463+0000","last_clean":"2024-09-11T00:00:53.605463+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605463+0000","last_undegraded":"2024-09-11T00:00:53.605463+0000","last_fullsized":"2024-09-11T00:00:53.605463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886459+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:01:52.886459+0000","last_peered":"2024-09-11T00:01:52.886459+0000","last_clean":"2024-09-11T00:01:52.886459+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:01:52.886459+0000","last_undegraded":"2024-09-11T00:01:52.886459+0000","last_fullsized":"2024-09-11T00:01:52.886459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607303+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607303+0000","last_peered":"2024-09-11T00:00:53.607303+0000","last_clean":"2024-09-11T00:00:53.607303+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607303+0000","last_undegraded":"2024-09-11T00:00:53.607303+0000","last_fullsized":"2024-09-11T00:00:53.607303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879698+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:01:52.879698+0000","last_peered":"2024-09-11T00:01:52.879698+0000","last_clean":"2024-09-11T00:01:52.879698+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:01:52.879698+0000","last_undegraded":"2024-09-11T00:01:52.879698+0000","last_fullsized":"2024-09-11T00:01:52.879698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:28.467618+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:02:28.467618+0000","last_peered":"2024-09-11T00:02:28.467618+0000","last_clean":"2024-09-11T00:02:28.467618+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:02:28.467618+0000","last_undegraded":"2024-09-11T00:02:28.467618+0000","last_fullsized":"2024-09-11T00:02:28.467618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.864150+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:01:52.864150+0000","last_peered":"2024-09-11T00:01:52.864150+0000","last_clean":"2024-09-11T00:01:52.864150+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:01:52.864150+0000","last_undegraded":"2024-09-11T00:01:52.864150+0000","last_fullsized":"2024-09-11T00:01:52.864150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607859+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607859+0000","last_peered":"2024-09-11T00:00:53.607859+0000","last_clean":"2024-09-11T00:00:53.607859+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607859+0000","last_undegraded":"2024-09-11T00:00:53.607859+0000","last_fullsized":"2024-09-11T00:00:53.607859+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.871115+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:01:52.871115+0000","last_peered":"2024-09-11T00:01:52.871115+0000","last_clean":"2024-09-11T00:01:52.871115+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:01:52.871115+0000","last_undegraded":"2024-09-11T00:01:52.871115+0000","last_fullsized":"2024-09-11T00:01:52.871115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612530+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.612530+0000","last_peered":"2024-09-11T00:00:53.612530+0000","last_clean":"2024-09-11T00:00:53.612530+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.612530+0000","last_undegraded":"2024-09-11T00:00:53.612530+0000","last_fullsized":"2024-09-11T00:00:53.612530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.877630+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:01:52.877630+0000","last_peered":"2024-09-11T00:01:52.877630+0000","last_clean":"2024-09-11T00:01:52.877630+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:01:52.877630+0000","last_undegraded":"2024-09-11T00:01:52.877630+0000","last_fullsized":"2024-09-11T00:01:52.877630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608936+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608936+0000","last_peered":"2024-09-11T00:00:53.608936+0000","last_clean":"2024-09-11T00:00:53.608936+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608936+0000","last_undegraded":"2024-09-11T00:00:53.608936+0000","last_fullsized":"2024-09-11T00:00:53.608936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882853+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:01:52.882853+0000","last_peered":"2024-09-11T00:01:52.882853+0000","last_clean":"2024-09-11T00:01:52.882853+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:01:52.882853+0000","last_undegraded":"2024-09-11T00:01:52.882853+0000","last_fullsized":"2024-09-11T00:01:52.882853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:29.264004+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:02:29.264004+0000","last_peered":"2024-09-11T00:02:29.264004+0000","last_clean":"2024-09-11T00:02:29.264004+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:02:29.264004+0000","last_undegraded":"2024-09-11T00:02:29.264004+0000","last_fullsized":"2024-09-11T00:02:29.264004+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870163+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:01:52.870163+0000","last_peered":"2024-09-11T00:01:52.870163+0000","last_clean":"2024-09-11T00:01:52.870163+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:01:52.870163+0000","last_undegraded":"2024-09-11T00:01:52.870163+0000","last_fullsized":"2024-09-11T00:01:52.870163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885223+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:01:52.885223+0000","last_peered":"2024-09-11T00:01:52.885223+0000","last_clean":"2024-09-11T00:01:52.885223+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:01:52.885223+0000","last_undegraded":"2024-09-11T00:01:52.885223+0000","last_fullsized":"2024-09-11T00:01:52.885223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.859253+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:01:52.859253+0000","last_peered":"2024-09-11T00:01:52.859253+0000","last_clean":"2024-09-11T00:01:52.859253+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:01:52.859253+0000","last_undegraded":"2024-09-11T00:01:52.859253+0000","last_fullsized":"2024-09-11T00:01:52.859253+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886475+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:01:52.886475+0000","last_peered":"2024-09-11T00:01:52.886475+0000","last_clean":"2024-09-11T00:01:52.886475+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:01:52.886475+0000","last_undegraded":"2024-09-11T00:01:52.886475+0000","last_fullsized":"2024-09-11T00:01:52.886475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878986+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:01:52.878986+0000","last_peered":"2024-09-11T00:01:52.878986+0000","last_clean":"2024-09-11T00:01:52.878986+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:01:52.878986+0000","last_undegraded":"2024-09-11T00:01:52.878986+0000","last_fullsized":"2024-09-11T00:01:52.878986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890344+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:01:52.890344+0000","last_peered":"2024-09-11T00:01:52.890344+0000","last_clean":"2024-09-11T00:01:52.890344+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:01:52.890344+0000","last_undegraded":"2024-09-11T00:01:52.890344+0000","last_fullsized":"2024-09-11T00:01:52.890344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891153+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:01:52.891153+0000","last_peered":"2024-09-11T00:01:52.891153+0000","last_clean":"2024-09-11T00:01:52.891153+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:01:52.891153+0000","last_undegraded":"2024-09-11T00:01:52.891153+0000","last_fullsized":"2024-09-11T00:01:52.891153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889337+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:01:52.889337+0000","last_peered":"2024-09-11T00:01:52.889337+0000","last_clean":"2024-09-11T00:01:52.889337+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:01:52.889337+0000","last_undegraded":"2024-09-11T00:01:52.889337+0000","last_fullsized":"2024-09-11T00:01:52.889337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889030+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:01:52.889030+0000","last_peered":"2024-09-11T00:01:52.889030+0000","last_clean":"2024-09-11T00:01:52.889030+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:01:52.889030+0000","last_undegraded":"2024-09-11T00:01:52.889030+0000","last_fullsized":"2024-09-11T00:01:52.889030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697983+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697983+0000","last_peered":"2024-09-11T00:00:53.697983+0000","last_clean":"2024-09-11T00:00:53.697983+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697983+0000","last_undegraded":"2024-09-11T00:00:53.697983+0000","last_fullsized":"2024-09-11T00:00:53.697983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884753+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:01:52.884753+0000","last_peered":"2024-09-11T00:01:52.884753+0000","last_clean":"2024-09-11T00:01:52.884753+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:01:52.884753+0000","last_undegraded":"2024-09-11T00:01:52.884753+0000","last_fullsized":"2024-09-11T00:01:52.884753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604797+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604797+0000","last_peered":"2024-09-11T00:00:53.604797+0000","last_clean":"2024-09-11T00:00:53.604797+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604797+0000","last_undegraded":"2024-09-11T00:00:53.604797+0000","last_fullsized":"2024-09-11T00:00:53.604797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69672,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":698,"num_read_kb":425,"num_write":175,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710759,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1079589,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":1014664,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626495,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1013425,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":423222,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378709,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":481998,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":481230,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705759,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:02:34.427 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-11T00:02:34.427 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:02:34.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:34 smithi135 ceph-mon[35432]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T00:02:34.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:34 smithi131 ceph-mon[35491]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T00:02:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 -- 172.21.15.19:0/2277257290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 msgr2=0x7f3b3410f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 --2- 172.21.15.19:0/2277257290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b3410f8c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009ca0 tx=0x7f3b2c02a950 comp rx=0 tx=0).stop 2024-09-11T00:02:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 -- 172.21.15.19:0/2277257290 shutdown_connections 2024-09-11T00:02:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 --2- 172.21.15.19:0/2277257290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b3410f8c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 --2- 172.21.15.19:0/2277257290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b34102040 0x7f3b34108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 --2- 172.21.15.19:0/2277257290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b34101720 0x7f3b34101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 -- 172.21.15.19:0/2277257290 >> 172.21.15.19:0/2277257290 conn(0x7f3b34076e90 msgr2=0x7f3b340772a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 -- 172.21.15.19:0/2277257290 shutdown_connections 2024-09-11T00:02:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.566+0000 7f3b397c6640 1 -- 172.21.15.19:0/2277257290 wait complete. 2024-09-11T00:02:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.567+0000 7f3b397c6640 1 Processor -- start 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.567+0000 7f3b397c6640 1 -- start start 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.567+0000 7f3b397c6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b34101720 0x7f3b3419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.567+0000 7f3b397c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b34102040 0x7f3b3419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b397c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b341a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b397c6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b34112cf0 con 0x7f3b34108ff0 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b397c6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3b34112b70 con 0x7f3b34101720 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b397c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3b34112e70 con 0x7f3b34102040 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b341a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b341a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33358/0 (socket says 172.21.15.19:33358) 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 -- 172.21.15.19:0/1713275953 learned_addr learned my addr 172.21.15.19:0/1713275953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b32ffd640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b34101720 0x7f3b3419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b327fc640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b34102040 0x7f3b3419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 -- 172.21.15.19:0/1713275953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b34102040 msgr2=0x7f3b3419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b34102040 0x7f3b3419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 -- 172.21.15.19:0/1713275953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b34101720 msgr2=0x7f3b3419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b34101720 0x7f3b3419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 -- 172.21.15.19:0/1713275953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b341a13d0 con 0x7f3b34108ff0 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b337fe640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b341a0c00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c02ae70 tx=0x7f3b2c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b2bfff640 1 -- 172.21.15.19:0/1713275953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c034040 con 0x7f3b34108ff0 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b2bfff640 1 -- 172.21.15.19:0/1713275953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b2c0308f0 con 0x7f3b34108ff0 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b341a1660 con 0x7f3b34108ff0 2024-09-11T00:02:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b2bfff640 1 -- 172.21.15.19:0/1713275953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c004720 con 0x7f3b34108ff0 2024-09-11T00:02:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.568+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b341a7d80 con 0x7f3b34108ff0 2024-09-11T00:02:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.569+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b34101b00 con 0x7f3b34108ff0 2024-09-11T00:02:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.571+0000 7f3b2bfff640 1 -- 172.21.15.19:0/1713275953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f3b2c04d030 con 0x7f3b34108ff0 2024-09-11T00:02:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.571+0000 7f3b2bfff640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3b200b53c0 0x7f3b200b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.572+0000 7f3b32ffd640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3b200b53c0 0x7f3b200b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.572+0000 7f3b2bfff640 1 -- 172.21.15.19:0/1713275953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f3b2c106c50 con 0x7f3b34108ff0 2024-09-11T00:02:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.572+0000 7f3b32ffd640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3b200b53c0 0x7f3b200b7880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b24005fd0 tx=0x7f3b2400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.574+0000 7f3b2bfff640 1 -- 172.21.15.19:0/1713275953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3b2c0cd910 con 0x7f3b34108ff0 2024-09-11T00:02:34.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.757+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b34063590 con 0x7f3b200b53c0 2024-09-11T00:02:34.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.761+0000 7f3b2bfff640 1 -- 172.21.15.19:0/1713275953 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259077 (secure 0 0 0) 0x7f3b34063590 con 0x7f3b200b53c0 2024-09-11T00:02:34.765 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:34.766 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-11T00:02:34.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3b200b53c0 msgr2=0x7f3b200b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3b200b53c0 0x7f3b200b7880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b24005fd0 tx=0x7f3b2400b390 comp rx=0 tx=0).stop 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 msgr2=0x7f3b341a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b341a0c00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c02ae70 tx=0x7f3b2c02f5d0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 shutdown_connections 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3b200b53c0 0x7f3b200b7880 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b34108ff0 0x7f3b341a0c00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.764+0000 7f3b397c6640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b34102040 0x7f3b3419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.765+0000 7f3b397c6640 1 --2- 172.21.15.19:0/1713275953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b34101720 0x7f3b3419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.765+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 >> 172.21.15.19:0/1713275953 conn(0x7f3b34076e90 msgr2=0x7f3b34102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.765+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 shutdown_connections 2024-09-11T00:02:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:34.765+0000 7f3b397c6640 1 -- 172.21.15.19:0/1713275953 wait complete. 2024-09-11T00:02:34.777 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-11T00:02:34.519911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660665,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":790,"num_read_kb":495,"num_write":301,"num_write_kb":2277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":743,"ondisk_log_size":743,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363828,"kb_used_data":10420,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577996,"statfs":{"total":1151940427776,"available":1151567867904,"internally_reserved":0,"allocated":10670080,"data_stored":7027644,"data_compressed":176808,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6463,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39,"num_write":10,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003128"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887900+0000","last_change":"2024-09-11T00:00:28.248779+0000","last_active":"2024-09-11T00:01:52.887900+0000","last_peered":"2024-09-11T00:01:52.887900+0000","last_clean":"2024-09-11T00:01:52.887900+0000","last_became_active":"2024-09-11T00:00:28.248164+0000","last_became_peered":"2024-09-11T00:00:28.248164+0000","last_unstale":"2024-09-11T00:01:52.887900+0000","last_undegraded":"2024-09-11T00:01:52.887900+0000","last_fullsized":"2024-09-11T00:01:52.887900+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:53.832647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884200+0000","last_change":"2024-09-11T00:00:28.242002+0000","last_active":"2024-09-11T00:01:52.884200+0000","last_peered":"2024-09-11T00:01:52.884200+0000","last_clean":"2024-09-11T00:01:52.884200+0000","last_became_active":"2024-09-11T00:00:28.241683+0000","last_became_peered":"2024-09-11T00:00:28.241683+0000","last_unstale":"2024-09-11T00:01:52.884200+0000","last_undegraded":"2024-09-11T00:01:52.884200+0000","last_fullsized":"2024-09-11T00:01:52.884200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.888305+0000","last_change":"2024-09-11T00:00:28.238816+0000","last_active":"2024-09-11T00:01:52.888305+0000","last_peered":"2024-09-11T00:01:52.888305+0000","last_clean":"2024-09-11T00:01:52.888305+0000","last_became_active":"2024-09-11T00:00:28.238533+0000","last_became_peered":"2024-09-11T00:00:28.238533+0000","last_unstale":"2024-09-11T00:01:52.888305+0000","last_undegraded":"2024-09-11T00:01:52.888305+0000","last_fullsized":"2024-09-11T00:01:52.888305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.947446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887506+0000","last_change":"2024-09-11T00:00:28.251385+0000","last_active":"2024-09-11T00:01:52.887506+0000","last_peered":"2024-09-11T00:01:52.887506+0000","last_clean":"2024-09-11T00:01:52.887506+0000","last_became_active":"2024-09-11T00:00:28.250881+0000","last_became_peered":"2024-09-11T00:00:28.250881+0000","last_unstale":"2024-09-11T00:01:52.887506+0000","last_undegraded":"2024-09-11T00:01:52.887506+0000","last_fullsized":"2024-09-11T00:01:52.887506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:30.509254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.880125+0000","last_change":"2024-09-11T00:00:28.243186+0000","last_active":"2024-09-11T00:01:52.880125+0000","last_peered":"2024-09-11T00:01:52.880125+0000","last_clean":"2024-09-11T00:01:52.880125+0000","last_became_active":"2024-09-11T00:00:28.242838+0000","last_became_peered":"2024-09-11T00:00:28.242838+0000","last_unstale":"2024-09-11T00:01:52.880125+0000","last_undegraded":"2024-09-11T00:01:52.880125+0000","last_fullsized":"2024-09-11T00:01:52.880125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:14.976329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.876164+0000","last_change":"2024-09-11T00:00:28.247124+0000","last_active":"2024-09-11T00:01:52.876164+0000","last_peered":"2024-09-11T00:01:52.876164+0000","last_clean":"2024-09-11T00:01:52.876164+0000","last_became_active":"2024-09-11T00:00:28.246787+0000","last_became_peered":"2024-09-11T00:00:28.246787+0000","last_unstale":"2024-09-11T00:01:52.876164+0000","last_undegraded":"2024-09-11T00:01:52.876164+0000","last_fullsized":"2024-09-11T00:01:52.876164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:22.297491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878226+0000","last_change":"2024-09-11T00:00:28.247505+0000","last_active":"2024-09-11T00:01:52.878226+0000","last_peered":"2024-09-11T00:01:52.878226+0000","last_clean":"2024-09-11T00:01:52.878226+0000","last_became_active":"2024-09-11T00:00:28.247190+0000","last_became_peered":"2024-09-11T00:00:28.247190+0000","last_unstale":"2024-09-11T00:01:52.878226+0000","last_undegraded":"2024-09-11T00:01:52.878226+0000","last_fullsized":"2024-09-11T00:01:52.878226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:18.888495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884654+0000","last_change":"2024-09-11T00:00:28.248886+0000","last_active":"2024-09-11T00:01:52.884654+0000","last_peered":"2024-09-11T00:01:52.884654+0000","last_clean":"2024-09-11T00:01:52.884654+0000","last_became_active":"2024-09-11T00:00:28.248585+0000","last_became_peered":"2024-09-11T00:00:28.248585+0000","last_unstale":"2024-09-11T00:01:52.884654+0000","last_undegraded":"2024-09-11T00:01:52.884654+0000","last_fullsized":"2024-09-11T00:01:52.884654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:58.315831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891837+0000","last_change":"2024-09-11T00:00:28.248159+0000","last_active":"2024-09-11T00:01:52.891837+0000","last_peered":"2024-09-11T00:01:52.891837+0000","last_clean":"2024-09-11T00:01:52.891837+0000","last_became_active":"2024-09-11T00:00:28.247815+0000","last_became_peered":"2024-09-11T00:00:28.247815+0000","last_unstale":"2024-09-11T00:01:52.891837+0000","last_undegraded":"2024-09-11T00:01:52.891837+0000","last_fullsized":"2024-09-11T00:01:52.891837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:18.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884749+0000","last_change":"2024-09-11T00:00:28.245227+0000","last_active":"2024-09-11T00:01:52.884749+0000","last_peered":"2024-09-11T00:01:52.884749+0000","last_clean":"2024-09-11T00:01:52.884749+0000","last_became_active":"2024-09-11T00:00:28.244912+0000","last_became_peered":"2024-09-11T00:00:28.244912+0000","last_unstale":"2024-09-11T00:01:52.884749+0000","last_undegraded":"2024-09-11T00:01:52.884749+0000","last_fullsized":"2024-09-11T00:01:52.884749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:44.820718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890142+0000","last_change":"2024-09-11T00:00:28.243830+0000","last_active":"2024-09-11T00:01:52.890142+0000","last_peered":"2024-09-11T00:01:52.890142+0000","last_clean":"2024-09-11T00:01:52.890142+0000","last_became_active":"2024-09-11T00:00:28.243173+0000","last_became_peered":"2024-09-11T00:00:28.243173+0000","last_unstale":"2024-09-11T00:01:52.890142+0000","last_undegraded":"2024-09-11T00:01:52.890142+0000","last_fullsized":"2024-09-11T00:01:52.890142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:28.313668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870158+0000","last_change":"2024-09-11T00:00:28.247587+0000","last_active":"2024-09-11T00:01:52.870158+0000","last_peered":"2024-09-11T00:01:52.870158+0000","last_clean":"2024-09-11T00:01:52.870158+0000","last_became_active":"2024-09-11T00:00:28.247263+0000","last_became_peered":"2024-09-11T00:00:28.247263+0000","last_unstale":"2024-09-11T00:01:52.870158+0000","last_undegraded":"2024-09-11T00:01:52.870158+0000","last_fullsized":"2024-09-11T00:01:52.870158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:35.529265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885516+0000","last_change":"2024-09-11T00:00:28.244598+0000","last_active":"2024-09-11T00:01:52.885516+0000","last_peered":"2024-09-11T00:01:52.885516+0000","last_clean":"2024-09-11T00:01:52.885516+0000","last_became_active":"2024-09-11T00:00:28.244281+0000","last_became_peered":"2024-09-11T00:00:28.244281+0000","last_unstale":"2024-09-11T00:01:52.885516+0000","last_undegraded":"2024-09-11T00:01:52.885516+0000","last_fullsized":"2024-09-11T00:01:52.885516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:26.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886565+0000","last_change":"2024-09-11T00:00:28.241483+0000","last_active":"2024-09-11T00:01:52.886565+0000","last_peered":"2024-09-11T00:01:52.886565+0000","last_clean":"2024-09-11T00:01:52.886565+0000","last_became_active":"2024-09-11T00:00:28.241163+0000","last_became_peered":"2024-09-11T00:00:28.241163+0000","last_unstale":"2024-09-11T00:01:52.886565+0000","last_undegraded":"2024-09-11T00:01:52.886565+0000","last_fullsized":"2024-09-11T00:01:52.886565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.571990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887122+0000","last_change":"2024-09-11T00:00:28.245531+0000","last_active":"2024-09-11T00:01:52.887122+0000","last_peered":"2024-09-11T00:01:52.887122+0000","last_clean":"2024-09-11T00:01:52.887122+0000","last_became_active":"2024-09-11T00:00:28.245214+0000","last_became_peered":"2024-09-11T00:00:28.245214+0000","last_unstale":"2024-09-11T00:01:52.887122+0000","last_undegraded":"2024-09-11T00:01:52.887122+0000","last_fullsized":"2024-09-11T00:01:52.887122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:20.194552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887902+0000","last_change":"2024-09-11T00:00:28.241864+0000","last_active":"2024-09-11T00:01:52.887902+0000","last_peered":"2024-09-11T00:01:52.887902+0000","last_clean":"2024-09-11T00:01:52.887902+0000","last_became_active":"2024-09-11T00:00:28.240515+0000","last_became_peered":"2024-09-11T00:00:28.240515+0000","last_unstale":"2024-09-11T00:01:52.887902+0000","last_undegraded":"2024-09-11T00:01:52.887902+0000","last_fullsized":"2024-09-11T00:01:52.887902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:12.887485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887965+0000","last_change":"2024-09-11T00:00:28.248504+0000","last_active":"2024-09-11T00:01:52.887965+0000","last_peered":"2024-09-11T00:01:52.887965+0000","last_clean":"2024-09-11T00:01:52.887965+0000","last_became_active":"2024-09-11T00:00:28.247780+0000","last_became_peered":"2024-09-11T00:00:28.247780+0000","last_unstale":"2024-09-11T00:01:52.887965+0000","last_undegraded":"2024-09-11T00:01:52.887965+0000","last_fullsized":"2024-09-11T00:01:52.887965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:54.942116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.887640+0000","last_change":"2024-09-11T00:00:28.242809+0000","last_active":"2024-09-11T00:01:52.887640+0000","last_peered":"2024-09-11T00:01:52.887640+0000","last_clean":"2024-09-11T00:01:52.887640+0000","last_became_active":"2024-09-11T00:00:28.242529+0000","last_became_peered":"2024-09-11T00:00:28.242529+0000","last_unstale":"2024-09-11T00:01:52.887640+0000","last_undegraded":"2024-09-11T00:01:52.887640+0000","last_fullsized":"2024-09-11T00:01:52.887640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:29.051612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885127+0000","last_change":"2024-09-11T00:00:28.238468+0000","last_active":"2024-09-11T00:01:52.885127+0000","last_peered":"2024-09-11T00:01:52.885127+0000","last_clean":"2024-09-11T00:01:52.885127+0000","last_became_active":"2024-09-11T00:00:28.237834+0000","last_became_peered":"2024-09-11T00:00:28.237834+0000","last_unstale":"2024-09-11T00:01:52.885127+0000","last_undegraded":"2024-09-11T00:01:52.885127+0000","last_fullsized":"2024-09-11T00:01:52.885127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:28.697885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.874083+0000","last_change":"2024-09-11T00:00:28.244545+0000","last_active":"2024-09-11T00:01:52.874083+0000","last_peered":"2024-09-11T00:01:52.874083+0000","last_clean":"2024-09-11T00:01:52.874083+0000","last_became_active":"2024-09-11T00:00:28.244218+0000","last_became_peered":"2024-09-11T00:00:28.244218+0000","last_unstale":"2024-09-11T00:01:52.874083+0000","last_undegraded":"2024-09-11T00:01:52.874083+0000","last_fullsized":"2024-09-11T00:01:52.874083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.657221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882199+0000","last_change":"2024-09-11T00:00:28.233846+0000","last_active":"2024-09-11T00:01:52.882199+0000","last_peered":"2024-09-11T00:01:52.882199+0000","last_clean":"2024-09-11T00:01:52.882199+0000","last_became_active":"2024-09-11T00:00:28.233549+0000","last_became_peered":"2024-09-11T00:00:28.233549+0000","last_unstale":"2024-09-11T00:01:52.882199+0000","last_undegraded":"2024-09-11T00:01:52.882199+0000","last_fullsized":"2024-09-11T00:01:52.882199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891557+0000","last_change":"2024-09-11T00:00:28.239955+0000","last_active":"2024-09-11T00:01:52.891557+0000","last_peered":"2024-09-11T00:01:52.891557+0000","last_clean":"2024-09-11T00:01:52.891557+0000","last_became_active":"2024-09-11T00:00:28.239528+0000","last_became_peered":"2024-09-11T00:00:28.239528+0000","last_unstale":"2024-09-11T00:01:52.891557+0000","last_undegraded":"2024-09-11T00:01:52.891557+0000","last_fullsized":"2024-09-11T00:01:52.891557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:04.793545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882465+0000","last_change":"2024-09-11T00:00:28.240771+0000","last_active":"2024-09-11T00:01:52.882465+0000","last_peered":"2024-09-11T00:01:52.882465+0000","last_clean":"2024-09-11T00:01:52.882465+0000","last_became_active":"2024-09-11T00:00:28.240341+0000","last_became_peered":"2024-09-11T00:00:28.240341+0000","last_unstale":"2024-09-11T00:01:52.882465+0000","last_undegraded":"2024-09-11T00:01:52.882465+0000","last_fullsized":"2024-09-11T00:01:52.882465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:46.979732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881842+0000","last_change":"2024-09-11T00:00:28.247765+0000","last_active":"2024-09-11T00:01:52.881842+0000","last_peered":"2024-09-11T00:01:52.881842+0000","last_clean":"2024-09-11T00:01:52.881842+0000","last_became_active":"2024-09-11T00:00:28.247488+0000","last_became_peered":"2024-09-11T00:00:28.247488+0000","last_unstale":"2024-09-11T00:01:52.881842+0000","last_undegraded":"2024-09-11T00:01:52.881842+0000","last_fullsized":"2024-09-11T00:01:52.881842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:14.532537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.875498+0000","last_change":"2024-09-11T00:00:28.235994+0000","last_active":"2024-09-11T00:01:52.875498+0000","last_peered":"2024-09-11T00:01:52.875498+0000","last_clean":"2024-09-11T00:01:52.875498+0000","last_became_active":"2024-09-11T00:00:28.235623+0000","last_became_peered":"2024-09-11T00:00:28.235623+0000","last_unstale":"2024-09-11T00:01:52.875498+0000","last_undegraded":"2024-09-11T00:01:52.875498+0000","last_fullsized":"2024-09-11T00:01:52.875498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:51.199104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891930+0000","last_change":"2024-09-11T00:00:28.240722+0000","last_active":"2024-09-11T00:01:52.891930+0000","last_peered":"2024-09-11T00:01:52.891930+0000","last_clean":"2024-09-11T00:01:52.891930+0000","last_became_active":"2024-09-11T00:00:28.240400+0000","last_became_peered":"2024-09-11T00:00:28.240400+0000","last_unstale":"2024-09-11T00:01:52.891930+0000","last_undegraded":"2024-09-11T00:01:52.891930+0000","last_fullsized":"2024-09-11T00:01:52.891930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:00.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.880183+0000","last_change":"2024-09-11T00:00:28.250221+0000","last_active":"2024-09-11T00:01:52.880183+0000","last_peered":"2024-09-11T00:01:52.880183+0000","last_clean":"2024-09-11T00:01:52.880183+0000","last_became_active":"2024-09-11T00:00:28.248327+0000","last_became_peered":"2024-09-11T00:00:28.248327+0000","last_unstale":"2024-09-11T00:01:52.880183+0000","last_undegraded":"2024-09-11T00:01:52.880183+0000","last_fullsized":"2024-09-11T00:01:52.880183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:03.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.883179+0000","last_change":"2024-09-11T00:00:53.609930+0000","last_active":"2024-09-11T00:01:52.883179+0000","last_peered":"2024-09-11T00:01:52.883179+0000","last_clean":"2024-09-11T00:01:52.883179+0000","last_became_active":"2024-09-11T00:00:53.609576+0000","last_became_peered":"2024-09-11T00:00:53.609576+0000","last_unstale":"2024-09-11T00:01:52.883179+0000","last_undegraded":"2024-09-11T00:01:52.883179+0000","last_fullsized":"2024-09-11T00:01:52.883179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:12.451439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885014+0000","last_change":"2024-09-11T00:00:28.245750+0000","last_active":"2024-09-11T00:01:52.885014+0000","last_peered":"2024-09-11T00:01:52.885014+0000","last_clean":"2024-09-11T00:01:52.885014+0000","last_became_active":"2024-09-11T00:00:28.245443+0000","last_became_peered":"2024-09-11T00:00:28.245443+0000","last_unstale":"2024-09-11T00:01:52.885014+0000","last_undegraded":"2024-09-11T00:01:52.885014+0000","last_fullsized":"2024-09-11T00:01:52.885014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:27.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884768+0000","last_change":"2024-09-11T00:00:28.238115+0000","last_active":"2024-09-11T00:01:52.884768+0000","last_peered":"2024-09-11T00:01:52.884768+0000","last_clean":"2024-09-11T00:01:52.884768+0000","last_became_active":"2024-09-11T00:00:28.237747+0000","last_became_peered":"2024-09-11T00:00:28.237747+0000","last_unstale":"2024-09-11T00:01:52.884768+0000","last_undegraded":"2024-09-11T00:01:52.884768+0000","last_fullsized":"2024-09-11T00:01:52.884768+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:29.238879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886302+0000","last_change":"2024-09-11T00:00:28.245339+0000","last_active":"2024-09-11T00:01:52.886302+0000","last_peered":"2024-09-11T00:01:52.886302+0000","last_clean":"2024-09-11T00:01:52.886302+0000","last_became_active":"2024-09-11T00:00:28.244978+0000","last_became_peered":"2024-09-11T00:00:28.244978+0000","last_unstale":"2024-09-11T00:01:52.886302+0000","last_undegraded":"2024-09-11T00:01:52.886302+0000","last_fullsized":"2024-09-11T00:01:52.886302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:18.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881240+0000","last_change":"2024-09-11T00:00:28.248681+0000","last_active":"2024-09-11T00:01:52.881240+0000","last_peered":"2024-09-11T00:01:52.881240+0000","last_clean":"2024-09-11T00:01:52.881240+0000","last_became_active":"2024-09-11T00:00:28.247933+0000","last_became_peered":"2024-09-11T00:00:28.247933+0000","last_unstale":"2024-09-11T00:01:52.881240+0000","last_undegraded":"2024-09-11T00:01:52.881240+0000","last_fullsized":"2024-09-11T00:01:52.881240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:43.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879982+0000","last_change":"2024-09-11T00:00:28.243465+0000","last_active":"2024-09-11T00:01:52.879982+0000","last_peered":"2024-09-11T00:01:52.879982+0000","last_clean":"2024-09-11T00:01:52.879982+0000","last_became_active":"2024-09-11T00:00:28.243145+0000","last_became_peered":"2024-09-11T00:00:28.243145+0000","last_unstale":"2024-09-11T00:01:52.879982+0000","last_undegraded":"2024-09-11T00:01:52.879982+0000","last_fullsized":"2024-09-11T00:01:52.879982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":146,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:31.467668+0000","last_change":"2024-09-11T00:00:26.224110+0000","last_active":"2024-09-11T00:02:31.467668+0000","last_peered":"2024-09-11T00:02:31.467668+0000","last_clean":"2024-09-11T00:02:31.467668+0000","last_became_active":"2024-09-11T00:00:26.223736+0000","last_became_peered":"2024-09-11T00:00:26.223736+0000","last_unstale":"2024-09-11T00:02:31.467668+0000","last_undegraded":"2024-09-11T00:02:31.467668+0000","last_fullsized":"2024-09-11T00:02:31.467668+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:48.409280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884259+0000","last_change":"2024-09-11T00:00:28.247200+0000","last_active":"2024-09-11T00:01:52.884259+0000","last_peered":"2024-09-11T00:01:52.884259+0000","last_clean":"2024-09-11T00:01:52.884259+0000","last_became_active":"2024-09-11T00:00:28.246862+0000","last_became_peered":"2024-09-11T00:00:28.246862+0000","last_unstale":"2024-09-11T00:01:52.884259+0000","last_undegraded":"2024-09-11T00:01:52.884259+0000","last_fullsized":"2024-09-11T00:01:52.884259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:41.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697831+0000","last_change":"2024-09-11T00:00:26.221852+0000","last_active":"2024-09-11T00:00:53.697831+0000","last_peered":"2024-09-11T00:00:53.697831+0000","last_clean":"2024-09-11T00:00:53.697831+0000","last_became_active":"2024-09-11T00:00:26.221505+0000","last_became_peered":"2024-09-11T00:00:26.221505+0000","last_unstale":"2024-09-11T00:00:53.697831+0000","last_undegraded":"2024-09-11T00:00:53.697831+0000","last_fullsized":"2024-09-11T00:00:53.697831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.915742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608158+0000","last_change":"2024-09-11T00:00:26.215135+0000","last_active":"2024-09-11T00:00:53.608158+0000","last_peered":"2024-09-11T00:00:53.608158+0000","last_clean":"2024-09-11T00:00:53.608158+0000","last_became_active":"2024-09-11T00:00:26.214117+0000","last_became_peered":"2024-09-11T00:00:26.214117+0000","last_unstale":"2024-09-11T00:00:53.608158+0000","last_undegraded":"2024-09-11T00:00:53.608158+0000","last_fullsized":"2024-09-11T00:00:53.608158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.434306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.877643+0000","last_change":"2024-09-11T00:00:28.242824+0000","last_active":"2024-09-11T00:01:52.877643+0000","last_peered":"2024-09-11T00:01:52.877643+0000","last_clean":"2024-09-11T00:01:52.877643+0000","last_became_active":"2024-09-11T00:00:28.242482+0000","last_became_peered":"2024-09-11T00:00:28.242482+0000","last_unstale":"2024-09-11T00:01:52.877643+0000","last_undegraded":"2024-09-11T00:01:52.877643+0000","last_fullsized":"2024-09-11T00:01:52.877643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.768676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609827+0000","last_change":"2024-09-11T00:00:26.222165+0000","last_active":"2024-09-11T00:00:53.609827+0000","last_peered":"2024-09-11T00:00:53.609827+0000","last_clean":"2024-09-11T00:00:53.609827+0000","last_became_active":"2024-09-11T00:00:26.221775+0000","last_became_peered":"2024-09-11T00:00:26.221775+0000","last_unstale":"2024-09-11T00:00:53.609827+0000","last_undegraded":"2024-09-11T00:00:53.609827+0000","last_fullsized":"2024-09-11T00:00:53.609827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:27.066576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879277+0000","last_change":"2024-09-11T00:00:28.243371+0000","last_active":"2024-09-11T00:01:52.879277+0000","last_peered":"2024-09-11T00:01:52.879277+0000","last_clean":"2024-09-11T00:01:52.879277+0000","last_became_active":"2024-09-11T00:00:28.243079+0000","last_became_peered":"2024-09-11T00:00:28.243079+0000","last_unstale":"2024-09-11T00:01:52.879277+0000","last_undegraded":"2024-09-11T00:01:52.879277+0000","last_fullsized":"2024-09-11T00:01:52.879277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:23.946542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:30.469620+0000","last_change":"2024-09-11T00:00:26.221293+0000","last_active":"2024-09-11T00:02:30.469620+0000","last_peered":"2024-09-11T00:02:30.469620+0000","last_clean":"2024-09-11T00:02:30.469620+0000","last_became_active":"2024-09-11T00:00:26.220970+0000","last_became_peered":"2024-09-11T00:00:26.220970+0000","last_unstale":"2024-09-11T00:02:30.469620+0000","last_undegraded":"2024-09-11T00:02:30.469620+0000","last_fullsized":"2024-09-11T00:02:30.469620+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:27.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889091+0000","last_change":"2024-09-11T00:00:28.242707+0000","last_active":"2024-09-11T00:01:52.889091+0000","last_peered":"2024-09-11T00:01:52.889091+0000","last_clean":"2024-09-11T00:01:52.889091+0000","last_became_active":"2024-09-11T00:00:28.242348+0000","last_became_peered":"2024-09-11T00:00:28.242348+0000","last_unstale":"2024-09-11T00:01:52.889091+0000","last_undegraded":"2024-09-11T00:01:52.889091+0000","last_fullsized":"2024-09-11T00:01:52.889091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:43:57.442541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607484+0000","last_change":"2024-09-11T00:00:26.222011+0000","last_active":"2024-09-11T00:00:53.607484+0000","last_peered":"2024-09-11T00:00:53.607484+0000","last_clean":"2024-09-11T00:00:53.607484+0000","last_became_active":"2024-09-11T00:00:26.221684+0000","last_became_peered":"2024-09-11T00:00:26.221684+0000","last_unstale":"2024-09-11T00:00:53.607484+0000","last_undegraded":"2024-09-11T00:00:53.607484+0000","last_fullsized":"2024-09-11T00:00:53.607484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:37.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886398+0000","last_change":"2024-09-11T00:00:28.246873+0000","last_active":"2024-09-11T00:01:52.886398+0000","last_peered":"2024-09-11T00:01:52.886398+0000","last_clean":"2024-09-11T00:01:52.886398+0000","last_became_active":"2024-09-11T00:00:28.246579+0000","last_became_peered":"2024-09-11T00:00:28.246579+0000","last_unstale":"2024-09-11T00:01:52.886398+0000","last_undegraded":"2024-09-11T00:01:52.886398+0000","last_fullsized":"2024-09-11T00:01:52.886398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:35.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609440+0000","last_change":"2024-09-11T00:00:26.305777+0000","last_active":"2024-09-11T00:00:53.609440+0000","last_peered":"2024-09-11T00:00:53.609440+0000","last_clean":"2024-09-11T00:00:53.609440+0000","last_became_active":"2024-09-11T00:00:26.305499+0000","last_became_peered":"2024-09-11T00:00:26.305499+0000","last_unstale":"2024-09-11T00:00:53.609440+0000","last_undegraded":"2024-09-11T00:00:53.609440+0000","last_fullsized":"2024-09-11T00:00:53.609440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:23.778016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891618+0000","last_change":"2024-09-11T00:00:28.247024+0000","last_active":"2024-09-11T00:01:52.891618+0000","last_peered":"2024-09-11T00:01:52.891618+0000","last_clean":"2024-09-11T00:01:52.891618+0000","last_became_active":"2024-09-11T00:00:28.246564+0000","last_became_peered":"2024-09-11T00:00:28.246564+0000","last_unstale":"2024-09-11T00:01:52.891618+0000","last_undegraded":"2024-09-11T00:01:52.891618+0000","last_fullsized":"2024-09-11T00:01:52.891618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:30.833827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'33","reported_seq":294,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:31.467908+0000","last_change":"2024-09-11T00:00:26.223746+0000","last_active":"2024-09-11T00:02:31.467908+0000","last_peered":"2024-09-11T00:02:31.467908+0000","last_clean":"2024-09-11T00:02:31.467908+0000","last_became_active":"2024-09-11T00:00:26.223148+0000","last_became_peered":"2024-09-11T00:00:26.223148+0000","last_unstale":"2024-09-11T00:02:31.467908+0000","last_undegraded":"2024-09-11T00:02:31.467908+0000","last_fullsized":"2024-09-11T00:02:31.467908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:15.680847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65530,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":183,"num_write":34,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870369+0000","last_change":"2024-09-11T00:00:28.247313+0000","last_active":"2024-09-11T00:01:52.870369+0000","last_peered":"2024-09-11T00:01:52.870369+0000","last_clean":"2024-09-11T00:01:52.870369+0000","last_became_active":"2024-09-11T00:00:28.246936+0000","last_became_peered":"2024-09-11T00:00:28.246936+0000","last_unstale":"2024-09-11T00:01:52.870369+0000","last_undegraded":"2024-09-11T00:01:52.870369+0000","last_fullsized":"2024-09-11T00:01:52.870369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:14.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608467+0000","last_change":"2024-09-11T00:00:26.219319+0000","last_active":"2024-09-11T00:00:53.608467+0000","last_peered":"2024-09-11T00:00:53.608467+0000","last_clean":"2024-09-11T00:00:53.608467+0000","last_became_active":"2024-09-11T00:00:26.218962+0000","last_became_peered":"2024-09-11T00:00:26.218962+0000","last_unstale":"2024-09-11T00:00:53.608467+0000","last_undegraded":"2024-09-11T00:00:53.608467+0000","last_fullsized":"2024-09-11T00:00:53.608467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.090682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.875766+0000","last_change":"2024-09-11T00:00:28.234932+0000","last_active":"2024-09-11T00:01:52.875766+0000","last_peered":"2024-09-11T00:01:52.875766+0000","last_clean":"2024-09-11T00:01:52.875766+0000","last_became_active":"2024-09-11T00:00:28.234625+0000","last_became_peered":"2024-09-11T00:00:28.234625+0000","last_unstale":"2024-09-11T00:01:52.875766+0000","last_undegraded":"2024-09-11T00:01:52.875766+0000","last_fullsized":"2024-09-11T00:01:52.875766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:24.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609182+0000","last_change":"2024-09-11T00:00:26.218038+0000","last_active":"2024-09-11T00:00:53.609182+0000","last_peered":"2024-09-11T00:00:53.609182+0000","last_clean":"2024-09-11T00:00:53.609182+0000","last_became_active":"2024-09-11T00:00:26.217570+0000","last_became_peered":"2024-09-11T00:00:26.217570+0000","last_unstale":"2024-09-11T00:00:53.609182+0000","last_undegraded":"2024-09-11T00:00:53.609182+0000","last_fullsized":"2024-09-11T00:00:53.609182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:52.653224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":40,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.881210+0000","last_change":"2024-09-11T00:00:53.610758+0000","last_active":"2024-09-11T00:01:52.881210+0000","last_peered":"2024-09-11T00:01:52.881210+0000","last_clean":"2024-09-11T00:01:52.881210+0000","last_became_active":"2024-09-11T00:00:53.610382+0000","last_became_peered":"2024-09-11T00:00:53.610382+0000","last_unstale":"2024-09-11T00:01:52.881210+0000","last_undegraded":"2024-09-11T00:01:52.881210+0000","last_fullsized":"2024-09-11T00:01:52.881210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:47.560323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'5","reported_seq":146,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:31.473030+0000","last_change":"2024-09-11T00:00:26.215747+0000","last_active":"2024-09-11T00:02:31.473030+0000","last_peered":"2024-09-11T00:02:31.473030+0000","last_clean":"2024-09-11T00:02:31.473030+0000","last_became_active":"2024-09-11T00:00:26.215374+0000","last_became_peered":"2024-09-11T00:00:26.215374+0000","last_unstale":"2024-09-11T00:02:31.473030+0000","last_undegraded":"2024-09-11T00:02:31.473030+0000","last_fullsized":"2024-09-11T00:02:31.473030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:58.868644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878439+0000","last_change":"2024-09-11T00:00:28.248057+0000","last_active":"2024-09-11T00:01:52.878439+0000","last_peered":"2024-09-11T00:01:52.878439+0000","last_clean":"2024-09-11T00:01:52.878439+0000","last_became_active":"2024-09-11T00:00:28.247742+0000","last_became_peered":"2024-09-11T00:00:28.247742+0000","last_unstale":"2024-09-11T00:01:52.878439+0000","last_undegraded":"2024-09-11T00:01:52.878439+0000","last_fullsized":"2024-09-11T00:01:52.878439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.425406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608659+0000","last_change":"2024-09-11T00:00:26.304810+0000","last_active":"2024-09-11T00:00:53.608659+0000","last_peered":"2024-09-11T00:00:53.608659+0000","last_clean":"2024-09-11T00:00:53.608659+0000","last_became_active":"2024-09-11T00:00:26.304484+0000","last_became_peered":"2024-09-11T00:00:26.304484+0000","last_unstale":"2024-09-11T00:00:53.608659+0000","last_undegraded":"2024-09-11T00:00:53.608659+0000","last_fullsized":"2024-09-11T00:00:53.608659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:44.929242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889807+0000","last_change":"2024-09-11T00:00:53.699144+0000","last_active":"2024-09-11T00:01:52.889807+0000","last_peered":"2024-09-11T00:01:52.889807+0000","last_clean":"2024-09-11T00:01:52.889807+0000","last_became_active":"2024-09-11T00:00:53.698799+0000","last_became_peered":"2024-09-11T00:00:53.698799+0000","last_unstale":"2024-09-11T00:01:52.889807+0000","last_undegraded":"2024-09-11T00:01:52.889807+0000","last_fullsized":"2024-09-11T00:01:52.889807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:07.110699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.618935+0000","last_change":"2024-09-11T00:00:53.618414+0000","last_active":"2024-09-11T00:00:53.618935+0000","last_peered":"2024-09-11T00:00:53.618935+0000","last_clean":"2024-09-11T00:00:53.618935+0000","last_became_active":"2024-09-11T00:00:53.612177+0000","last_became_peered":"2024-09-11T00:00:53.612177+0000","last_unstale":"2024-09-11T00:00:53.618935+0000","last_undegraded":"2024-09-11T00:00:53.618935+0000","last_fullsized":"2024-09-11T00:00:53.618935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.675913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878443+0000","last_change":"2024-09-11T00:00:28.248095+0000","last_active":"2024-09-11T00:01:52.878443+0000","last_peered":"2024-09-11T00:01:52.878443+0000","last_clean":"2024-09-11T00:01:52.878443+0000","last_became_active":"2024-09-11T00:00:28.247657+0000","last_became_peered":"2024-09-11T00:00:28.247657+0000","last_unstale":"2024-09-11T00:01:52.878443+0000","last_undegraded":"2024-09-11T00:01:52.878443+0000","last_fullsized":"2024-09-11T00:01:52.878443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:30.699480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607806+0000","last_change":"2024-09-11T00:00:26.214739+0000","last_active":"2024-09-11T00:00:53.607806+0000","last_peered":"2024-09-11T00:00:53.607806+0000","last_clean":"2024-09-11T00:00:53.607806+0000","last_became_active":"2024-09-11T00:00:26.213965+0000","last_became_peered":"2024-09-11T00:00:26.213965+0000","last_unstale":"2024-09-11T00:00:53.607806+0000","last_undegraded":"2024-09-11T00:00:53.607806+0000","last_fullsized":"2024-09-11T00:00:53.607806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.872864+0000","last_change":"2024-09-11T00:00:28.241086+0000","last_active":"2024-09-11T00:01:52.872864+0000","last_peered":"2024-09-11T00:01:52.872864+0000","last_clean":"2024-09-11T00:01:52.872864+0000","last_became_active":"2024-09-11T00:00:28.240757+0000","last_became_peered":"2024-09-11T00:00:28.240757+0000","last_unstale":"2024-09-11T00:01:52.872864+0000","last_undegraded":"2024-09-11T00:01:52.872864+0000","last_fullsized":"2024-09-11T00:01:52.872864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:50.665209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609666+0000","last_change":"2024-09-11T00:00:26.223335+0000","last_active":"2024-09-11T00:00:53.609666+0000","last_peered":"2024-09-11T00:00:53.609666+0000","last_clean":"2024-09-11T00:00:53.609666+0000","last_became_active":"2024-09-11T00:00:26.223012+0000","last_became_peered":"2024-09-11T00:00:26.223012+0000","last_unstale":"2024-09-11T00:00:53.609666+0000","last_undegraded":"2024-09-11T00:00:53.609666+0000","last_fullsized":"2024-09-11T00:00:53.609666+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:46.878405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878190+0000","last_change":"2024-09-11T00:00:28.246763+0000","last_active":"2024-09-11T00:01:52.878190+0000","last_peered":"2024-09-11T00:01:52.878190+0000","last_clean":"2024-09-11T00:01:52.878190+0000","last_became_active":"2024-09-11T00:00:28.246403+0000","last_became_peered":"2024-09-11T00:00:28.246403+0000","last_unstale":"2024-09-11T00:01:52.878190+0000","last_undegraded":"2024-09-11T00:01:52.878190+0000","last_fullsized":"2024-09-11T00:01:52.878190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:55.558135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.616935+0000","last_change":"2024-09-11T00:00:53.616821+0000","last_active":"2024-09-11T00:00:53.616935+0000","last_peered":"2024-09-11T00:00:53.616935+0000","last_clean":"2024-09-11T00:00:53.616935+0000","last_became_active":"2024-09-11T00:00:53.611298+0000","last_became_peered":"2024-09-11T00:00:53.611298+0000","last_unstale":"2024-09-11T00:00:53.616935+0000","last_undegraded":"2024-09-11T00:00:53.616935+0000","last_fullsized":"2024-09-11T00:00:53.616935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:23.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890272+0000","last_change":"2024-09-11T00:00:28.243514+0000","last_active":"2024-09-11T00:01:52.890272+0000","last_peered":"2024-09-11T00:01:52.890272+0000","last_clean":"2024-09-11T00:01:52.890272+0000","last_became_active":"2024-09-11T00:00:28.242678+0000","last_became_peered":"2024-09-11T00:00:28.242678+0000","last_unstale":"2024-09-11T00:01:52.890272+0000","last_undegraded":"2024-09-11T00:01:52.890272+0000","last_fullsized":"2024-09-11T00:01:52.890272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:18.811190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607398+0000","last_change":"2024-09-10T23:59:14.289772+0000","last_active":"2024-09-11T00:00:53.607398+0000","last_peered":"2024-09-11T00:00:53.607398+0000","last_clean":"2024-09-11T00:00:53.607398+0000","last_became_active":"2024-09-10T23:59:13.438147+0000","last_became_peered":"2024-09-10T23:59:13.438147+0000","last_unstale":"2024-09-11T00:00:53.607398+0000","last_undegraded":"2024-09-11T00:00:53.607398+0000","last_fullsized":"2024-09-11T00:00:53.607398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:55:47.356284+0000","last_clean_scrub_stamp":"2024-09-10T23:55:47.356284+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:56.340326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605536+0000","last_change":"2024-09-11T00:00:26.216748+0000","last_active":"2024-09-11T00:00:53.605536+0000","last_peered":"2024-09-11T00:00:53.605536+0000","last_clean":"2024-09-11T00:00:53.605536+0000","last_became_active":"2024-09-11T00:00:26.216427+0000","last_became_peered":"2024-09-11T00:00:26.216427+0000","last_unstale":"2024-09-11T00:00:53.605536+0000","last_undegraded":"2024-09-11T00:00:53.605536+0000","last_fullsized":"2024-09-11T00:00:53.605536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:53.291534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886459+0000","last_change":"2024-09-11T00:00:28.245864+0000","last_active":"2024-09-11T00:01:52.886459+0000","last_peered":"2024-09-11T00:01:52.886459+0000","last_clean":"2024-09-11T00:01:52.886459+0000","last_became_active":"2024-09-11T00:00:28.245538+0000","last_became_peered":"2024-09-11T00:00:28.245538+0000","last_unstale":"2024-09-11T00:01:52.886459+0000","last_undegraded":"2024-09-11T00:01:52.886459+0000","last_fullsized":"2024-09-11T00:01:52.886459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:37.625663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607303+0000","last_change":"2024-09-11T00:00:26.219580+0000","last_active":"2024-09-11T00:00:53.607303+0000","last_peered":"2024-09-11T00:00:53.607303+0000","last_clean":"2024-09-11T00:00:53.607303+0000","last_became_active":"2024-09-11T00:00:26.219209+0000","last_became_peered":"2024-09-11T00:00:26.219209+0000","last_unstale":"2024-09-11T00:00:53.607303+0000","last_undegraded":"2024-09-11T00:00:53.607303+0000","last_fullsized":"2024-09-11T00:00:53.607303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:16.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.879698+0000","last_change":"2024-09-11T00:00:28.235075+0000","last_active":"2024-09-11T00:01:52.879698+0000","last_peered":"2024-09-11T00:01:52.879698+0000","last_clean":"2024-09-11T00:01:52.879698+0000","last_became_active":"2024-09-11T00:00:28.234770+0000","last_became_peered":"2024-09-11T00:00:28.234770+0000","last_unstale":"2024-09-11T00:01:52.879698+0000","last_undegraded":"2024-09-11T00:01:52.879698+0000","last_fullsized":"2024-09-11T00:01:52.879698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:17.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:28.467618+0000","last_change":"2024-09-11T00:00:26.304147+0000","last_active":"2024-09-11T00:02:28.467618+0000","last_peered":"2024-09-11T00:02:28.467618+0000","last_clean":"2024-09-11T00:02:28.467618+0000","last_became_active":"2024-09-11T00:00:26.303747+0000","last_became_peered":"2024-09-11T00:00:26.303747+0000","last_unstale":"2024-09-11T00:02:28.467618+0000","last_undegraded":"2024-09-11T00:02:28.467618+0000","last_fullsized":"2024-09-11T00:02:28.467618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:06.526611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.864150+0000","last_change":"2024-09-11T00:00:53.611609+0000","last_active":"2024-09-11T00:01:52.864150+0000","last_peered":"2024-09-11T00:01:52.864150+0000","last_clean":"2024-09-11T00:01:52.864150+0000","last_became_active":"2024-09-11T00:00:53.611133+0000","last_became_peered":"2024-09-11T00:00:53.611133+0000","last_unstale":"2024-09-11T00:01:52.864150+0000","last_undegraded":"2024-09-11T00:01:52.864150+0000","last_fullsized":"2024-09-11T00:01:52.864150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:38.577317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.607859+0000","last_change":"2024-09-11T00:00:26.217696+0000","last_active":"2024-09-11T00:00:53.607859+0000","last_peered":"2024-09-11T00:00:53.607859+0000","last_clean":"2024-09-11T00:00:53.607859+0000","last_became_active":"2024-09-11T00:00:26.217295+0000","last_became_peered":"2024-09-11T00:00:26.217295+0000","last_unstale":"2024-09-11T00:00:53.607859+0000","last_undegraded":"2024-09-11T00:00:53.607859+0000","last_fullsized":"2024-09-11T00:00:53.607859+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:27.511915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.871115+0000","last_change":"2024-09-11T00:00:28.244301+0000","last_active":"2024-09-11T00:01:52.871115+0000","last_peered":"2024-09-11T00:01:52.871115+0000","last_clean":"2024-09-11T00:01:52.871115+0000","last_became_active":"2024-09-11T00:00:28.243799+0000","last_became_peered":"2024-09-11T00:00:28.243799+0000","last_unstale":"2024-09-11T00:01:52.871115+0000","last_undegraded":"2024-09-11T00:01:52.871115+0000","last_fullsized":"2024-09-11T00:01:52.871115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:46.189104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.612530+0000","last_change":"2024-09-11T00:00:53.611730+0000","last_active":"2024-09-11T00:00:53.612530+0000","last_peered":"2024-09-11T00:00:53.612530+0000","last_clean":"2024-09-11T00:00:53.612530+0000","last_became_active":"2024-09-11T00:00:53.611376+0000","last_became_peered":"2024-09-11T00:00:53.611376+0000","last_unstale":"2024-09-11T00:00:53.612530+0000","last_undegraded":"2024-09-11T00:00:53.612530+0000","last_fullsized":"2024-09-11T00:00:53.612530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:02.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.877630+0000","last_change":"2024-09-11T00:00:28.244742+0000","last_active":"2024-09-11T00:01:52.877630+0000","last_peered":"2024-09-11T00:01:52.877630+0000","last_clean":"2024-09-11T00:01:52.877630+0000","last_became_active":"2024-09-11T00:00:28.243963+0000","last_became_peered":"2024-09-11T00:00:28.243963+0000","last_unstale":"2024-09-11T00:01:52.877630+0000","last_undegraded":"2024-09-11T00:01:52.877630+0000","last_fullsized":"2024-09-11T00:01:52.877630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:17.196311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608981+0000","last_change":"2024-09-11T00:00:26.303826+0000","last_active":"2024-09-11T00:00:53.608981+0000","last_peered":"2024-09-11T00:00:53.608981+0000","last_clean":"2024-09-11T00:00:53.608981+0000","last_became_active":"2024-09-11T00:00:26.303482+0000","last_became_peered":"2024-09-11T00:00:26.303482+0000","last_unstale":"2024-09-11T00:00:53.608981+0000","last_undegraded":"2024-09-11T00:00:53.608981+0000","last_fullsized":"2024-09-11T00:00:53.608981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.428384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.882853+0000","last_change":"2024-09-11T00:00:28.231497+0000","last_active":"2024-09-11T00:01:52.882853+0000","last_peered":"2024-09-11T00:01:52.882853+0000","last_clean":"2024-09-11T00:01:52.882853+0000","last_became_active":"2024-09-11T00:00:28.231137+0000","last_became_peered":"2024-09-11T00:00:28.231137+0000","last_unstale":"2024-09-11T00:01:52.882853+0000","last_undegraded":"2024-09-11T00:01:52.882853+0000","last_fullsized":"2024-09-11T00:01:52.882853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:02:29.264004+0000","last_change":"2024-09-11T00:00:26.218483+0000","last_active":"2024-09-11T00:02:29.264004+0000","last_peered":"2024-09-11T00:02:29.264004+0000","last_clean":"2024-09-11T00:02:29.264004+0000","last_became_active":"2024-09-11T00:00:26.218194+0000","last_became_peered":"2024-09-11T00:00:26.218194+0000","last_unstale":"2024-09-11T00:02:29.264004+0000","last_undegraded":"2024-09-11T00:02:29.264004+0000","last_fullsized":"2024-09-11T00:02:29.264004+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:08.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.870163+0000","last_change":"2024-09-11T00:00:28.243686+0000","last_active":"2024-09-11T00:01:52.870163+0000","last_peered":"2024-09-11T00:01:52.870163+0000","last_clean":"2024-09-11T00:01:52.870163+0000","last_became_active":"2024-09-11T00:00:28.243385+0000","last_became_peered":"2024-09-11T00:00:28.243385+0000","last_unstale":"2024-09-11T00:01:52.870163+0000","last_undegraded":"2024-09-11T00:01:52.870163+0000","last_fullsized":"2024-09-11T00:01:52.870163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:28.440851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.605769+0000","last_change":"2024-09-11T00:00:26.813675+0000","last_active":"2024-09-11T00:00:53.605769+0000","last_peered":"2024-09-11T00:00:53.605769+0000","last_clean":"2024-09-11T00:00:53.605769+0000","last_became_active":"2024-09-11T00:00:26.813338+0000","last_became_peered":"2024-09-11T00:00:26.813338+0000","last_unstale":"2024-09-11T00:00:53.605769+0000","last_undegraded":"2024-09-11T00:00:53.605769+0000","last_fullsized":"2024-09-11T00:00:53.605769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:11.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.885223+0000","last_change":"2024-09-11T00:00:28.245655+0000","last_active":"2024-09-11T00:01:52.885223+0000","last_peered":"2024-09-11T00:01:52.885223+0000","last_clean":"2024-09-11T00:01:52.885223+0000","last_became_active":"2024-09-11T00:00:28.245345+0000","last_became_peered":"2024-09-11T00:00:28.245345+0000","last_unstale":"2024-09-11T00:01:52.885223+0000","last_undegraded":"2024-09-11T00:01:52.885223+0000","last_fullsized":"2024-09-11T00:01:52.885223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697544+0000","last_change":"2024-09-11T00:00:26.306022+0000","last_active":"2024-09-11T00:00:53.697544+0000","last_peered":"2024-09-11T00:00:53.697544+0000","last_clean":"2024-09-11T00:00:53.697544+0000","last_became_active":"2024-09-11T00:00:26.305666+0000","last_became_peered":"2024-09-11T00:00:26.305666+0000","last_unstale":"2024-09-11T00:00:53.697544+0000","last_undegraded":"2024-09-11T00:00:53.697544+0000","last_fullsized":"2024-09-11T00:00:53.697544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:56.063443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.859253+0000","last_change":"2024-09-11T00:00:28.242297+0000","last_active":"2024-09-11T00:01:52.859253+0000","last_peered":"2024-09-11T00:01:52.859253+0000","last_clean":"2024-09-11T00:01:52.859253+0000","last_became_active":"2024-09-11T00:00:28.241908+0000","last_became_peered":"2024-09-11T00:00:28.241908+0000","last_unstale":"2024-09-11T00:01:52.859253+0000","last_undegraded":"2024-09-11T00:01:52.859253+0000","last_fullsized":"2024-09-11T00:01:52.859253+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:29.352959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697534+0000","last_change":"2024-09-11T00:00:26.218436+0000","last_active":"2024-09-11T00:00:53.697534+0000","last_peered":"2024-09-11T00:00:53.697534+0000","last_clean":"2024-09-11T00:00:53.697534+0000","last_became_active":"2024-09-11T00:00:26.218143+0000","last_became_peered":"2024-09-11T00:00:26.218143+0000","last_unstale":"2024-09-11T00:00:53.697534+0000","last_undegraded":"2024-09-11T00:00:53.697534+0000","last_fullsized":"2024-09-11T00:00:53.697534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:03.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.886475+0000","last_change":"2024-09-11T00:00:28.241348+0000","last_active":"2024-09-11T00:01:52.886475+0000","last_peered":"2024-09-11T00:01:52.886475+0000","last_clean":"2024-09-11T00:01:52.886475+0000","last_became_active":"2024-09-11T00:00:28.241016+0000","last_became_peered":"2024-09-11T00:00:28.241016+0000","last_unstale":"2024-09-11T00:01:52.886475+0000","last_undegraded":"2024-09-11T00:01:52.886475+0000","last_fullsized":"2024-09-11T00:01:52.886475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:38.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608243+0000","last_change":"2024-09-11T00:00:26.218184+0000","last_active":"2024-09-11T00:00:53.608243+0000","last_peered":"2024-09-11T00:00:53.608243+0000","last_clean":"2024-09-11T00:00:53.608243+0000","last_became_active":"2024-09-11T00:00:26.217790+0000","last_became_peered":"2024-09-11T00:00:26.217790+0000","last_unstale":"2024-09-11T00:00:53.608243+0000","last_undegraded":"2024-09-11T00:00:53.608243+0000","last_fullsized":"2024-09-11T00:00:53.608243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.338865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.878986+0000","last_change":"2024-09-11T00:00:28.242154+0000","last_active":"2024-09-11T00:01:52.878986+0000","last_peered":"2024-09-11T00:01:52.878986+0000","last_clean":"2024-09-11T00:01:52.878986+0000","last_became_active":"2024-09-11T00:00:28.240365+0000","last_became_peered":"2024-09-11T00:00:28.240365+0000","last_unstale":"2024-09-11T00:01:52.878986+0000","last_undegraded":"2024-09-11T00:01:52.878986+0000","last_fullsized":"2024-09-11T00:01:52.878986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:11.248419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608033+0000","last_change":"2024-09-11T00:00:26.220137+0000","last_active":"2024-09-11T00:00:53.608033+0000","last_peered":"2024-09-11T00:00:53.608033+0000","last_clean":"2024-09-11T00:00:53.608033+0000","last_became_active":"2024-09-11T00:00:26.219775+0000","last_became_peered":"2024-09-11T00:00:26.219775+0000","last_unstale":"2024-09-11T00:00:53.608033+0000","last_undegraded":"2024-09-11T00:00:53.608033+0000","last_fullsized":"2024-09-11T00:00:53.608033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:51.088222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.890344+0000","last_change":"2024-09-11T00:00:28.241970+0000","last_active":"2024-09-11T00:01:52.890344+0000","last_peered":"2024-09-11T00:01:52.890344+0000","last_clean":"2024-09-11T00:01:52.890344+0000","last_became_active":"2024-09-11T00:00:28.241385+0000","last_became_peered":"2024-09-11T00:00:28.241385+0000","last_unstale":"2024-09-11T00:01:52.890344+0000","last_undegraded":"2024-09-11T00:01:52.890344+0000","last_fullsized":"2024-09-11T00:01:52.890344+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.709629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.891153+0000","last_change":"2024-09-11T00:00:28.252006+0000","last_active":"2024-09-11T00:01:52.891153+0000","last_peered":"2024-09-11T00:01:52.891153+0000","last_clean":"2024-09-11T00:01:52.891153+0000","last_became_active":"2024-09-11T00:00:28.251638+0000","last_became_peered":"2024-09-11T00:00:28.251638+0000","last_unstale":"2024-09-11T00:01:52.891153+0000","last_undegraded":"2024-09-11T00:01:52.891153+0000","last_fullsized":"2024-09-11T00:01:52.891153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:23.122464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.608094+0000","last_change":"2024-09-11T00:00:26.222337+0000","last_active":"2024-09-11T00:00:53.608094+0000","last_peered":"2024-09-11T00:00:53.608094+0000","last_clean":"2024-09-11T00:00:53.608094+0000","last_became_active":"2024-09-11T00:00:26.221936+0000","last_became_peered":"2024-09-11T00:00:26.221936+0000","last_unstale":"2024-09-11T00:00:53.608094+0000","last_undegraded":"2024-09-11T00:00:53.608094+0000","last_fullsized":"2024-09-11T00:00:53.608094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:15.425732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889337+0000","last_change":"2024-09-11T00:00:28.241319+0000","last_active":"2024-09-11T00:01:52.889337+0000","last_peered":"2024-09-11T00:01:52.889337+0000","last_clean":"2024-09-11T00:01:52.889337+0000","last_became_active":"2024-09-11T00:00:28.240962+0000","last_became_peered":"2024-09-11T00:00:28.240962+0000","last_unstale":"2024-09-11T00:01:52.889337+0000","last_undegraded":"2024-09-11T00:01:52.889337+0000","last_fullsized":"2024-09-11T00:01:52.889337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:45.375306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.609105+0000","last_change":"2024-09-11T00:00:26.220173+0000","last_active":"2024-09-11T00:00:53.609105+0000","last_peered":"2024-09-11T00:00:53.609105+0000","last_clean":"2024-09-11T00:00:53.609105+0000","last_became_active":"2024-09-11T00:00:26.219828+0000","last_became_peered":"2024-09-11T00:00:26.219828+0000","last_unstale":"2024-09-11T00:00:53.609105+0000","last_undegraded":"2024-09-11T00:00:53.609105+0000","last_fullsized":"2024-09-11T00:00:53.609105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:20.829557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.889030+0000","last_change":"2024-09-11T00:00:28.237709+0000","last_active":"2024-09-11T00:01:52.889030+0000","last_peered":"2024-09-11T00:01:52.889030+0000","last_clean":"2024-09-11T00:01:52.889030+0000","last_became_active":"2024-09-11T00:00:28.237230+0000","last_became_peered":"2024-09-11T00:00:28.237230+0000","last_unstale":"2024-09-11T00:01:52.889030+0000","last_undegraded":"2024-09-11T00:01:52.889030+0000","last_fullsized":"2024-09-11T00:01:52.889030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:19.647702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.697983+0000","last_change":"2024-09-11T00:00:26.303588+0000","last_active":"2024-09-11T00:00:53.697983+0000","last_peered":"2024-09-11T00:00:53.697983+0000","last_clean":"2024-09-11T00:00:53.697983+0000","last_became_active":"2024-09-11T00:00:26.303231+0000","last_became_peered":"2024-09-11T00:00:26.303231+0000","last_unstale":"2024-09-11T00:00:53.697983+0000","last_undegraded":"2024-09-11T00:00:53.697983+0000","last_fullsized":"2024-09-11T00:00:53.697983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:01:52.884753+0000","last_change":"2024-09-11T00:00:28.247433+0000","last_active":"2024-09-11T00:01:52.884753+0000","last_peered":"2024-09-11T00:01:52.884753+0000","last_clean":"2024-09-11T00:01:52.884753+0000","last_became_active":"2024-09-11T00:00:28.246880+0000","last_became_peered":"2024-09-11T00:00:28.246880+0000","last_unstale":"2024-09-11T00:01:52.884753+0000","last_undegraded":"2024-09-11T00:01:52.884753+0000","last_fullsized":"2024-09-11T00:01:52.884753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:27.214155+0000","last_clean_scrub_stamp":"2024-09-11T00:00:27.214155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:38.232157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T00:00:53.604797+0000","last_change":"2024-09-11T00:00:26.218340+0000","last_active":"2024-09-11T00:00:53.604797+0000","last_peered":"2024-09-11T00:00:53.604797+0000","last_clean":"2024-09-11T00:00:53.604797+0000","last_became_active":"2024-09-11T00:00:26.218027+0000","last_became_peered":"2024-09-11T00:00:26.218027+0000","last_unstale":"2024-09-11T00:00:53.604797+0000","last_undegraded":"2024-09-11T00:00:53.604797+0000","last_fullsized":"2024-09-11T00:00:53.604797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:25.196185+0000","last_clean_scrub_stamp":"2024-09-11T00:00:25.196185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:32.785297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70063,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":709,"num_read_kb":426,"num_write":176,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282026,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710759,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":422068,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1079589,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":422282,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266742,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":422180,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":1014664,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626495,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":421671,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1013816,"data_compressed":41629,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":423222,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":421982,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378709,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":481998,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":481230,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705759,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":422942,"data_compressed":5769,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34242,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35860,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:02:34.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:02:35.072 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:35.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:35 smithi135 ceph-mon[35432]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:35.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:35 smithi019 ceph-mon[30859]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:35.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:35 smithi131 ceph-mon[35491]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.552+0000 7f07fbffc640 1 -- 172.21.15.19:0/2527387046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4108020 msgr2=0x7f07f410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.552+0000 7f07fbffc640 1 --2- 172.21.15.19:0/2527387046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4108020 0x7f07f410e820 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009ca0 tx=0x7f07ec02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 -- 172.21.15.19:0/2527387046 shutdown_connections 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 --2- 172.21.15.19:0/2527387046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4108020 0x7f07f410e820 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 --2- 172.21.15.19:0/2527387046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f41076a0 0x7f07f4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 --2- 172.21.15.19:0/2527387046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4101c90 0x7f07f4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 -- 172.21.15.19:0/2527387046 >> 172.21.15.19:0/2527387046 conn(0x7f07f40fd6c0 msgr2=0x7f07f40ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 -- 172.21.15.19:0/2527387046 shutdown_connections 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 -- 172.21.15.19:0/2527387046 wait complete. 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 Processor -- start 2024-09-11T00:02:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.553+0000 7f07fbffc640 1 -- start start 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fbffc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4101c90 0x7f07f419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fbffc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f41076a0 0x7f07f419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fbffc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4108020 0x7f07f419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fbffc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4111ce0 con 0x7f07f4101c90 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fbffc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4111b60 con 0x7f07f41076a0 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fbffc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4111e60 con 0x7f07f4108020 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4101c90 0x7f07f419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4101c90 0x7f07f419a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33374/0 (socket says 172.21.15.19:33374) 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 -- 172.21.15.19:0/1392278178 learned_addr learned my addr 172.21.15.19:0/1392278178 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fa599640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4108020 0x7f07f419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9597640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f41076a0 0x7f07f419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 -- 172.21.15.19:0/1392278178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4108020 msgr2=0x7f07f419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4108020 0x7f07f419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 -- 172.21.15.19:0/1392278178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f41076a0 msgr2=0x7f07f419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f41076a0 0x7f07f419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 -- 172.21.15.19:0/1392278178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f41a5410 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9597640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f41076a0 0x7f07f419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07f9d98640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4101c90 0x7f07f419a030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f07f000d770 tx=0x7f07f000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07eaffd640 1 -- 172.21.15.19:0/1392278178 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0017070 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f41a5700 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07eaffd640 1 -- 172.21.15.19:0/1392278178 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f00054d0 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.554+0000 7f07eaffd640 1 -- 172.21.15.19:0/1392278178 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0004c30 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.555+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f41a5bf0 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.556+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f4102070 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.558+0000 7f07eaffd640 1 -- 172.21.15.19:0/1392278178 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f07f0004dd0 con 0x7f07f4101c90 2024-09-11T00:02:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.559+0000 7f07eaffd640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07e00b53c0 0x7f07e00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:35.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.559+0000 7f07f9597640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07e00b53c0 0x7f07e00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:35.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.559+0000 7f07eaffd640 1 -- 172.21.15.19:0/1392278178 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f07f00e5da0 con 0x7f07f4101c90 2024-09-11T00:02:35.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.559+0000 7f07f9597640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07e00b53c0 0x7f07e00b7880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07f406c0d0 tx=0x7f07e400b5f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:35.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.562+0000 7f07eaffd640 1 -- 172.21.15.19:0/1392278178 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07f00aca00 con 0x7f07f4101c90 2024-09-11T00:02:35.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.786+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07f402e5c0 con 0x7f07f4101c90 2024-09-11T00:02:35.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.786+0000 7f07eaffd640 1 -- 172.21.15.19:0/1392278178 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f07f00ac300 con 0x7f07f4101c90 2024-09-11T00:02:35.788 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:35.788 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"btime":"2024-09-11T00:02:30:097777+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:02:29.420729+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:02:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 25 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07e00b53c0 msgr2=0x7f07e00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07e00b53c0 0x7f07e00b7880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07f406c0d0 tx=0x7f07e400b5f0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4101c90 msgr2=0x7f07f419a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4101c90 0x7f07f419a030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f07f000d770 tx=0x7f07f000dc30 comp rx=0 tx=0).stop 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 shutdown_connections 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4108020 0x7f07f419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f41076a0 0x7f07f419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f07e00b53c0 0x7f07e00b7880 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 --2- 172.21.15.19:0/1392278178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f4101c90 0x7f07f419a030 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.788+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 >> 172.21.15.19:0/1392278178 conn(0x7f07f40fd6c0 msgr2=0x7f07f40ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:35.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.789+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 shutdown_connections 2024-09-11T00:02:35.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:35.789+0000 7f07fbffc640 1 -- 172.21.15.19:0/1392278178 wait complete. 2024-09-11T00:02:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:36 smithi135 ceph-mon[35432]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:36 smithi135 ceph-mon[35432]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T00:02:36.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:36 smithi135 ceph-mon[35432]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:36.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:36 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1392278178' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:36.467 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:36 smithi019 ceph-mon[30859]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:36.467 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:36 smithi019 ceph-mon[30859]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T00:02:36.467 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:36 smithi019 ceph-mon[30859]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:36.467 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:36 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1392278178' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:36.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:02:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:36 smithi131 ceph-mon[35491]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:36 smithi131 ceph-mon[35491]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T00:02:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:36 smithi131 ceph-mon[35491]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:02:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:36 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1392278178' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:02:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:37.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/1413600904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0102dc0 msgr2=0x7f6ef01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/1413600904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0102dc0 0x7f6ef01031a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009900 tx=0x7f6ee002a3f0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/1413600904 shutdown_connections 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/1413600904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef0109150 0x7f6ef010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/1413600904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef01087d0 0x7f6ef0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/1413600904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0102dc0 0x7f6ef01031a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/1413600904 >> 172.21.15.19:0/1413600904 conn(0x7f6ef00fe830 msgr2=0x7f6ef0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/1413600904 shutdown_connections 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.263+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/1413600904 wait complete. 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 Processor -- start 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 -- start start 2024-09-11T00:02:37.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef0102dc0 0x7f6ef01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef01087d0 0x7f6ef0199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0109150 0x7f6ef019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0112e60 con 0x7f6ef0109150 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0112ce0 con 0x7f6ef0102dc0 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.264+0000 7f6ef5a2a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0112fe0 con 0x7f6ef01087d0 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0109150 0x7f6ef019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0109150 0x7f6ef019ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33392/0 (socket says 172.21.15.19:33392) 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 -- 172.21.15.19:0/2074591646 learned_addr learned my addr 172.21.15.19:0/2074591646 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eeeffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef0102dc0 0x7f6ef01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eee7fc640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef01087d0 0x7f6ef0199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 -- 172.21.15.19:0/2074591646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef01087d0 msgr2=0x7f6ef0199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef01087d0 0x7f6ef0199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 -- 172.21.15.19:0/2074591646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef0102dc0 msgr2=0x7f6ef01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef0102dc0 0x7f6ef01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 -- 172.21.15.19:0/2074591646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef019f3a0 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eee7fc640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef01087d0 0x7f6ef0199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6eef7fe640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0109150 0x7f6ef019ebd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800cce0 tx=0x7f6ee800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6ef4a28640 1 -- 172.21.15.19:0/2074591646 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800f450 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6ef4a28640 1 -- 172.21.15.19:0/2074591646 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee800faa0 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef019f690 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6ef4a28640 1 -- 172.21.15.19:0/2074591646 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8018b70 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.265+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef01a5d50 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.266+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef01031a0 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.268+0000 7f6ef4a28640 1 -- 172.21.15.19:0/2074591646 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f6ee800f5f0 con 0x7f6ef0109150 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.269+0000 7f6ef4a28640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6ed80b5440 0x7f6ed80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.269+0000 7f6eeeffd640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6ed80b5440 0x7f6ed80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.269+0000 7f6ef4a28640 1 -- 172.21.15.19:0/2074591646 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6ee80e65d0 con 0x7f6ef0109150 2024-09-11T00:02:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.269+0000 7f6eeeffd640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6ed80b5440 0x7f6ed80b7900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0005ab0 tx=0x7f6ee0005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.271+0000 7f6ef4a28640 1 -- 172.21.15.19:0/2074591646 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6ee8014030 con 0x7f6ef0109150 2024-09-11T00:02:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.462+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ef01a60e0 con 0x7f6ef0109150 2024-09-11T00:02:37.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.463+0000 7f6ef4a28640 1 -- 172.21.15.19:0/2074591646 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22967 (secure 0 0 0) 0x7f6ee80ad340 con 0x7f6ef0109150 2024-09-11T00:02:37.465 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:02:37.465 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:00:53.600623+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6ed80b5440 msgr2=0x7f6ed80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6ed80b5440 0x7f6ed80b7900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0005ab0 tx=0x7f6ee0005a20 comp rx=0 tx=0).stop 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0109150 msgr2=0x7f6ef019ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0109150 0x7f6ef019ebd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800cce0 tx=0x7f6ee800a620 comp rx=0 tx=0).stop 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 shutdown_connections 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6ed80b5440 0x7f6ed80b7900 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ef0109150 0x7f6ef019ebd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef01087d0 0x7f6ef0199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 --2- 172.21.15.19:0/2074591646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef0102dc0 0x7f6ef01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.465+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 >> 172.21.15.19:0/2074591646 conn(0x7f6ef00fe830 msgr2=0x7f6ef0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.466+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 shutdown_connections 2024-09-11T00:02:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:37.466+0000 7f6ef5a2a640 1 -- 172.21.15.19:0/2074591646 wait complete. 2024-09-11T00:02:38.116 DEBUG:tasks.fwd_scrub:Yielding 2024-09-11T00:02:38.116 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T00:02:38.124 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T00:02:38.124 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T00:02:38.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-11T00:02:38.125 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-11T00:02:38.125 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:02:38.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 -- 172.21.15.19:0/520532612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 msgr2=0x7f9a4010e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 --2- 172.21.15.19:0/520532612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a4010e800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009ca0 tx=0x7f9a3802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 -- 172.21.15.19:0/520532612 shutdown_connections 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 --2- 172.21.15.19:0/520532612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a4010e800 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 --2- 172.21.15.19:0/520532612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40107680 0x7f9a40107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 --2- 172.21.15.19:0/520532612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40101c80 0x7f9a40102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 -- 172.21.15.19:0/520532612 >> 172.21.15.19:0/520532612 conn(0x7f9a400fd6a0 msgr2=0x7f9a400ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 -- 172.21.15.19:0/520532612 shutdown_connections 2024-09-11T00:02:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.235+0000 7f9a46564640 1 -- 172.21.15.19:0/520532612 wait complete. 2024-09-11T00:02:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.236+0000 7f9a46564640 1 Processor -- start 2024-09-11T00:02:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.236+0000 7f9a46564640 1 -- start start 2024-09-11T00:02:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a46564640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40101c80 0x7f9a400fdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a46564640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40107680 0x7f9a400fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a46564640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a400fe620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a46564640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40111cc0 con 0x7f9a40108000 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a46564640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40111b40 con 0x7f9a40101c80 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a46564640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40111e40 con 0x7f9a40107680 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a400fe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a400fe620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33404/0 (socket says 172.21.15.19:33404) 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 -- 172.21.15.19:0/3204199309 learned_addr learned my addr 172.21.15.19:0/3204199309 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a3f7fe640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40107680 0x7f9a400fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a3ffff640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40101c80 0x7f9a400fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 -- 172.21.15.19:0/3204199309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40107680 msgr2=0x7f9a400fe0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40107680 0x7f9a400fe0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 -- 172.21.15.19:0/3204199309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40101c80 msgr2=0x7f9a400fdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40101c80 0x7f9a400fdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 -- 172.21.15.19:0/3204199309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a401a7690 con 0x7f9a40108000 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.237+0000 7f9a44b01640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a400fe620 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a38005cc0 tx=0x7f9a3802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.238+0000 7f9a3d7fa640 1 -- 172.21.15.19:0/3204199309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38003bf0 con 0x7f9a40108000 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.238+0000 7f9a3d7fa640 1 -- 172.21.15.19:0/3204199309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a38003d90 con 0x7f9a40108000 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.238+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a401a7920 con 0x7f9a40108000 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.238+0000 7f9a3d7fa640 1 -- 172.21.15.19:0/3204199309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3802fbc0 con 0x7f9a40108000 2024-09-11T00:02:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.238+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a401a7e70 con 0x7f9a40108000 2024-09-11T00:02:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.239+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a40102060 con 0x7f9a40108000 2024-09-11T00:02:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.241+0000 7f9a3d7fa640 1 -- 172.21.15.19:0/3204199309 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f9a38004610 con 0x7f9a40108000 2024-09-11T00:02:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.242+0000 7f9a3d7fa640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9a280b53c0 0x7f9a280b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.242+0000 7f9a3d7fa640 1 -- 172.21.15.19:0/3204199309 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9a38107500 con 0x7f9a40108000 2024-09-11T00:02:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.242+0000 7f9a3ffff640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9a280b53c0 0x7f9a280b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.243+0000 7f9a3ffff640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9a280b53c0 0x7f9a280b7880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005fd0 tx=0x7f9a30005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.245+0000 7f9a3d7fa640 1 -- 172.21.15.19:0/3204199309 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a380ce160 con 0x7f9a40108000 2024-09-11T00:02:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:38 smithi135 ceph-mon[35432]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T00:02:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:38 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2074591646' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:38.426 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:38.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.473+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9a40104c40 con 0x7f9a280b53c0 2024-09-11T00:02:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:38 smithi019 ceph-mon[30859]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T00:02:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:38 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2074591646' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:38 smithi131 ceph-mon[35491]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T00:02:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:38 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2074591646' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:02:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.626+0000 7f9a3d7fa640 1 -- 172.21.15.19:0/3204199309 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9a40104c40 con 0x7f9a280b53c0 2024-09-11T00:02:38.628 INFO:teuthology.orchestra.run.smithi019.stdout:Schedule set for path / 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.628+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9a280b53c0 msgr2=0x7f9a280b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.628+0000 7f9a46564640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9a280b53c0 0x7f9a280b7880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005fd0 tx=0x7f9a30005850 comp rx=0 tx=0).stop 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.628+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 msgr2=0x7f9a400fe620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.628+0000 7f9a46564640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a400fe620 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a38005cc0 tx=0x7f9a3802f380 comp rx=0 tx=0).stop 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.628+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 shutdown_connections 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.628+0000 7f9a46564640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9a280b53c0 0x7f9a280b7880 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.629+0000 7f9a46564640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a40108000 0x7f9a400fe620 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.629+0000 7f9a46564640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40107680 0x7f9a400fe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.629+0000 7f9a46564640 1 --2- 172.21.15.19:0/3204199309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40101c80 0x7f9a400fdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.629+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 >> 172.21.15.19:0/3204199309 conn(0x7f9a400fd6a0 msgr2=0x7f9a4006b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.629+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 shutdown_connections 2024-09-11T00:02:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.629+0000 7f9a46564640 1 -- 172.21.15.19:0/3204199309 wait complete. 2024-09-11T00:02:38.645 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-11T00:02:38.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 -- 172.21.15.19:0/3294859879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e81043d0 msgr2=0x7f49e8104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/3294859879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e81043d0 0x7f49e8104830 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009900 tx=0x7f49dc02a410 comp rx=0 tx=0).stop 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 -- 172.21.15.19:0/3294859879 shutdown_connections 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/3294859879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49e8104d70 0x7f49e810e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/3294859879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e81043d0 0x7f49e8104830 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/3294859879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e8102010 0x7f49e81023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 -- 172.21.15.19:0/3294859879 >> 172.21.15.19:0/3294859879 conn(0x7f49e8077720 msgr2=0x7f49e8077b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 -- 172.21.15.19:0/3294859879 shutdown_connections 2024-09-11T00:02:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.757+0000 7f49ed8bd640 1 -- 172.21.15.19:0/3294859879 wait complete. 2024-09-11T00:02:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 Processor -- start 2024-09-11T00:02:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 -- start start 2024-09-11T00:02:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e8102010 0x7f49e819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49e81043d0 0x7f49e819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e8104d70 0x7f49e819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8111c00 con 0x7f49e8102010 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8111a80 con 0x7f49e81043d0 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49ed8bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8111d80 con 0x7f49e8104d70 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e8102010 0x7f49e819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e8102010 0x7f49e819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33440/0 (socket says 172.21.15.19:33440) 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.758+0000 7f49e6ffd640 1 -- 172.21.15.19:0/2512654520 learned_addr learned my addr 172.21.15.19:0/2512654520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e67fc640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49e81043d0 0x7f49e819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e77fe640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e8104d70 0x7f49e819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e6ffd640 1 -- 172.21.15.19:0/2512654520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e8104d70 msgr2=0x7f49e819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e6ffd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e8104d70 0x7f49e819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e6ffd640 1 -- 172.21.15.19:0/2512654520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49e81043d0 msgr2=0x7f49e819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e6ffd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49e81043d0 0x7f49e819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e6ffd640 1 -- 172.21.15.19:0/2512654520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e81a5470 con 0x7f49e8102010 2024-09-11T00:02:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e67fc640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49e81043d0 0x7f49e819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49e6ffd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e8102010 0x7f49e819a070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49d800d950 tx=0x7f49d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49ec8bb640 1 -- 172.21.15.19:0/2512654520 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8017030 con 0x7f49e8102010 2024-09-11T00:02:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49ec8bb640 1 -- 172.21.15.19:0/2512654520 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d8004020 con 0x7f49e8102010 2024-09-11T00:02:38.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e81a5760 con 0x7f49e8102010 2024-09-11T00:02:38.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49ec8bb640 1 -- 172.21.15.19:0/2512654520 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d80047a0 con 0x7f49e8102010 2024-09-11T00:02:38.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.759+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e81a5c80 con 0x7f49e8102010 2024-09-11T00:02:38.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.760+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e81023f0 con 0x7f49e8102010 2024-09-11T00:02:38.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.762+0000 7f49ec8bb640 1 -- 172.21.15.19:0/2512654520 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f49d8009a30 con 0x7f49e8102010 2024-09-11T00:02:38.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.763+0000 7f49ec8bb640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49d00b53c0 0x7f49d00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:38.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.763+0000 7f49ec8bb640 1 -- 172.21.15.19:0/2512654520 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f49d80e5f80 con 0x7f49e8102010 2024-09-11T00:02:38.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.763+0000 7f49e67fc640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49d00b53c0 0x7f49d00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:38.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.763+0000 7f49e67fc640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49d00b53c0 0x7f49d00b7880 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49dc031440 tx=0x7f49dc005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:38.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.766+0000 7f49ec8bb640 1 -- 172.21.15.19:0/2512654520 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f49d80acc40 con 0x7f49e8102010 2024-09-11T00:02:38.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.984+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f49e8063590 con 0x7f49d00b53c0 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 -- 172.21.15.19:0/217058232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd010d100 msgr2=0x7f0cd010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/217058232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd010d100 0x7f0cd010f560 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ca0 tx=0x7f0cc802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 -- 172.21.15.19:0/217058232 shutdown_connections 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/217058232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd010d100 0x7f0cd010f560 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/217058232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd01045c0 0x7f0cd010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/217058232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cd0103ca0 0x7f0cd0104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 -- 172.21.15.19:0/217058232 >> 172.21.15.19:0/217058232 conn(0x7f0cd00fd700 msgr2=0x7f0cd00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 -- 172.21.15.19:0/217058232 shutdown_connections 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.972+0000 7f0cd4a04640 1 -- 172.21.15.19:0/217058232 wait complete. 2024-09-11T00:02:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 Processor -- start 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 -- start start 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd0103ca0 0x7f0cd0199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd01045c0 0x7f0cd0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cd010d100 0x7f0cd019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0112d70 con 0x7f0cd01045c0 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0112bf0 con 0x7f0cd010d100 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cd4a04640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0112ef0 con 0x7f0cd0103ca0 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0ccdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd01045c0 0x7f0cd0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0ccdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd01045c0 0x7f0cd0199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33464/0 (socket says 172.21.15.19:33464) 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0ccdd9b640 1 -- 172.21.15.19:0/3896037062 learned_addr learned my addr 172.21.15.19:0/3896037062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cd010d100 0x7f0cd019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.973+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd0103ca0 0x7f0cd0199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0ccdd9b640 1 -- 172.21.15.19:0/3896037062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd0103ca0 msgr2=0x7f0cd0199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd0103ca0 0x7f0cd0199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0ccdd9b640 1 -- 172.21.15.19:0/3896037062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cd010d100 msgr2=0x7f0cd019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cd010d100 0x7f0cd019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0ccdd9b640 1 -- 172.21.15.19:0/3896037062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd019f2f0 con 0x7f0cd01045c0 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd0103ca0 0x7f0cd0199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd01045c0 0x7f0cd0199780 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e9c0 tx=0x7f0cb800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0cc77fe640 1 -- 172.21.15.19:0/3896037062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800cd80 con 0x7f0cd01045c0 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0cc77fe640 1 -- 172.21.15.19:0/3896037062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cb80096c0 con 0x7f0cd01045c0 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0cc77fe640 1 -- 172.21.15.19:0/3896037062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8018840 con 0x7f0cd01045c0 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd019f5e0 con 0x7f0cd01045c0 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.974+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01a5e70 con 0x7f0cd01045c0 2024-09-11T00:02:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 Processor -- start 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 -- start start 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cc77fe640 1 -- 172.21.15.19:0/3896037062 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 23) ==== 153318+0+0 (secure 0 0 0) 0x7f0cb8010b20 con 0x7f0cd01045c0 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade07b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade07db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558addfe5e60 con 0x558ade06eee0 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558addfd5290 con 0x558ade06f800 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558addfd90a0 con 0x558ade07b790 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade06f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33474/0 (socket says 172.21.15.19:33474) 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cced9d640 1 -- 172.21.15.19:0/1449476989 learned_addr learned my addr 172.21.15.19:0/1449476989 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0cce59c640 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.977+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade07db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cced9d640 1 -- 172.21.15.19:0/1449476989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 msgr2=0x558ade07db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cced9d640 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade07db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cced9d640 1 -- 172.21.15.19:0/1449476989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 msgr2=0x558ade07b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cced9d640 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade07b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cced9d640 1 -- 172.21.15.19:0/1449476989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558addd33930 con 0x558ade06eee0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cced9d640 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade06f2c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005f70 tx=0x7f0cc8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938c31e564113fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cc77fe640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0cbc0b5440 0x7f0cbc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cc4ff9640 1 -- 172.21.15.19:0/1449476989 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8031cf0 con 0x558ade06eee0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0cbc0b5440 0x7f0cbc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cc77fe640 1 -- 172.21.15.19:0/3896037062 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f0cb80e6180 con 0x7f0cd01045c0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cc4ff9640 1 -- 172.21.15.19:0/1449476989 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc8040070 con 0x558ade06eee0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.978+0000 7f0cc4ff9640 1 -- 172.21.15.19:0/1449476989 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8004040 con 0x558ade06eee0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0cbc0b5440 0x7f0cbc0b7900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558ade072060 tx=0x7f0cc0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/1449476989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 msgr2=0x558ade06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade06f2c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005f70 tx=0x7f0cc8009360 comp rx=0 tx=0).stop 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/1449476989 shutdown_connections 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade07db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade07b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/1449476989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade06f2c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/1449476989 >> 172.21.15.19:0/1449476989 conn(0x558ade06cd10 msgr2=0x558ade06deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/1449476989 shutdown_connections 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/1449476989 wait complete. 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.979+0000 7f0cd6dd9740 1 -- start start 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 1 Processor -- start 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade078790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade078cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade079210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558adde36890 con 0x558ade06eee0 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558addf6fd40 con 0x558ade06f800 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558ade07e3e0 con 0x558ade07b790 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cd6dd9740 10 client.0 _ll_register_callbacks cb 0x558addfd3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade078790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33488/0 (socket says 172.21.15.19:33488) 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 -- 172.21.15.19:0/4243369907 learned_addr learned my addr 172.21.15.19:0/4243369907 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade078cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cced9d640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade079210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 -- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 msgr2=0x558ade079210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade079210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 -- 172.21.15.19:0/4243369907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 msgr2=0x558ade078cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade078cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cce59c640 1 -- 172.21.15.19:0/4243369907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ade087870 con 0x558ade06eee0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.980+0000 7f0cced9d640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade079210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cce59c640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade078790 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001f9f0 tx=0x7f0cc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3037413d365bc763 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/4243369907 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc001d620 con 0x558ade06eee0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/4243369907 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f0cc001d7c0 con 0x558ade06eee0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc8040070 con 0x558ade06eee0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/4243369907 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0cc001d9c0 con 0x558ade06eee0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 10 client.15453 fetch_fsmap learned FSMap version 25 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ade08a260 con 0x558ade06eee0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/4243369907 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc8040070 con 0x558ade06eee0 2024-09-11T00:02:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/4243369907 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0cc0033cb0 con 0x558ade06eee0 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 10 client.15453 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 10 client.15453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 20 client.15453 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade08b810 0x558ade08dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 4 client.15453 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.981+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558addfe7db0 con 0x558ade08b810 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.982+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade08b810 0x558ade08dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.982+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade08b810 0x558ade08dc90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5787aed13baf1d71 server_cookie=4879c779c448268f in_seq=0 out_seq=0 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.982+0000 7f0cb5ffb640 10 client.15453 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/4243369907 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558addfe7db0 con 0x558ade08b810 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cb5ffb640 10 client.15453 handle_command_reply: tid=0 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 client.15453 shutdown 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 msgr2=0x558ade078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade078790 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001f9f0 tx=0x7f0cc0004730 comp rx=0 tx=0).stop 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 shutdown_connections 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade079210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade078cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade08b810 0x558ade08dc90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/4243369907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade078790 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 >> 172.21.15.19:0/4243369907 conn(0x558ade06cd10 msgr2=0x558ade06bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cb5ffb640 0 client.15453 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 shutdown_connections 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/4243369907 wait complete. 2024-09-11T00:02:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:38.983+0000 7f0cd6dd9740 20 client.15453 trim_cache size 0 max 16384 2024-09-11T00:02:39.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.003+0000 7f0cd6dd9740 1 Processor -- start 2024-09-11T00:02:39.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cd6dd9740 1 -- start start 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade0727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade0759a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade075ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01b0ef0 con 0x558ade06eee0 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01ae7c0 con 0x558ade06f800 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01ac610 con 0x558ade07b790 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade0727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade0727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33490/0 (socket says 172.21.15.19:33490) 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cce59c640 1 -- 172.21.15.19:0/3659697213 learned_addr learned my addr 172.21.15.19:0/3659697213 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade075ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade0759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cced9d640 1 -- 172.21.15.19:0/3659697213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 msgr2=0x558ade0759a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade0759a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cced9d640 1 -- 172.21.15.19:0/3659697213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 msgr2=0x558ade0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.004+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade0727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.005+0000 7f0cced9d640 1 -- 172.21.15.19:0/3659697213 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ade06d790 con 0x558ade07b790 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.005+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade0727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.005+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade075ee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0cc802ade0 tx=0x7f0cc8005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afcbf9b1b1bec352 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.005+0000 7f0cb7fff640 1 -- 172.21.15.19:0/3659697213 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8031450 con 0x558ade07b790 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.005+0000 7f0cb7fff640 1 -- 172.21.15.19:0/3659697213 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc8040040 con 0x558ade07b790 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.005+0000 7f0cb7fff640 1 -- 172.21.15.19:0/3659697213 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80305c0 con 0x558ade07b790 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3659697213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 msgr2=0x558ade075ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade075ee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0cc802ade0 tx=0x7f0cc8005fa0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3659697213 shutdown_connections 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade07b790 0x558ade075ee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06f800 0x558ade0759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3659697213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade06eee0 0x558ade0727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3659697213 >> 172.21.15.19:0/3659697213 conn(0x558ade06cd10 msgr2=0x558ade072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3659697213 shutdown_connections 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.006+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3659697213 wait complete. 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 -- start start 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 Processor -- start 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06eee0 0x558ade083c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade06f800 0x558ade080130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade07b790 0x558ade080670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01acc80 con 0x558ade07b790 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01ae0f0 con 0x558ade06eee0 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01ad350 con 0x558ade06f800 2024-09-11T00:02:39.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cd6dd9740 10 client.0 _ll_register_callbacks cb 0x7f0cc0009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade07b790 0x558ade080670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade07b790 0x558ade080670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33496/0 (socket says 172.21.15.19:33496) 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cced9d640 1 -- 172.21.15.19:0/3662910547 learned_addr learned my addr 172.21.15.19:0/3662910547 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0ccdd9b640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade06f800 0x558ade080130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06eee0 0x558ade083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cced9d640 1 -- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade06f800 msgr2=0x558ade080130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade06f800 0x558ade080130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cced9d640 1 -- 172.21.15.19:0/3662910547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06eee0 msgr2=0x558ade083c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.007+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06eee0 0x558ade083c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cced9d640 1 -- 172.21.15.19:0/3662910547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ade080cb0 con 0x558ade07b790 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06eee0 0x558ade083c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cced9d640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade07b790 0x558ade080670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009c10 tx=0x7f0cc802fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dc3ffcba6b6ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/3662910547 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8031450 con 0x558ade07b790 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/3662910547 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f0cc80315f0 con 0x558ade07b790 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc8040040 con 0x558ade07b790 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/3662910547 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0cc80317f0 con 0x558ade07b790 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cd6dd9740 10 client.15459 fetch_fsmap learned FSMap version 25 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.008+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ade0f95e0 con 0x558ade07b790 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/3662910547 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc8036040 con 0x558ade07b790 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/3662910547 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0cc805f070 con 0x558ade07b790 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cd6dd9740 10 client.15459 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cd6dd9740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cd6dd9740 20 client.15459 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade0f9860 0x558ade0fbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cd6dd9740 4 client.15459 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f0cc8040040 con 0x558ade0f9860 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.009+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade0f9860 0x558ade0fbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.010+0000 7f0cce59c640 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade0f9860 0x558ade0fbc50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12bc6fb557a27fd6 server_cookie=614ce7437a93ce6a in_seq=0 out_seq=0 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.010+0000 7f0cb5ffb640 10 client.15459 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cb5ffb640 1 -- 172.21.15.19:0/3662910547 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f0cc8040040 con 0x558ade0f9860 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cb5ffb640 10 client.15459 handle_command_reply: tid=0 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 client.15459 shutdown 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade07b790 msgr2=0x558ade080670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade07b790 0x558ade080670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009c10 tx=0x7f0cc802fe80 comp rx=0 tx=0).stop 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 shutdown_connections 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ade0f9860 0x558ade0fbc50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ade07b790 0x558ade080670 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ade06f800 0x558ade080130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 --2- 172.21.15.19:0/3662910547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ade06eee0 0x558ade083c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 >> 172.21.15.19:0/3662910547 conn(0x558ade06cd10 msgr2=0x558ade0728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cb5ffb640 0 client.15459 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 shutdown_connections 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 1 -- 172.21.15.19:0/3662910547 wait complete. 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.012+0000 7f0cd6dd9740 20 client.15459 trim_cache size 0 max 16384 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "959ea9a0-f727-40b8-aeee-c7acf5059e8e", 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:02:39.021 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:02:39.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0cbc0b5440 msgr2=0x7f0cbc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0cbc0b5440 0x7f0cbc0b7900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558ade072060 tx=0x7f0cc0005f90 comp rx=0 tx=0).stop 2024-09-11T00:02:39.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd01045c0 msgr2=0x7f0cd0199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd01045c0 0x7f0cd0199780 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e9c0 tx=0x7f0cb800edc0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 shutdown_connections 2024-09-11T00:02:39.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cd010d100 0x7f0cd019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0cbc0b5440 0x7f0cbc0b7900 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cd01045c0 0x7f0cd0199780 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 --2- 172.21.15.19:0/3896037062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cd0103ca0 0x7f0cd0199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 >> 172.21.15.19:0/3896037062 conn(0x7f0cd00fd700 msgr2=0x7f0cd00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 shutdown_connections 2024-09-11T00:02:39.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.013+0000 7f0cd4a04640 1 -- 172.21.15.19:0/3896037062 wait complete. 2024-09-11T00:02:39.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.045+0000 7f49ec8bb640 1 -- 172.21.15.19:0/2512654520 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f49e8063590 con 0x7f49d00b53c0 2024-09-11T00:02:39.047 INFO:teuthology.orchestra.run.smithi019.stdout:Retention added to path / 2024-09-11T00:02:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.047+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49d00b53c0 msgr2=0x7f49d00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.047+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49d00b53c0 0x7f49d00b7880 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49dc031440 tx=0x7f49dc005a20 comp rx=0 tx=0).stop 2024-09-11T00:02:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e8102010 msgr2=0x7f49e819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e8102010 0x7f49e819a070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49d800d950 tx=0x7f49d800de10 comp rx=0 tx=0).stop 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 shutdown_connections 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e8104d70 0x7f49e819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49e81043d0 0x7f49e819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49d00b53c0 0x7f49d00b7880 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 --2- 172.21.15.19:0/2512654520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49e8102010 0x7f49e819a070 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 >> 172.21.15.19:0/2512654520 conn(0x7f49e8077720 msgr2=0x7f49e8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 shutdown_connections 2024-09-11T00:02:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.048+0000 7f49ed8bd640 1 -- 172.21.15.19:0/2512654520 wait complete. 2024-09-11T00:02:39.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T00:02:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 -- 172.21.15.19:0/3067473298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe610101bd0 msgr2=0x7fe610101fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 --2- 172.21.15.19:0/3067473298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe610101bd0 0x7fe610101fb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009900 tx=0x7fe60c02a410 comp rx=0 tx=0).stop 2024-09-11T00:02:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 -- 172.21.15.19:0/3067473298 shutdown_connections 2024-09-11T00:02:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 --2- 172.21.15.19:0/3067473298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610107f50 0x7fe61010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 --2- 172.21.15.19:0/3067473298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6101075d0 0x7fe610107a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 --2- 172.21.15.19:0/3067473298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe610101bd0 0x7fe610101fb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 -- 172.21.15.19:0/3067473298 >> 172.21.15.19:0/3067473298 conn(0x7fe6100fd650 msgr2=0x7fe6100ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 -- 172.21.15.19:0/3067473298 shutdown_connections 2024-09-11T00:02:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 -- 172.21.15.19:0/3067473298 wait complete. 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 Processor -- start 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 -- start start 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.170+0000 7fe6185f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610101bd0 0x7fe610198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6185f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6101075d0 0x7fe610198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6185f4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe610107f50 0x7fe61019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6185f4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe610111c10 con 0x7fe6101075d0 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6185f4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe610111a90 con 0x7fe610107f50 2024-09-11T00:02:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6185f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe610111d90 con 0x7fe610101bd0 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6101075d0 0x7fe610198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6101075d0 0x7fe610198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33514/0 (socket says 172.21.15.19:33514) 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 -- 172.21.15.19:0/2895436379 learned_addr learned my addr 172.21.15.19:0/2895436379 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe616390640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610101bd0 0x7fe610198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe616b91640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe610107f50 0x7fe61019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 -- 172.21.15.19:0/2895436379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610101bd0 msgr2=0x7fe610198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610101bd0 0x7fe610198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 -- 172.21.15.19:0/2895436379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe610107f50 msgr2=0x7fe61019da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe610107f50 0x7fe61019da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 -- 172.21.15.19:0/2895436379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61019e1f0 con 0x7fe6101075d0 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe616b91640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe610107f50 0x7fe61019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe615b8f640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6101075d0 0x7fe610198690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe60000d950 tx=0x7fe60000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6077fe640 1 -- 172.21.15.19:0/2895436379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600017030 con 0x7fe6101075d0 2024-09-11T00:02:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6077fe640 1 -- 172.21.15.19:0/2895436379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe600004020 con 0x7fe6101075d0 2024-09-11T00:02:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61019e4e0 con 0x7fe6101075d0 2024-09-11T00:02:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6077fe640 1 -- 172.21.15.19:0/2895436379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6000047a0 con 0x7fe6101075d0 2024-09-11T00:02:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.171+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6101a4d80 con 0x7fe6101075d0 2024-09-11T00:02:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.172+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe610101fb0 con 0x7fe6101075d0 2024-09-11T00:02:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.174+0000 7fe6077fe640 1 -- 172.21.15.19:0/2895436379 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 24) ==== 153375+0+0 (secure 0 0 0) 0x7fe600009a30 con 0x7fe6101075d0 2024-09-11T00:02:39.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.175+0000 7fe6077fe640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe5fc0b54d0 0x7fe5fc0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.175+0000 7fe616390640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe5fc0b54d0 0x7fe5fc0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.175+0000 7fe6077fe640 1 -- 172.21.15.19:0/2895436379 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe6000e6020 con 0x7fe6101075d0 2024-09-11T00:02:39.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.175+0000 7fe616390640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe5fc0b54d0 0x7fe5fc0b7990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe60c031440 tx=0x7fe60c005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.177+0000 7fe6077fe640 1 -- 172.21.15.19:0/2895436379 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe6000acca0 con 0x7fe6101075d0 2024-09-11T00:02:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.384+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fe610063590 con 0x7fe5fc0b54d0 2024-09-11T00:02:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.391+0000 7fe6077fe640 1 -- 172.21.15.19:0/2895436379 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fe610063590 con 0x7fe5fc0b54d0 2024-09-11T00:02:39.392 INFO:teuthology.orchestra.run.smithi019.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T00:02:38", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-11T00:02:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe5fc0b54d0 msgr2=0x7fe5fc0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe5fc0b54d0 0x7fe5fc0b7990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe60c031440 tx=0x7fe60c005b50 comp rx=0 tx=0).stop 2024-09-11T00:02:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6101075d0 msgr2=0x7fe610198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6101075d0 0x7fe610198690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe60000d950 tx=0x7fe60000de10 comp rx=0 tx=0).stop 2024-09-11T00:02:39.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 shutdown_connections 2024-09-11T00:02:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe610107f50 0x7fe61019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe5fc0b54d0 0x7fe5fc0b7990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6101075d0 0x7fe610198690 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 --2- 172.21.15.19:0/2895436379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610101bd0 0x7fe610198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 >> 172.21.15.19:0/2895436379 conn(0x7fe6100fd650 msgr2=0x7fe6100ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 shutdown_connections 2024-09-11T00:02:39.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.393+0000 7fe6185f4640 1 -- 172.21.15.19:0/2895436379 wait complete. 2024-09-11T00:02:39.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T00:02:39.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 -- 172.21.15.19:0/4025723162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 msgr2=0x7fa1d4103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 --2- 172.21.15.19:0/4025723162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4103ec0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009900 tx=0x7fa1d002a410 comp rx=0 tx=0).stop 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 -- 172.21.15.19:0/4025723162 shutdown_connections 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 --2- 172.21.15.19:0/4025723162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d410d090 0x7fa1d410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 --2- 172.21.15.19:0/4025723162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d41044e0 0x7fa1d410cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 --2- 172.21.15.19:0/4025723162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4103ec0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 -- 172.21.15.19:0/4025723162 >> 172.21.15.19:0/4025723162 conn(0x7fa1d40fd630 msgr2=0x7fa1d40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 -- 172.21.15.19:0/4025723162 shutdown_connections 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 -- 172.21.15.19:0/4025723162 wait complete. 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.509+0000 7fa1db582640 1 Processor -- start 2024-09-11T00:02:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1db582640 1 -- start start 2024-09-11T00:02:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1db582640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1db582640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d41044e0 0x7fa1d4101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1db582640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d410d090 0x7fa1d41023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1db582640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4112cf0 con 0x7fa1d4103ae0 2024-09-11T00:02:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1db582640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4112b70 con 0x7fa1d410d090 2024-09-11T00:02:39.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1db582640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4112e70 con 0x7fa1d41044e0 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4101960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33524/0 (socket says 172.21.15.19:33524) 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 -- 172.21.15.19:0/1292314190 learned_addr learned my addr 172.21.15.19:0/1292314190 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d8b1d640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d41044e0 0x7fa1d4101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 -- 172.21.15.19:0/1292314190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d41044e0 msgr2=0x7fa1d4101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d41044e0 0x7fa1d4101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 -- 172.21.15.19:0/1292314190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d410d090 msgr2=0x7fa1d41023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d410d090 0x7fa1d41023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 -- 172.21.15.19:0/1292314190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d41a76c0 con 0x7fa1d4103ae0 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.510+0000 7fa1d931e640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4101960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0006010 tx=0x7fa1d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.511+0000 7fa1ca7fc640 1 -- 172.21.15.19:0/1292314190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d003f030 con 0x7fa1d4103ae0 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.511+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d41a7950 con 0x7fa1d4103ae0 2024-09-11T00:02:39.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.511+0000 7fa1ca7fc640 1 -- 172.21.15.19:0/1292314190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1d0003800 con 0x7fa1d4103ae0 2024-09-11T00:02:39.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.511+0000 7fa1ca7fc640 1 -- 172.21.15.19:0/1292314190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0049060 con 0x7fa1d4103ae0 2024-09-11T00:02:39.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.511+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d41a7e40 con 0x7fa1d4103ae0 2024-09-11T00:02:39.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.512+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d4103ec0 con 0x7fa1d4103ae0 2024-09-11T00:02:39.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.513+0000 7fa1ca7fc640 1 -- 172.21.15.19:0/1292314190 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 24) ==== 153375+0+0 (secure 0 0 0) 0x7fa1d0031b10 con 0x7fa1d4103ae0 2024-09-11T00:02:39.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.514+0000 7fa1ca7fc640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1c00b5450 0x7fa1c00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.514+0000 7fa1d8b1d640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1c00b5450 0x7fa1c00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.514+0000 7fa1ca7fc640 1 -- 172.21.15.19:0/1292314190 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa1d0106ca0 con 0x7fa1d4103ae0 2024-09-11T00:02:39.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.514+0000 7fa1d8b1d640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1c00b5450 0x7fa1c00b7910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4103450 tx=0x7fa1c4008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.518+0000 7fa1ca7fc640 1 -- 172.21.15.19:0/1292314190 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa1d00cd8a0 con 0x7fa1d4103ae0 2024-09-11T00:02:39.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.727+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fa1d40ff240 con 0x7fa1c00b5450 2024-09-11T00:02:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.735+0000 7fa1ca7fc640 1 -- 172.21.15.19:0/1292314190 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fa1d40ff240 con 0x7fa1c00b5450 2024-09-11T00:02:39.736 INFO:teuthology.orchestra.run.smithi019.stdout:/ 1m 6m3h 2024-09-11T00:02:39.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1c00b5450 msgr2=0x7fa1c00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1c00b5450 0x7fa1c00b7910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4103450 tx=0x7fa1c4008040 comp rx=0 tx=0).stop 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 msgr2=0x7fa1d4101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4101960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0006010 tx=0x7fa1d00042f0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 shutdown_connections 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d410d090 0x7fa1d41023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d41044e0 0x7fa1d4101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa1c00b5450 0x7fa1c00b7910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 --2- 172.21.15.19:0/1292314190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d4103ae0 0x7fa1d4101960 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 >> 172.21.15.19:0/1292314190 conn(0x7fa1d40fd630 msgr2=0x7fa1d410f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 shutdown_connections 2024-09-11T00:02:39.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:39.737+0000 7fa1db582640 1 -- 172.21.15.19:0/1292314190 wait complete. 2024-09-11T00:02:39.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:02:39.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-11T00:02:39.817 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-11T00:02:39.961 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T00:02:39.991 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:02:39.992 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T00:02:39.992 INFO:tasks.workunit:timeout=3h 2024-09-11T00:02:39.992 INFO:tasks.workunit:cleanup=True 2024-09-11T00:02:39.993 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:40.002 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:02:40.010 INFO:teuthology.orchestra.run.smithi019.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:40.010 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-11T00:02:40.010 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 60h/96d Inode: 1099511628283 Links: 2 2024-09-11T00:02:40.010 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:02:40.010 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-11T00:02:40.011 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-11 00:00:48.421992006 +0000 2024-09-11T00:02:40.011 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-11 00:00:48.421992006 +0000 2024-09-11T00:02:40.011 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-11 00:02:28.702665262 +0000 2024-09-11T00:02:40.011 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-11 00:00:48.421992006 +0000 2024-09-11T00:02:40.011 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T00:02:40.012 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T00:02:40.085 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:02:40.142 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T00:02:40.325 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:40.325 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: pgmap v329: 97 pgs: 97 active+clean; 648 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-11T00:02:40.325 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:40.325 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:02:40.325 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:02:40.326 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:02:40.326 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:02:40.326 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:40 smithi019 ceph-mon[30859]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-11T00:02:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: pgmap v329: 97 pgs: 97 active+clean; 648 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-11T00:02:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:02:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:02:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:02:40.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:02:40.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:40 smithi135 ceph-mon[35432]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 -- 172.21.15.19:0/210991529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc810d180 msgr2=0x7f4bc810f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 --2- 172.21.15.19:0/210991529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc810d180 0x7f4bc810f5e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009900 tx=0x7f4bb802a410 comp rx=0 tx=0).stop 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 -- 172.21.15.19:0/210991529 shutdown_connections 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 --2- 172.21.15.19:0/210991529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc810d180 0x7f4bc810f5e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 --2- 172.21.15.19:0/210991529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bc8104640 0x7f4bc810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 --2- 172.21.15.19:0/210991529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8103d20 0x7f4bc8104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 -- 172.21.15.19:0/210991529 >> 172.21.15.19:0/210991529 conn(0x7f4bc80fd7c0 msgr2=0x7f4bc80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 -- 172.21.15.19:0/210991529 shutdown_connections 2024-09-11T00:02:40.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.526+0000 7f4bcca84640 1 -- 172.21.15.19:0/210991529 wait complete. 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.527+0000 7f4bcca84640 1 Processor -- start 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.527+0000 7f4bcca84640 1 -- start start 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bcca84640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc8103d20 0x7f4bc8199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bcca84640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8104640 0x7f4bc81997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bcca84640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bc810d180 0x7f4bc819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bcca84640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8112df0 con 0x7f4bc8103d20 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bcca84640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8112c70 con 0x7f4bc8104640 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bcca84640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8112f70 con 0x7f4bc810d180 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc8103d20 0x7f4bc8199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc8103d20 0x7f4bc8199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33552/0 (socket says 172.21.15.19:33552) 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 -- 172.21.15.19:0/3162043164 learned_addr learned my addr 172.21.15.19:0/3162043164 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bc810d180 0x7f4bc819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8104640 0x7f4bc81997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 -- 172.21.15.19:0/3162043164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bc810d180 msgr2=0x7f4bc819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bc810d180 0x7f4bc819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 -- 172.21.15.19:0/3162043164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8104640 msgr2=0x7f4bc81997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8104640 0x7f4bc81997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 -- 172.21.15.19:0/3162043164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc819f310 con 0x7f4bc8103d20 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.528+0000 7f4bc659c640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc8103d20 0x7f4bc8199260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000cce0 tx=0x7f4bc000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.529+0000 7f4bbf7fe640 1 -- 172.21.15.19:0/3162043164 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000f650 con 0x7f4bc8103d20 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.529+0000 7f4bbf7fe640 1 -- 172.21.15.19:0/3162043164 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bc000fca0 con 0x7f4bc8103d20 2024-09-11T00:02:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.529+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc819f600 con 0x7f4bc8103d20 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.529+0000 7f4bbf7fe640 1 -- 172.21.15.19:0/3162043164 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0018b40 con 0x7f4bc8103d20 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.529+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc81018b0 con 0x7f4bc8103d20 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.531+0000 7f4bcee59740 1 Processor -- start 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.531+0000 7f4bcee59740 1 -- start start 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bbf7fe640 1 -- 172.21.15.19:0/3162043164 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 24) ==== 153375+0+0 (secure 0 0 0) 0x7f4bc000f7f0 con 0x7f4bc8103d20 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa80a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa816410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa818d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bcee59740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619aa780e50 con 0x5619aa80a0a0 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bcee59740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5619aa770280 con 0x5619aa80a9c0 2024-09-11T00:02:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bcee59740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619aa774090 con 0x5619aa816950 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa80a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa80a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33556/0 (socket says 172.21.15.19:33556) 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3478500866 learned_addr learned my addr 172.21.15.19:0/3478500866 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc659c640 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa816410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa818d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3478500866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 msgr2=0x5619aa818d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa818d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3478500866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 msgr2=0x5619aa816410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa816410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3478500866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619aa4ce650 con 0x5619aa80a0a0 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.532+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa80a480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4bb802a930 tx=0x7f4bb8032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d343f27ed9e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bbcff9640 1 -- 172.21.15.19:0/3478500866 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8040070 con 0x5619aa80a0a0 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bbcff9640 1 -- 172.21.15.19:0/3478500866 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb80316a0 con 0x5619aa80a0a0 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bbcff9640 1 -- 172.21.15.19:0/3478500866 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8035040 con 0x5619aa80a0a0 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bbf7fe640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4bb40b5450 0x7f4bb40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bc659c640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4bb40b5450 0x7f4bb40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bbf7fe640 1 -- 172.21.15.19:0/3162043164 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f4bc00e6440 con 0x7f4bc8103d20 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bcee59740 1 -- 172.21.15.19:0/3478500866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 msgr2=0x5619aa80a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bc659c640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4bb40b5450 0x7f4bb40b7910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00e3cc0 tx=0x7f4bc0007940 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa80a480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4bb802a930 tx=0x7f4bb8032e70 comp rx=0 tx=0).stop 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bcee59740 1 -- 172.21.15.19:0/3478500866 shutdown_connections 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa818d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa816410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3478500866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa80a480 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.533+0000 7f4bcee59740 1 -- 172.21.15.19:0/3478500866 >> 172.21.15.19:0/3478500866 conn(0x5619aa807ed0 msgr2=0x5619aa809070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 -- 172.21.15.19:0/3478500866 shutdown_connections 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 -- 172.21.15.19:0/3478500866 wait complete. 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 -- start start 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 Processor -- start 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a0a0 0x5619aa816220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa813670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa816950 0x5619aa813c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619aa5d1700 con 0x5619aa816950 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5619aa70b110 con 0x5619aa80a9c0 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619aa819570 con 0x5619aa80a0a0 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bcee59740 10 client.0 _ll_register_callbacks cb 0x5619aa724990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa816950 0x5619aa813c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa816950 0x5619aa813c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33558/0 (socket says 172.21.15.19:33558) 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.534+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/639893349 learned_addr learned my addr 172.21.15.19:0/639893349 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa813670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a0a0 0x5619aa816220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a0a0 msgr2=0x5619aa816220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a0a0 0x5619aa816220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/639893349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 msgr2=0x5619aa813670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa813670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/639893349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619aa738c40 con 0x5619aa816950 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa816950 0x5619aa813c50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8005ec0 tx=0x7f4bb8005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ff93435a3f86fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4badffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4badffb640 1 -- 172.21.15.19:0/639893349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8035040 con 0x5619aa816950 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4badffb640 1 -- 172.21.15.19:0/639893349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f4bb8031d10 con 0x5619aa816950 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb80316a0 con 0x5619aa816950 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4badffb640 1 -- 172.21.15.19:0/639893349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4bb8040040 con 0x5619aa816950 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bcee59740 10 client.15483 fetch_fsmap learned FSMap version 25 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5619aa824eb0 con 0x5619aa816950 2024-09-11T00:02:40.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.535+0000 7f4badffb640 1 -- 172.21.15.19:0/639893349 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb80316a0 con 0x5619aa816950 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4badffb640 1 -- 172.21.15.19:0/639893349 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4bb8054070 con 0x5619aa816950 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bcee59740 10 client.15483 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bcee59740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bcee59740 20 client.15483 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bcee59740 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa826200 0x5619aa8285f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bcee59740 4 client.15483 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619aa782da0 con 0x5619aa826200 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa826200 0x5619aa8285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa826200 0x5619aa8285f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc2233226211443c server_cookie=10844596f5d8b53e in_seq=0 out_seq=0 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.536+0000 7f4badffb640 10 client.15483 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.537+0000 7f4badffb640 1 -- 172.21.15.19:0/639893349 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619aa782da0 con 0x5619aa826200 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.537+0000 7f4badffb640 10 client.15483 handle_command_reply: tid=0 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.537+0000 7f4bcee59740 1 client.15483 shutdown 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa816950 msgr2=0x5619aa813c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa816950 0x5619aa813c50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8005ec0 tx=0x7f4bb8005380 comp rx=0 tx=0).stop 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 shutdown_connections 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa826200 0x5619aa8285f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa816950 0x5619aa813c50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a9c0 0x5619aa813670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4badffb640 0 client.15483 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 --2- 172.21.15.19:0/639893349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a0a0 0x5619aa816220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 >> 172.21.15.19:0/639893349 conn(0x5619aa807ed0 msgr2=0x5619aa80da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 shutdown_connections 2024-09-11T00:02:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 1 -- 172.21.15.19:0/639893349 wait complete. 2024-09-11T00:02:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.538+0000 7f4bcee59740 20 client.15483 trim_cache size 0 max 16384 2024-09-11T00:02:40.555 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:40.555 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: pgmap v329: 97 pgs: 97 active+clean; 648 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-11T00:02:40.555 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:40.555 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:02:40.555 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:02:40.556 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:02:40.556 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:02:40.556 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:40 smithi131 ceph-mon[35491]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 Processor -- start 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 -- start start 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a0a0 0x5619aa8227d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a9c0 0x5619aa8153b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa817d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81b2ec0 con 0x5619aa80a9c0 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81b0790 con 0x5619aa80a0a0 2024-09-11T00:02:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bcee59740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81ae600 con 0x5619aa816950 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a9c0 0x5619aa8153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a9c0 0x5619aa8153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33568/0 (socket says 172.21.15.19:33568) 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 -- 172.21.15.19:0/1830443315 learned_addr learned my addr 172.21.15.19:0/1830443315 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a0a0 0x5619aa8227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa817d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 -- 172.21.15.19:0/1830443315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 msgr2=0x5619aa817d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa817d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 -- 172.21.15.19:0/1830443315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a0a0 msgr2=0x5619aa8227d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a0a0 0x5619aa8227d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 -- 172.21.15.19:0/1830443315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619aa811b70 con 0x5619aa80a9c0 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.556+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a9c0 0x5619aa8153b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80fffd0 tx=0x7f4bb0014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46d02f8d00bc1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4baffff640 1 -- 172.21.15.19:0/1830443315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00140d0 con 0x5619aa80a9c0 2024-09-11T00:02:40.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4baffff640 1 -- 172.21.15.19:0/1830443315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb0014270 con 0x5619aa80a9c0 2024-09-11T00:02:40.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4baffff640 1 -- 172.21.15.19:0/1830443315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0003d00 con 0x5619aa80a9c0 2024-09-11T00:02:40.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 -- 172.21.15.19:0/1830443315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a9c0 msgr2=0x5619aa8153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a9c0 0x5619aa8153b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80fffd0 tx=0x7f4bb0014840 comp rx=0 tx=0).stop 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 -- 172.21.15.19:0/1830443315 shutdown_connections 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa816950 0x5619aa817d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a9c0 0x5619aa8153b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 --2- 172.21.15.19:0/1830443315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa80a0a0 0x5619aa8227d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 -- 172.21.15.19:0/1830443315 >> 172.21.15.19:0/1830443315 conn(0x5619aa807ed0 msgr2=0x5619aa814ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 -- 172.21.15.19:0/1830443315 shutdown_connections 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.557+0000 7f4bcee59740 1 -- 172.21.15.19:0/1830443315 wait complete. 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 -- start start 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 Processor -- start 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa81f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a9c0 0x5619aa8197f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa816950 0x5619aa819d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81aec50 con 0x5619aa80a0a0 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81b00c0 con 0x5619aa816950 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81af320 con 0x5619aa80a9c0 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bcee59740 10 client.0 _ll_register_callbacks cb 0x7f4bb8032d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa81f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa81f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33570/0 (socket says 172.21.15.19:33570) 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3223549998 learned_addr learned my addr 172.21.15.19:0/3223549998 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a9c0 0x5619aa8197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa816950 0x5619aa819d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a9c0 msgr2=0x5619aa8197f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a9c0 0x5619aa8197f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3223549998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa816950 msgr2=0x5619aa819d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa816950 0x5619aa819d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.558+0000 7f4bc6d9d640 1 -- 172.21.15.19:0/3223549998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619aa81a5a0 con 0x5619aa80a0a0 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bc6d9d640 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa81f020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009900 tx=0x7f4bb8032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8922d9d279c9923 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4badffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4badffb640 1 -- 172.21.15.19:0/3223549998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8035070 con 0x5619aa80a0a0 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4badffb640 1 -- 172.21.15.19:0/3223549998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f4bb80318b0 con 0x5619aa80a0a0 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb0014270 con 0x5619aa80a0a0 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4badffb640 1 -- 172.21.15.19:0/3223549998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4bb8048030 con 0x5619aa80a0a0 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bcee59740 10 client.15489 fetch_fsmap learned FSMap version 25 2024-09-11T00:02:40.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5619aa893ed0 con 0x5619aa80a0a0 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4badffb640 1 -- 172.21.15.19:0/3223549998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb0014270 con 0x5619aa80a0a0 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4badffb640 1 -- 172.21.15.19:0/3223549998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4bb8060040 con 0x5619aa80a0a0 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bcee59740 10 client.15489 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bcee59740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bcee59740 20 client.15489 populate_metadata read hostname 'smithi019' 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.559+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa894590 0x5619aa896980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4bcee59740 4 client.15489 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5619aa77e850 con 0x5619aa894590 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa894590 0x5619aa896980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4bc5d9b640 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa894590 0x5619aa896980 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=158be0e34e83c404 server_cookie=faa82eff04ade5f5 in_seq=0 out_seq=0 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4badffb640 10 client.15489 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4badffb640 1 -- 172.21.15.19:0/3223549998 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x5619aa77e850 con 0x5619aa894590 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4badffb640 10 client.15489 handle_command_reply: tid=0 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4bcee59740 1 client.15489 shutdown 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 msgr2=0x5619aa81f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.560+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa81f020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009900 tx=0x7f4bb8032be0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 shutdown_connections 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619aa816950 0x5619aa819d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619aa80a9c0 0x5619aa8197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5619aa894590 0x5619aa896980 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 --2- 172.21.15.19:0/3223549998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619aa80a0a0 0x5619aa81f020 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 >> 172.21.15.19:0/3223549998 conn(0x5619aa807ed0 msgr2=0x5619aa8154c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:40.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4badffb640 0 client.15489 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 shutdown_connections 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 1 -- 172.21.15.19:0/3223549998 wait complete. 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcee59740 20 client.15489 trim_cache size 0 max 16384 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:02:40.569 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "959ea9a0-f727-40b8-aeee-c7acf5059e8e", 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:02:40.570 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:02:40.571 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:02:40.571 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:02:40.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4bb40b5450 msgr2=0x7f4bb40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4bb40b5450 0x7f4bb40b7910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00e3cc0 tx=0x7f4bc0007940 comp rx=0 tx=0).stop 2024-09-11T00:02:40.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc8103d20 msgr2=0x7f4bc8199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:40.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc8103d20 0x7f4bc8199260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000cce0 tx=0x7f4bc000a620 comp rx=0 tx=0).stop 2024-09-11T00:02:40.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 shutdown_connections 2024-09-11T00:02:40.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bc810d180 0x7f4bc819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8104640 0x7f4bc81997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4bb40b5450 0x7f4bb40b7910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 --2- 172.21.15.19:0/3162043164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bc8103d20 0x7f4bc8199260 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:40.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 >> 172.21.15.19:0/3162043164 conn(0x7f4bc80fd7c0 msgr2=0x7f4bc810f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:40.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 shutdown_connections 2024-09-11T00:02:40.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:02:40.561+0000 7f4bcca84640 1 -- 172.21.15.19:0/3162043164 wait complete. 2024-09-11T00:02:41.251 INFO:tasks.cephfs.filesystem:scrub status for tag:959ea9a0-f727-40b8-aeee-c7acf5059e8e - {'path': '/', 'tag': '959ea9a0-f727-40b8-aeee-c7acf5059e8e', 'options': 'recursive,force'} 2024-09-11T00:02:41.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:41 smithi135 ceph-mon[35432]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:41.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:41 smithi135 ceph-mon[35432]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:41.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:41 smithi019 ceph-mon[30859]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:41.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:41 smithi019 ceph-mon[30859]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:41 smithi131 ceph-mon[35491]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:41 smithi131 ceph-mon[35491]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:02:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:42 smithi135 ceph-mon[35432]: pgmap v330: 97 pgs: 97 active+clean; 648 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-11T00:02:42.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:42 smithi019 ceph-mon[30859]: pgmap v330: 97 pgs: 97 active+clean; 648 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-11T00:02:42.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:42 smithi131 ceph-mon[35491]: pgmap v330: 97 pgs: 97 active+clean; 648 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-11T00:02:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:44 smithi135 ceph-mon[35432]: pgmap v331: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 104 KiB/s wr, 46 op/s 2024-09-11T00:02:44.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:44 smithi019 ceph-mon[30859]: pgmap v331: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 104 KiB/s wr, 46 op/s 2024-09-11T00:02:44.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:44 smithi131 ceph-mon[35491]: pgmap v331: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 104 KiB/s wr, 46 op/s 2024-09-11T00:02:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:46 smithi135 ceph-mon[35432]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:46.517 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:46 smithi019 ceph-mon[30859]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:46.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:46 smithi131 ceph-mon[35491]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:47 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:47.452 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:02:47.452 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:47.453 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:47 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:47.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:02:47.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:47.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:47 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:48 smithi135 ceph-mon[35432]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:48 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:48 smithi019 ceph-mon[30859]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:48 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:48 smithi131 ceph-mon[35491]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:48 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:49 smithi135 ceph-mon[35432]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-11T00:02:49.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:02:49.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:02:49.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:49 smithi019 ceph-mon[30859]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-11T00:02:49.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:02:49.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:02:49.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:49.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:49 smithi131 ceph-mon[35491]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-11T00:02:49.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:02:49.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:02:49.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:02:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:50 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:02:50.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:50 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:02:50.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:50 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:02:51.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:51 smithi135 ceph-mon[35432]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-11T00:02:51.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:51 smithi019 ceph-mon[30859]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-11T00:02:51.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:51 smithi131 ceph-mon[35491]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-11T00:02:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:53 smithi135 ceph-mon[35432]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:54.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:53 smithi019 ceph-mon[30859]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:53 smithi131 ceph-mon[35491]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-11T00:02:55.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:55 smithi135 ceph-mon[35432]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 73 KiB/s wr, 14 op/s 2024-09-11T00:02:56.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:55 smithi019 ceph-mon[30859]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 73 KiB/s wr, 14 op/s 2024-09-11T00:02:56.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:55 smithi131 ceph-mon[35491]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 73 KiB/s wr, 14 op/s 2024-09-11T00:02:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:57 smithi135 ceph-mon[35432]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:57 smithi019 ceph-mon[30859]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:58.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:57 smithi131 ceph-mon[35491]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:02:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:02:59 smithi135 ceph-mon[35432]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:03:00.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:02:59 smithi019 ceph-mon[30859]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:03:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:02:59 smithi131 ceph-mon[35491]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-11T00:03:00.522 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:03:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:03:00.056+0000 7f137f48c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:03:00.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:03:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:03:00.056+0000 7f137f48c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:03:00.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:03:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:03:00.056+0000 7f137f48c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:03:00.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:03:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:03:00.056+0000 7f137f48c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:03:00.523 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:03:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x[31085]: 2024-09-11T00:03:00.056+0000 7f137f48c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:03:01.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:01 smithi135 ceph-mon[35432]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:03:01.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:01 smithi135 ceph-mon[35432]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-11T00:03:02.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:01 smithi019 ceph-mon[30859]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:03:02.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:01 smithi019 ceph-mon[30859]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-11T00:03:02.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:01 smithi131 ceph-mon[35491]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:03:02.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:01 smithi131 ceph-mon[35491]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-11T00:03:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:03 smithi135 ceph-mon[35432]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-11T00:03:04.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:03 smithi019 ceph-mon[30859]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-11T00:03:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:03 smithi131 ceph-mon[35491]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-11T00:03:05.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:05 smithi135 ceph-mon[35432]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-11T00:03:06.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:05 smithi019 ceph-mon[30859]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-11T00:03:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:05 smithi131 ceph-mon[35491]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-11T00:03:07.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:07 smithi135 ceph-mon[35432]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-11T00:03:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:07 smithi019 ceph-mon[30859]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-11T00:03:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:07 smithi131 ceph-mon[35491]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-11T00:03:09.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:09 smithi135 ceph-mon[35432]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-11T00:03:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:09 smithi019 ceph-mon[30859]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-11T00:03:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:09 smithi131 ceph-mon[35491]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-11T00:03:11.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:03:11.620 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:11.865 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:11 smithi019 ceph-mon[30859]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-11T00:03:11.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:11 smithi135 ceph-mon[35432]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-11T00:03:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:11 smithi131 ceph-mon[35491]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-11T00:03:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.170+0000 7f455913f640 1 -- 172.21.15.19:0/3945585656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4554102dc0 msgr2=0x7f45541031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.170+0000 7f455913f640 1 --2- 172.21.15.19:0/3945585656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4554102dc0 0x7f45541031a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4544009900 tx=0x7f454402a410 comp rx=0 tx=0).stop 2024-09-11T00:03:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.171+0000 7f455913f640 1 -- 172.21.15.19:0/3945585656 shutdown_connections 2024-09-11T00:03:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.171+0000 7f455913f640 1 --2- 172.21.15.19:0/3945585656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4554109150 0x7f455410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.171+0000 7f455913f640 1 --2- 172.21.15.19:0/3945585656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45541087d0 0x7f4554108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.171+0000 7f455913f640 1 --2- 172.21.15.19:0/3945585656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4554102dc0 0x7f45541031a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.171+0000 7f455913f640 1 -- 172.21.15.19:0/3945585656 >> 172.21.15.19:0/3945585656 conn(0x7f45540fe870 msgr2=0x7f4554100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.171+0000 7f455913f640 1 -- 172.21.15.19:0/3945585656 shutdown_connections 2024-09-11T00:03:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.171+0000 7f455913f640 1 -- 172.21.15.19:0/3945585656 wait complete. 2024-09-11T00:03:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.172+0000 7f455913f640 1 Processor -- start 2024-09-11T00:03:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.172+0000 7f455913f640 1 -- start start 2024-09-11T00:03:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.173+0000 7f455913f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554102dc0 0x7f4554199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.173+0000 7f455913f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45541087d0 0x7f4554199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.173+0000 7f4552d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554102dc0 0x7f4554199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.173+0000 7f454bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45541087d0 0x7f4554199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.173+0000 7f4552d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554102dc0 0x7f4554199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35138/0 (socket says 172.21.15.19:35138) 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.173+0000 7f4552d9d640 1 -- 172.21.15.19:0/3351672830 learned_addr learned my addr 172.21.15.19:0/3351672830 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.173+0000 7f455913f640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4554109150 0x7f455419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4554112e60 con 0x7f45541087d0 2024-09-11T00:03:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4554112ce0 con 0x7f4554109150 2024-09-11T00:03:12.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4554112fe0 con 0x7f4554102dc0 2024-09-11T00:03:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f455359e640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4554109150 0x7f455419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f4552d9d640 1 -- 172.21.15.19:0/3351672830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4554109150 msgr2=0x7f455419ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f4552d9d640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4554109150 0x7f455419ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f4552d9d640 1 -- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45541087d0 msgr2=0x7f4554199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f4552d9d640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45541087d0 0x7f4554199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f4552d9d640 1 -- 172.21.15.19:0/3351672830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455419f3e0 con 0x7f4554102dc0 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f455359e640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4554109150 0x7f455419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.174+0000 7f454bfff640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45541087d0 0x7f4554199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.175+0000 7f4552d9d640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554102dc0 0x7f4554199330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4544005ab0 tx=0x7f4544003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.175+0000 7f4550d99640 1 -- 172.21.15.19:0/3351672830 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454403f070 con 0x7f4554102dc0 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.175+0000 7f4550d99640 1 -- 172.21.15.19:0/3351672830 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4544031d60 con 0x7f4554102dc0 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.175+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455419f670 con 0x7f4554102dc0 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.175+0000 7f4550d99640 1 -- 172.21.15.19:0/3351672830 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544035030 con 0x7f4554102dc0 2024-09-11T00:03:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.175+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45541a5d90 con 0x7f4554102dc0 2024-09-11T00:03:12.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 Processor -- start 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 -- start start 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c0447f0a0 0x557c0447f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 0x557c0447f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04494000 0x557c044963f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c043f5e50 con 0x557c0447f0a0 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557c043e5280 con 0x557c04494000 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.179+0000 7f455b514740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557c043e9090 con 0x557c04489400 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04494000 0x557c044963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04494000 0x557c044963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:42694/0 (socket says 172.21.15.19:42694) 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 -- 172.21.15.19:0/4193554346 learned_addr learned my addr 172.21.15.19:0/4193554346 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:12.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f455359e640 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c0447f0a0 0x557c0447f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 -- 172.21.15.19:0/4193554346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 msgr2=0x557c0447f9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 0x557c0447f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 -- 172.21.15.19:0/4193554346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c0447f0a0 msgr2=0x557c0447f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c0447f0a0 0x557c0447f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f454bfff640 1 -- 172.21.15.19:0/4193554346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c04143650 con 0x557c04494000 2024-09-11T00:03:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.180+0000 7f4550d99640 1 -- 172.21.15.19:0/3351672830 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 153432+0+0 (secure 0 0 0) 0x7f454403b560 con 0x7f4554102dc0 2024-09-11T00:03:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.181+0000 7f454bfff640 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04494000 0x557c044963f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f453c010480 tx=0x7f453c010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d48e5c204df66d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.181+0000 7f45497fa640 1 -- 172.21.15.19:0/4193554346 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c011760 con 0x557c04494000 2024-09-11T00:03:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.181+0000 7f45497fa640 1 -- 172.21.15.19:0/4193554346 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f453c011db0 con 0x557c04494000 2024-09-11T00:03:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.181+0000 7f45497fa640 1 -- 172.21.15.19:0/4193554346 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c00ee50 con 0x557c04494000 2024-09-11T00:03:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.182+0000 7f4550d99640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f45400b55e0 0x7f45400b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.182+0000 7f455359e640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f45400b55e0 0x7f45400b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.182+0000 7f4550d99640 1 -- 172.21.15.19:0/3351672830 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f4544106c80 con 0x7f4554102dc0 2024-09-11T00:03:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 -- 172.21.15.19:0/4193554346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04494000 msgr2=0x557c044963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04494000 0x557c044963f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f453c010480 tx=0x7f453c010940 comp rx=0 tx=0).stop 2024-09-11T00:03:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455359e640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f45400b55e0 0x7f45400b7aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f454c009fd0 tx=0x7f454c009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 -- 172.21.15.19:0/4193554346 shutdown_connections 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04494000 0x557c044963f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 0x557c0447f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 --2- 172.21.15.19:0/4193554346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c0447f0a0 0x557c0447f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 -- 172.21.15.19:0/4193554346 >> 172.21.15.19:0/4193554346 conn(0x557c0447ced0 msgr2=0x557c0447e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.183+0000 7f455b514740 1 -- 172.21.15.19:0/4193554346 shutdown_connections 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 -- 172.21.15.19:0/4193554346 wait complete. 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 -- start start 2024-09-11T00:03:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 Processor -- start 2024-09-11T00:03:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c0447f0a0 0x557c044882e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 0x557c04488860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044935e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c04246700 con 0x557c04494000 2024-09-11T00:03:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557c04380110 con 0x557c0447f0a0 2024-09-11T00:03:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.184+0000 7f455b514740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557c04489be0 con 0x557c04489400 2024-09-11T00:03:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f455b514740 10 client.0 _ll_register_callbacks cb 0x557c04399990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c0447f0a0 0x557c044882e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c0447f0a0 0x557c044882e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:42704/0 (socket says 172.21.15.19:42704) 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 -- 172.21.15.19:0/3140640278 learned_addr learned my addr 172.21.15.19:0/3140640278 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f454bfff640 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 0x557c04488860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 -- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 msgr2=0x557c04488860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 0x557c04488860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 -- 172.21.15.19:0/3140640278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 msgr2=0x557c044935e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.185+0000 7f4552d9d640 1 -- 172.21.15.19:0/3140640278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c043adc40 con 0x557c0447f0a0 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f4552d9d640 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c0447f0a0 0x557c044882e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45440ca2d0 tx=0x7f45440c96b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7caf79c7d98c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f453a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f453a7fc640 1 -- 172.21.15.19:0/3140640278 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544049070 con 0x557c0447f0a0 2024-09-11T00:03:12.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f453a7fc640 1 -- 172.21.15.19:0/3140640278 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f45440b8370 con 0x557c0447f0a0 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f453c011db0 con 0x557c0447f0a0 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f453a7fc640 1 -- 172.21.15.19:0/3140640278 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f45440cc9b0 con 0x557c0447f0a0 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f455b514740 10 client.25022 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c044ab060 con 0x557c0447f0a0 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f453a7fc640 1 -- 172.21.15.19:0/3140640278 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f453c011db0 con 0x557c0447f0a0 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.186+0000 7f453a7fc640 1 -- 172.21.15.19:0/3140640278 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f45440cd2c0 con 0x557c0447f0a0 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f455b514740 10 client.25022 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f455b514740 10 client.25022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f455b514740 20 client.25022 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f455b514740 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c044ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f455b514740 4 client.25022 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c043f7da0 con 0x557c044ac400 2024-09-11T00:03:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f454bfff640 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c044ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f454bfff640 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c044ae830 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3179f5b135fb4e36 server_cookie=192bc5a82cccb7ae in_seq=0 out_seq=0 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.187+0000 7f453a7fc640 10 client.25022 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f453a7fc640 1 -- 172.21.15.19:0/3140640278 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c043f7da0 con 0x557c044ac400 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f453a7fc640 10 client.25022 handle_command_reply: tid=0 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 client.25022 shutdown 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c0447f0a0 msgr2=0x557c044882e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c0447f0a0 0x557c044882e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45440ca2d0 tx=0x7f45440c96b0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 shutdown_connections 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c044ae830 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f453a7fc640 0 client.25022 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044935e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c04489400 0x557c04488860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 --2- 172.21.15.19:0/3140640278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c0447f0a0 0x557c044882e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.188+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 >> 172.21.15.19:0/3140640278 conn(0x557c0447ced0 msgr2=0x557c044821e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.189+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 shutdown_connections 2024-09-11T00:03:12.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.189+0000 7f455b514740 1 -- 172.21.15.19:0/3140640278 wait complete. 2024-09-11T00:03:12.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.189+0000 7f455b514740 20 client.25022 trim_cache size 0 max 16384 2024-09-11T00:03:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.224+0000 7f455b514740 1 Processor -- start 2024-09-11T00:03:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.224+0000 7f455b514740 1 -- start start 2024-09-11T00:03:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.224+0000 7f455b514740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.224+0000 7f455b514740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c04483730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.224+0000 7f455b514740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c04485350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.224+0000 7f455359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c04485350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f455359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c04485350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35394/0 (socket says 172.21.15.19:35394) 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f455359e640 1 -- 172.21.15.19:0/4058900355 learned_addr learned my addr 172.21.15.19:0/4058900355 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45541aeb90 con 0x557c04494000 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f45541ac460 con 0x557c04489400 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45541aa2d0 con 0x557c0447f0a0 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f454bfff640 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c04483730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f4552d9d640 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f454bfff640 1 -- 172.21.15.19:0/4058900355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 msgr2=0x557c044831f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f454bfff640 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044831f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f454bfff640 1 -- 172.21.15.19:0/4058900355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 msgr2=0x557c04485350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f454bfff640 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c04485350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f454bfff640 1 -- 172.21.15.19:0/4058900355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c04486620 con 0x557c04489400 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f455359e640 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c04485350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.225+0000 7f454bfff640 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c04483730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f453c010450 tx=0x7f453c005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ff34417582e429 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.226+0000 7f4548ff9640 1 -- 172.21.15.19:0/4058900355 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c036070 con 0x557c04489400 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.226+0000 7f4548ff9640 1 -- 172.21.15.19:0/4058900355 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f453c0054f0 con 0x557c04489400 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.226+0000 7f4548ff9640 1 -- 172.21.15.19:0/4058900355 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c00ee50 con 0x557c04489400 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 msgr2=0x557c04483730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c04483730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f453c010450 tx=0x7f453c005e50 comp rx=0 tx=0).stop 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 shutdown_connections 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c04485350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c04483730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 --2- 172.21.15.19:0/4058900355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 >> 172.21.15.19:0/4058900355 conn(0x557c0447ced0 msgr2=0x557c0447b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 shutdown_connections 2024-09-11T00:03:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 -- 172.21.15.19:0/4058900355 wait complete. 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.227+0000 7f455b514740 1 -- start start 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.228+0000 7f455b514740 1 Processor -- start 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.228+0000 7f455b514740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.228+0000 7f455b514740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c044c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.228+0000 7f455b514740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044bd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.228+0000 7f4552d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f4552d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35172/0 (socket says 172.21.15.19:35172) 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f454bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c044c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f454bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c044c08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:42730/0 (socket says 172.21.15.19:42730) 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f455359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044bd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f455359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044bd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35400/0 (socket says 172.21.15.19:35400) 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f4552d9d640 1 -- 172.21.15.19:0/2498017221 learned_addr learned my addr 172.21.15.19:0/2498017221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45541aa920 con 0x557c04494000 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f45541abd90 con 0x557c04489400 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45541aaff0 con 0x557c0447f0a0 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.229+0000 7f455b514740 10 client.0 _ll_register_callbacks cb 0x7f45441041c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f455359e640 1 -- 172.21.15.19:0/2498017221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 msgr2=0x557c044c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f455359e640 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f455359e640 1 -- 172.21.15.19:0/2498017221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 msgr2=0x557c044c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f455359e640 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c044c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f455359e640 1 -- 172.21.15.19:0/2498017221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c044bd940 con 0x557c04494000 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f455359e640 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044bd0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f454c012010 tx=0x7f454c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb69cc8ef045af7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f453a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f453a7fc640 1 -- 172.21.15.19:0/2498017221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c029640 con 0x557c04494000 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f453c0054f0 con 0x557c04494000 2024-09-11T00:03:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.230+0000 7f453a7fc640 1 -- 172.21.15.19:0/2498017221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f454c01f420 con 0x557c04494000 2024-09-11T00:03:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f453a7fc640 1 -- 172.21.15.19:0/2498017221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f454c0297e0 con 0x557c04494000 2024-09-11T00:03:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 10 client.15507 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c04519ee0 con 0x557c04494000 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f453a7fc640 1 -- 172.21.15.19:0/2498017221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f454c029e30 con 0x557c04494000 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f453a7fc640 1 -- 172.21.15.19:0/2498017221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f454c027020 con 0x557c04494000 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 10 client.15507 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 10 client.15507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 20 client.15507 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c0451c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 4 client.15507 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.231+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f453c0054f0 con 0x557c044ac400 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.232+0000 7f4552d9d640 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c0451c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.232+0000 7f453a7fc640 10 client.15507 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.232+0000 7f4552d9d640 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c0451c6e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6db7f75c5ac38f07 server_cookie=fdbc0b0a120566f1 in_seq=0 out_seq=0 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.232+0000 7f453a7fc640 1 -- 172.21.15.19:0/2498017221 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f453c0054f0 con 0x557c044ac400 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.232+0000 7f453a7fc640 10 client.15507 handle_command_reply: tid=0 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.232+0000 7f455b514740 1 client.15507 shutdown 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 msgr2=0x557c044bd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044bd0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f454c012010 tx=0x7f454c004ab0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 shutdown_connections 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557c044ac400 0x557c0451c6e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f453a7fc640 0 client.15507 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c04494000 0x557c044bd0c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c04489400 0x557c044c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 --2- 172.21.15.19:0/2498017221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c0447f0a0 0x557c044c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 >> 172.21.15.19:0/2498017221 conn(0x557c0447ced0 msgr2=0x557c0447bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.233+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 shutdown_connections 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.234+0000 7f455b514740 1 -- 172.21.15.19:0/2498017221 wait complete. 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.234+0000 7f455b514740 20 client.15507 trim_cache size 0 max 16384 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:03:12.241 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:03:12.242 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:03:12.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.234+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f45400b55e0 msgr2=0x7f45400b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.234+0000 7f455913f640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f45400b55e0 0x7f45400b7aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f454c009fd0 tx=0x7f454c009600 comp rx=0 tx=0).stop 2024-09-11T00:03:12.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554102dc0 msgr2=0x7f4554199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554102dc0 0x7f4554199330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4544005ab0 tx=0x7f4544003cd0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 shutdown_connections 2024-09-11T00:03:12.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4554109150 0x7f455419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f45400b55e0 0x7f45400b7aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45541087d0 0x7f4554199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 --2- 172.21.15.19:0/3351672830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554102dc0 0x7f4554199330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 >> 172.21.15.19:0/3351672830 conn(0x7f45540fe870 msgr2=0x7f4554100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 shutdown_connections 2024-09-11T00:03:12.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:12.235+0000 7f455913f640 1 -- 172.21.15.19:0/3351672830 wait complete. 2024-09-11T00:03:13.002 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:03:13.002 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:03:13.376 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:13.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:13 smithi019 ceph-mon[30859]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-11T00:03:13.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:13 smithi135 ceph-mon[35432]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-11T00:03:13.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 -- 172.21.15.19:0/355467950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 msgr2=0x7f780c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:13.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 --2- 172.21.15.19:0/355467950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c107ae0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7800009900 tx=0x7f780002a410 comp rx=0 tx=0).stop 2024-09-11T00:03:13.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 -- 172.21.15.19:0/355467950 shutdown_connections 2024-09-11T00:03:13.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 --2- 172.21.15.19:0/355467950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f780c108020 0x7f780c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 --2- 172.21.15.19:0/355467950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c107ae0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 --2- 172.21.15.19:0/355467950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f780c101c90 0x7f780c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 -- 172.21.15.19:0/355467950 >> 172.21.15.19:0/355467950 conn(0x7f780c0fd700 msgr2=0x7f780c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:13.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 -- 172.21.15.19:0/355467950 shutdown_connections 2024-09-11T00:03:13.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.961+0000 7f78121bc640 1 -- 172.21.15.19:0/355467950 wait complete. 2024-09-11T00:03:13.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 Processor -- start 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 -- start start 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f780c101c90 0x7f780c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f780c108020 0x7f780c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f780c111ca0 con 0x7f780c1076a0 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f780c111b20 con 0x7f780c101c90 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f78121bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f780c111e20 con 0x7f780c108020 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f780affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f780affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35430/0 (socket says 172.21.15.19:35430) 2024-09-11T00:03:13.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f780affd640 1 -- 172.21.15.19:0/2815959782 learned_addr learned my addr 172.21.15.19:0/2815959782 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:13.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f780b7fe640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f780c101c90 0x7f780c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:13.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.962+0000 7f780bfff640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f780c108020 0x7f780c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:13.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f780affd640 1 -- 172.21.15.19:0/2815959782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f780c108020 msgr2=0x7f780c0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:13.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f780affd640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f780c108020 0x7f780c0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f780affd640 1 -- 172.21.15.19:0/2815959782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f780c101c90 msgr2=0x7f780c0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:13.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f780affd640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f780c101c90 0x7f780c0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f780affd640 1 -- 172.21.15.19:0/2815959782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c1a76f0 con 0x7f780c1076a0 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f780affd640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c0fe140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7800005940 tx=0x7f7800004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f7808ff9640 1 -- 172.21.15.19:0/2815959782 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780003f030 con 0x7f780c1076a0 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780c1a7980 con 0x7f780c1076a0 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f7808ff9640 1 -- 172.21.15.19:0/2815959782 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7800003aa0 con 0x7f780c1076a0 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.963+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780c1a7eb0 con 0x7f780c1076a0 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.964+0000 7f7808ff9640 1 -- 172.21.15.19:0/2815959782 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800035070 con 0x7f780c1076a0 2024-09-11T00:03:13.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.965+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780c102070 con 0x7f780c1076a0 2024-09-11T00:03:13.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.966+0000 7f7808ff9640 1 -- 172.21.15.19:0/2815959782 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 25) ==== 153432+0+0 (secure 0 0 0) 0x7f78000035f0 con 0x7f780c1076a0 2024-09-11T00:03:13.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.967+0000 7f7808ff9640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77f40b5560 0x7f77f40b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:13.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.967+0000 7f7808ff9640 1 -- 172.21.15.19:0/2815959782 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f78001069f0 con 0x7f780c1076a0 2024-09-11T00:03:13.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.967+0000 7f780b7fe640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77f40b5560 0x7f77f40b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:13.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.967+0000 7f780b7fe640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77f40b5560 0x7f77f40b7a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00bbe0 tx=0x7f77fc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:13.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:13.971+0000 7f7808ff9640 1 -- 172.21.15.19:0/2815959782 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f78000cce30 con 0x7f780c1076a0 2024-09-11T00:03:14.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:13 smithi131 ceph-mon[35491]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-11T00:03:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.250+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f780c0fef00 con 0x7f780c1076a0 2024-09-11T00:03:14.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.252+0000 7f7808ff9640 1 -- 172.21.15.19:0/2815959782 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f78000d1860 con 0x7f780c1076a0 2024-09-11T00:03:14.254 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:03:14.255 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"btime":"2024-09-11T00:02:30:097777+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:02:29.420729+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:03:14.255 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 25 2024-09-11T00:03:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.255+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77f40b5560 msgr2=0x7f77f40b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.255+0000 7f78121bc640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77f40b5560 0x7f77f40b7a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00bbe0 tx=0x7f77fc00b390 comp rx=0 tx=0).stop 2024-09-11T00:03:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.255+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 msgr2=0x7f780c0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.255+0000 7f78121bc640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c0fe140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7800005940 tx=0x7f7800004270 comp rx=0 tx=0).stop 2024-09-11T00:03:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.256+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 shutdown_connections 2024-09-11T00:03:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.256+0000 7f78121bc640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f780c108020 0x7f780c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.256+0000 7f78121bc640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77f40b5560 0x7f77f40b7a20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.256+0000 7f78121bc640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f780c1076a0 0x7f780c0fe140 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.256+0000 7f78121bc640 1 --2- 172.21.15.19:0/2815959782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f780c101c90 0x7f780c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.256+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 >> 172.21.15.19:0/2815959782 conn(0x7f780c0fd700 msgr2=0x7f780c100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:14.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.257+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 shutdown_connections 2024-09-11T00:03:14.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:14.257+0000 7f78121bc640 1 -- 172.21.15.19:0/2815959782 wait complete. 2024-09-11T00:03:14.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:14 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2815959782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:03:14.971 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:14 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2815959782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:03:15.003 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:03:15.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:14 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2815959782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:03:15.293 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:15.733 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:15 smithi019 ceph-mon[30859]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-11T00:03:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 -- 172.21.15.19:0/2025467628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4700101c90 msgr2=0x7f4700102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 --2- 172.21.15.19:0/2025467628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4700101c90 0x7f4700102070 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009900 tx=0x7f46f002a410 comp rx=0 tx=0).stop 2024-09-11T00:03:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 -- 172.21.15.19:0/2025467628 shutdown_connections 2024-09-11T00:03:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 --2- 172.21.15.19:0/2025467628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4700108020 0x7f470010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 --2- 172.21.15.19:0/2025467628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47001076a0 0x7f4700107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 --2- 172.21.15.19:0/2025467628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4700101c90 0x7f4700102070 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 -- 172.21.15.19:0/2025467628 >> 172.21.15.19:0/2025467628 conn(0x7f47000fd700 msgr2=0x7f47000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 -- 172.21.15.19:0/2025467628 shutdown_connections 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.835+0000 7f4705c83640 1 -- 172.21.15.19:0/2025467628 wait complete. 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 Processor -- start 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 -- start start 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4700101c90 0x7f47001981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47001076a0 0x7f47001986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4700108020 0x7f470019da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4700111ce0 con 0x7f47001076a0 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4700111b60 con 0x7f4700108020 2024-09-11T00:03:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.836+0000 7f4705c83640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4700111e60 con 0x7f4700101c90 2024-09-11T00:03:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47001076a0 0x7f47001986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4700101c90 0x7f47001981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47001076a0 0x7f47001986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35448/0 (socket says 172.21.15.19:35448) 2024-09-11T00:03:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 -- 172.21.15.19:0/2875246881 learned_addr learned my addr 172.21.15.19:0/2875246881 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46fffff640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4700108020 0x7f470019da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 -- 172.21.15.19:0/2875246881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4700101c90 msgr2=0x7f47001981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4700101c90 0x7f47001981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 -- 172.21.15.19:0/2875246881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4700108020 msgr2=0x7f470019da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4700108020 0x7f470019da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 -- 172.21.15.19:0/2875246881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470019e260 con 0x7f47001076a0 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46fffff640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4700108020 0x7f470019da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46feffd640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47001076a0 0x7f47001986f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009ae0 tx=0x7f46f400ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46fcff9640 1 -- 172.21.15.19:0/2875246881 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4007920 con 0x7f47001076a0 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46fcff9640 1 -- 172.21.15.19:0/2875246881 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46f4005020 con 0x7f47001076a0 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.837+0000 7f46fcff9640 1 -- 172.21.15.19:0/2875246881 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4004cd0 con 0x7f47001076a0 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.838+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470019e550 con 0x7f47001076a0 2024-09-11T00:03:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.838+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470006aab0 con 0x7f47001076a0 2024-09-11T00:03:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.840+0000 7f46fcff9640 1 -- 172.21.15.19:0/2875246881 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 25) ==== 153432+0+0 (secure 0 0 0) 0x7f46f4007ac0 con 0x7f47001076a0 2024-09-11T00:03:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 Processor -- start 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 -- start start 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624333fc0f0 0x5624333fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433410c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624334111b0 0x5624334135a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562433372ea0 con 0x5624334111b0 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5624333622d0 con 0x5624333fc0f0 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.841+0000 7f4708058740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5624333660e0 con 0x5624333fca10 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46fcff9640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f46e80b55e0 0x7f46e80b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46fffff640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f46e80b55e0 0x7f46e80b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433410c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433410c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35210/0 (socket says 172.21.15.19:35210) 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1420720934 learned_addr learned my addr 172.21.15.19:0/1420720934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46feffd640 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624334111b0 0x5624334135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46fcff9640 1 -- 172.21.15.19:0/2875246881 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f46f40e97c0 con 0x7f47001076a0 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1420720934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624333fc0f0 msgr2=0x5624333fc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624333fc0f0 0x5624333fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1420720934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624334111b0 msgr2=0x5624334135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624334111b0 0x5624334135a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.842+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1420720934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624330c0650 con 0x5624333fca10 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.843+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433410c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009900 tx=0x7f46f0032bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96398393daf72a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.843+0000 7f46e5ffb640 1 -- 172.21.15.19:0/1420720934 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0046070 con 0x5624333fca10 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.843+0000 7f46e5ffb640 1 -- 172.21.15.19:0/1420720934 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46f0032cc0 con 0x5624333fca10 2024-09-11T00:03:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.843+0000 7f46e5ffb640 1 -- 172.21.15.19:0/1420720934 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0035040 con 0x5624333fca10 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f4708058740 1 -- 172.21.15.19:0/1420720934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 msgr2=0x562433410c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f46fffff640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f46e80b55e0 0x7f46e80b7aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46f8005fd0 tx=0x7f46f80098e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f4708058740 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433410c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009900 tx=0x7f46f0032bd0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f4708058740 1 -- 172.21.15.19:0/1420720934 shutdown_connections 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f4708058740 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624334111b0 0x5624334135a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f4708058740 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433410c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f4708058740 1 --2- 172.21.15.19:0/1420720934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624333fc0f0 0x5624333fc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.844+0000 7f4708058740 1 -- 172.21.15.19:0/1420720934 >> 172.21.15.19:0/1420720934 conn(0x5624333f9f20 msgr2=0x5624333fb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.845+0000 7f4708058740 1 -- 172.21.15.19:0/1420720934 shutdown_connections 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.845+0000 7f4708058740 1 -- 172.21.15.19:0/1420720934 wait complete. 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.845+0000 7f4708058740 1 -- start start 2024-09-11T00:03:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.845+0000 7f4708058740 1 Processor -- start 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f4708058740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fc0f0 0x562433410b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f4708058740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243340df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f4708058740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x56243340e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f4708058740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5624331c3700 con 0x5624333fca10 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f4708058740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5624332fd160 con 0x5624334111b0 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f4708058740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562433413e20 con 0x5624333fc0f0 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fc0f0 0x562433410b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fc0f0 0x562433410b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35226/0 (socket says 172.21.15.19:35226) 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1611082400 learned_addr learned my addr 172.21.15.19:0/1611082400 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46feffd640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243340df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f4708058740 10 client.0 _ll_register_callbacks cb 0x5624333169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1611082400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 msgr2=0x56243340e5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46fffff640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x56243340e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x56243340e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1611082400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 msgr2=0x56243340df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.846+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243340df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.847+0000 7f46ff7fe640 1 -- 172.21.15.19:0/1611082400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56243332ac90 con 0x5624333fc0f0 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.847+0000 7f46feffd640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243340df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.847+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fc0f0 0x562433410b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46f0044040 tx=0x7f46f00044a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f6f71971d59cb61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.847+0000 7f46deffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.848+0000 7f46deffd640 1 -- 172.21.15.19:0/1611082400 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0046040 con 0x5624333fc0f0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.848+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f0032cc0 con 0x5624333fc0f0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.848+0000 7f46deffd640 1 -- 172.21.15.19:0/1611082400 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f46f00050b0 con 0x5624333fc0f0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.848+0000 7f46deffd640 1 -- 172.21.15.19:0/1611082400 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f46f0035040 con 0x5624333fc0f0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.848+0000 7f4708058740 10 client.25153 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.848+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56243341f7e0 con 0x5624333fc0f0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.848+0000 7f46deffd640 1 -- 172.21.15.19:0/1611082400 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46f0032cc0 con 0x5624333fc0f0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f46deffd640 1 -- 172.21.15.19:0/1611082400 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f46f0004b20 con 0x5624333fc0f0 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f4708058740 10 client.25153 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f4708058740 10 client.25153 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f4708058740 20 client.25153 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f4708058740 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562433420b30 0x562433422f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f4708058740 4 client.25153 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562433374df0 con 0x562433420b30 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.849+0000 7f46feffd640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562433420b30 0x562433422f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.850+0000 7f46deffd640 10 client.25153 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.850+0000 7f46feffd640 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562433420b30 0x562433422f20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=992e6b18883ae740 server_cookie=e2d29de3d7b0c90f in_seq=0 out_seq=0 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.850+0000 7f46deffd640 1 -- 172.21.15.19:0/1611082400 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562433374df0 con 0x562433420b30 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.850+0000 7f46deffd640 10 client.25153 handle_command_reply: tid=0 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.850+0000 7f4708058740 1 client.25153 shutdown 2024-09-11T00:03:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fc0f0 msgr2=0x562433410b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fc0f0 0x562433410b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46f0044040 tx=0x7f46f00044a0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 shutdown_connections 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562433420b30 0x562433422f20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x56243340e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243340df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 --2- 172.21.15.19:0/1611082400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fc0f0 0x562433410b10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 >> 172.21.15.19:0/1611082400 conn(0x5624333f9f20 msgr2=0x5624333ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f46deffd640 0 client.25153 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 shutdown_connections 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 1 -- 172.21.15.19:0/1611082400 wait complete. 2024-09-11T00:03:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.851+0000 7f4708058740 20 client.25153 trim_cache size 0 max 16384 2024-09-11T00:03:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.864+0000 7f4708058740 1 Processor -- start 2024-09-11T00:03:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f4708058740 1 -- start start 2024-09-11T00:03:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f4708058740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243341d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f4708058740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624334111b0 0x562433425b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f4708058740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562433413720 0x5624334260a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f4708058740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47001aecb0 con 0x5624333fca10 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f4708058740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f47001ac580 con 0x562433413720 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f4708058740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47001aa3f0 con 0x5624334111b0 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243341d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243341d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35468/0 (socket says 172.21.15.19:35468) 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46ff7fe640 1 -- 172.21.15.19:0/909538257 learned_addr learned my addr 172.21.15.19:0/909538257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46fffff640 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562433413720 0x5624334260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46feffd640 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624334111b0 0x562433425b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46ff7fe640 1 -- 172.21.15.19:0/909538257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624334111b0 msgr2=0x562433425b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624334111b0 0x562433425b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46ff7fe640 1 -- 172.21.15.19:0/909538257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562433413720 msgr2=0x5624334260a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.865+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562433413720 0x5624334260a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.866+0000 7f46ff7fe640 1 -- 172.21.15.19:0/909538257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56243340e950 con 0x5624333fca10 2024-09-11T00:03:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.866+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243341d0f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46f0004650 tx=0x7f46f0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b659a9a917bf4e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.866+0000 7f46e57fa640 1 -- 172.21.15.19:0/909538257 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0046070 con 0x5624333fca10 2024-09-11T00:03:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.866+0000 7f46e57fa640 1 -- 172.21.15.19:0/909538257 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46f004f070 con 0x5624333fca10 2024-09-11T00:03:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.866+0000 7f46e57fa640 1 -- 172.21.15.19:0/909538257 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0004a40 con 0x5624333fca10 2024-09-11T00:03:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 -- 172.21.15.19:0/909538257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 msgr2=0x56243341d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243341d0f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46f0004650 tx=0x7f46f0031400 comp rx=0 tx=0).stop 2024-09-11T00:03:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 -- 172.21.15.19:0/909538257 shutdown_connections 2024-09-11T00:03:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562433413720 0x5624334260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624334111b0 0x562433425b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 --2- 172.21.15.19:0/909538257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624333fca10 0x56243341d0f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 -- 172.21.15.19:0/909538257 >> 172.21.15.19:0/909538257 conn(0x5624333f9f20 msgr2=0x562433413010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 -- 172.21.15.19:0/909538257 shutdown_connections 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 -- 172.21.15.19:0/909538257 wait complete. 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.867+0000 7f4708058740 1 -- start start 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 1 Processor -- start 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433421c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x562433422140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562433413720 0x562433422680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47001aaa40 con 0x562433413720 2024-09-11T00:03:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f47001abeb0 con 0x5624334111b0 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47001ab110 con 0x5624333fca10 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f4708058740 10 client.0 _ll_register_callbacks cb 0x7f46f0044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433421c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433421c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35248/0 (socket says 172.21.15.19:35248) 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 -- 172.21.15.19:0/2082634686 learned_addr learned my addr 172.21.15.19:0/2082634686 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46fffff640 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562433413720 0x562433422680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46feffd640 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x562433422140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 -- 172.21.15.19:0/2082634686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 msgr2=0x562433422140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x562433422140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 -- 172.21.15.19:0/2082634686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562433413720 msgr2=0x562433422680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562433413720 0x562433422680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.868+0000 7f46ff7fe640 1 -- 172.21.15.19:0/2082634686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56243348c810 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f46ff7fe640 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433421c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46f0044040 tx=0x7f46f00095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e3c1c8d400edcb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f46deffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f46deffd640 1 -- 172.21.15.19:0/2082634686 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0046040 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f004f070 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f46deffd640 1 -- 172.21.15.19:0/2082634686 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f46f00049d0 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f46deffd640 1 -- 172.21.15.19:0/2082634686 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f46f006c050 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f4708058740 10 client.25159 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.869+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56243348c810 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f46deffd640 1 -- 172.21.15.19:0/2082634686 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46f004f070 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f46deffd640 1 -- 172.21.15.19:0/2082634686 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f46f0065060 con 0x5624333fca10 2024-09-11T00:03:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f4708058740 10 client.25159 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f4708058740 10 client.25159 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:03:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f4708058740 20 client.25159 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f4708058740 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x56243348de30 0x562433490250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f4708058740 4 client.25159 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:03:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624333708a0 con 0x56243348de30 2024-09-11T00:03:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f46feffd640 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x56243348de30 0x562433490250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f46feffd640 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x56243348de30 0x562433490250 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ddb8abeb9769af6 server_cookie=f392d8530d28ccf9 in_seq=0 out_seq=0 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.870+0000 7f46deffd640 10 client.25159 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f46deffd640 1 -- 172.21.15.19:0/2082634686 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624333708a0 con 0x56243348de30 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f46deffd640 10 client.25159 handle_command_reply: tid=0 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 client.25159 shutdown 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 msgr2=0x562433421c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433421c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46f0044040 tx=0x7f46f00095a0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 shutdown_connections 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x56243348de30 0x562433490250 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562433413720 0x562433422680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624334111b0 0x562433422140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 --2- 172.21.15.19:0/2082634686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624333fca10 0x562433421c00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 >> 172.21.15.19:0/2082634686 conn(0x5624333f9f20 msgr2=0x56243340c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f46deffd640 0 client.25159 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:03:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 shutdown_connections 2024-09-11T00:03:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 1 -- 172.21.15.19:0/2082634686 wait complete. 2024-09-11T00:03:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.871+0000 7f4708058740 20 client.25159 trim_cache size 0 max 16384 2024-09-11T00:03:15.878 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f46e80b55e0 msgr2=0x7f46e80b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f46e80b55e0 0x7f46e80b7aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46f8005fd0 tx=0x7f46f80098e0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47001076a0 msgr2=0x7f47001986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47001076a0 0x7f47001986f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009ae0 tx=0x7f46f400ff80 comp rx=0 tx=0).stop 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 shutdown_connections 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4700108020 0x7f470019da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f46e80b55e0 0x7f46e80b7aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47001076a0 0x7f47001986f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.872+0000 7f4705c83640 1 --2- 172.21.15.19:0/2875246881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4700101c90 0x7f47001981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:15.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.873+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 >> 172.21.15.19:0/2875246881 conn(0x7f47000fd700 msgr2=0x7f47000ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:15.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.873+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 shutdown_connections 2024-09-11T00:03:15.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:15.873+0000 7f4705c83640 1 -- 172.21.15.19:0/2875246881 wait complete. 2024-09-11T00:03:15.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:15 smithi135 ceph-mon[35432]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-11T00:03:16.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:15 smithi131 ceph-mon[35491]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-11T00:03:16.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:03:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:17.619 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:03:17.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 -- 172.21.15.19:0/2735175649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97201087d0 msgr2=0x7f9720108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 --2- 172.21.15.19:0/2735175649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97201087d0 0x7f9720108c10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9714009900 tx=0x7f971402a410 comp rx=0 tx=0).stop 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 -- 172.21.15.19:0/2735175649 shutdown_connections 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 --2- 172.21.15.19:0/2735175649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9720109150 0x7f972010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 --2- 172.21.15.19:0/2735175649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97201087d0 0x7f9720108c10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 --2- 172.21.15.19:0/2735175649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 0x7f97201031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 -- 172.21.15.19:0/2735175649 >> 172.21.15.19:0/2735175649 conn(0x7f97200fe870 msgr2=0x7f9720100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 -- 172.21.15.19:0/2735175649 shutdown_connections 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.549+0000 7f9724c49640 1 -- 172.21.15.19:0/2735175649 wait complete. 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.550+0000 7f9724c49640 1 Processor -- start 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.550+0000 7f9724c49640 1 -- start start 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f9724c49640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 0x7f972019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f9724c49640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97201087d0 0x7f972019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f9724c49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9720109150 0x7f97201a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f9724c49640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9720112e10 con 0x7f9720109150 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f9724c49640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9720112c90 con 0x7f97201087d0 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f9724c49640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9720112f90 con 0x7f9720102dc0 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 0x7f972019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9720109150 0x7f97201a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 0x7f972019b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35266/0 (socket says 172.21.15.19:35266) 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971e59c640 1 -- 172.21.15.19:0/2648742537 learned_addr learned my addr 172.21.15.19:0/2648742537 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971dd9b640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97201087d0 0x7f972019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971dd9b640 1 -- 172.21.15.19:0/2648742537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 msgr2=0x7f972019b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971dd9b640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 0x7f972019b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.551+0000 7f971dd9b640 1 -- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9720109150 msgr2=0x7f97201a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f971dd9b640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9720109150 0x7f97201a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f971dd9b640 1 -- 172.21.15.19:0/2648742537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97201a1520 con 0x7f97201087d0 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f971e59c640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 0x7f972019b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f971ed9d640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9720109150 0x7f97201a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f971dd9b640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97201087d0 0x7f972019b9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f971402a930 tx=0x7f9714031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f970f7fe640 1 -- 172.21.15.19:0/2648742537 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971403f030 con 0x7f97201087d0 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f970f7fe640 1 -- 172.21.15.19:0/2648742537 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9714004490 con 0x7f97201087d0 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.552+0000 7f970f7fe640 1 -- 172.21.15.19:0/2648742537 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714035070 con 0x7f97201087d0 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.553+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97201a17b0 con 0x7f97201087d0 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.553+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97201a7ed0 con 0x7f97201087d0 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.555+0000 7f972701e740 1 Processor -- start 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f972701e740 1 -- start start 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f972701e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbbc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f972701e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbc8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f972701e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbcad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f972701e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c2afb32ea0 con 0x55c2afbbca10 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f972701e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c2afb222d0 con 0x55c2afbc89a0 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f972701e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2afb260e0 con 0x55c2afbbc0f0 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f971e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbc8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f971e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbc8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35494/0 (socket says 172.21.15.19:35494) 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f971e59c640 1 -- 172.21.15.19:0/3971831530 learned_addr learned my addr 172.21.15.19:0/3971831530 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.556+0000 7f971ed9d640 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbbc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f971e59c640 1 -- 172.21.15.19:0/3971831530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 msgr2=0x55c2afbbc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f971e59c640 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbbc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f971e59c640 1 -- 172.21.15.19:0/3971831530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 msgr2=0x55c2afbcad90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:17.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f971e59c640 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbcad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f971e59c640 1 -- 172.21.15.19:0/3971831530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2af880650 con 0x55c2afbbca10 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f971e59c640 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbc8460 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9710011650 tx=0x7f9710009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4023e6aee96d4254 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f970f7fe640 1 -- 172.21.15.19:0/2648742537 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) ==== 153432+0+0 (secure 0 0 0) 0x7f971403ba30 con 0x7f97201087d0 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f970cff9640 1 -- 172.21.15.19:0/3971831530 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971001e070 con 0x55c2afbbca10 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f970cff9640 1 -- 172.21.15.19:0/3971831530 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f971000fb70 con 0x55c2afbbca10 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.557+0000 7f970cff9640 1 -- 172.21.15.19:0/3971831530 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710019bf0 con 0x55c2afbbca10 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 -- 172.21.15.19:0/3971831530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 msgr2=0x55c2afbc8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbc8460 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9710011650 tx=0x7f9710009f90 comp rx=0 tx=0).stop 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 -- 172.21.15.19:0/3971831530 shutdown_connections 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbcad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbc8460 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 --2- 172.21.15.19:0/3971831530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbbc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 -- 172.21.15.19:0/3971831530 >> 172.21.15.19:0/3971831530 conn(0x55c2afbb9f20 msgr2=0x55c2afbbb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f972701e740 1 -- 172.21.15.19:0/3971831530 shutdown_connections 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.558+0000 7f970f7fe640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f97080b54f0 0x7f97080b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.559+0000 7f971e59c640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f97080b54f0 0x7f97080b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.559+0000 7f972701e740 1 -- 172.21.15.19:0/3971831530 wait complete. 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.559+0000 7f970f7fe640 1 -- 172.21.15.19:0/2648742537 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f97141066f0 con 0x7f97201087d0 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.559+0000 7f972701e740 1 -- start start 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.559+0000 7f971e59c640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f97080b54f0 0x7f97080b79b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97100198d0 tx=0x7f9710013040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.559+0000 7f972701e740 1 Processor -- start 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.559+0000 7f972701e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbc82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f972701e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbbca10 0x55c2afbc5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f972701e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbc89a0 0x55c2afbc5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbc82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f972701e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c2af983700 con 0x55c2afbc89a0 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f972701e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c2afabd160 con 0x55c2afbbca10 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f972701e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2afbcb620 con 0x55c2afbbc0f0 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbc89a0 0x55c2afbc5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbc82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35292/0 (socket says 172.21.15.19:35292) 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 -- 172.21.15.19:0/3475451551 learned_addr learned my addr 172.21.15.19:0/3475451551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f972701e740 10 client.0 _ll_register_callbacks cb 0x55c2afad69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 -- 172.21.15.19:0/3475451551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbbca10 msgr2=0x55c2afbc5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbbca10 0x55c2afbc5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 -- 172.21.15.19:0/3475451551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbc89a0 msgr2=0x55c2afbc5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbc89a0 0x55c2afbc5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.560+0000 7f971e59c640 1 -- 172.21.15.19:0/3475451551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2afaeac90 con 0x55c2afbbc0f0 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f971e59c640 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbc82d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9710013010 tx=0x7f9710019730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2acd0a394bbc4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f9705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f9705ffb640 1 -- 172.21.15.19:0/3475451551 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710034060 con 0x55c2afbbc0f0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f971000fb70 con 0x55c2afbbc0f0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f9705ffb640 1 -- 172.21.15.19:0/3475451551 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9710016050 con 0x55c2afbbc0f0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f9705ffb640 1 -- 172.21.15.19:0/3475451551 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f971001e040 con 0x55c2afbbc0f0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f972701e740 10 client.25171 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c2afbdf800 con 0x55c2afbbc0f0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.561+0000 7f9705ffb640 1 -- 172.21.15.19:0/3475451551 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f971000fb70 con 0x55c2afbbc0f0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f9705ffb640 1 -- 172.21.15.19:0/3475451551 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9710004ad0 con 0x55c2afbbc0f0 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f972701e740 10 client.25171 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f972701e740 10 client.25171 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f972701e740 20 client.25171 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f972701e740 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afbe0bb0 0x55c2afbe2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f972701e740 4 client.25171 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2afb34df0 con 0x55c2afbe0bb0 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f971dd9b640 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afbe0bb0 0x55c2afbe2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f971dd9b640 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afbe0bb0 0x55c2afbe2fa0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3cde77a3ef884324 server_cookie=91c5ca6859c25cc7 in_seq=0 out_seq=0 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.562+0000 7f9705ffb640 10 client.25171 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.563+0000 7f9705ffb640 1 -- 172.21.15.19:0/3475451551 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2afb34df0 con 0x55c2afbe0bb0 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.563+0000 7f9705ffb640 10 client.25171 handle_command_reply: tid=0 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.563+0000 7f972701e740 1 client.25171 shutdown 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.563+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 msgr2=0x55c2afbc82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.563+0000 7f972701e740 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbc82d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9710013010 tx=0x7f9710019730 comp rx=0 tx=0).stop 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.563+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 shutdown_connections 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.563+0000 7f972701e740 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afbe0bb0 0x55c2afbe2fa0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f972701e740 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbc89a0 0x55c2afbc5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f972701e740 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbbca10 0x55c2afbc5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f972701e740 1 --2- 172.21.15.19:0/3475451551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbc82d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f9705ffb640 0 client.25171 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 >> 172.21.15.19:0/3475451551 conn(0x55c2afbb9f20 msgr2=0x55c2afbbfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 shutdown_connections 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f972701e740 1 -- 172.21.15.19:0/3475451551 wait complete. 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.564+0000 7f972701e740 20 client.25171 trim_cache size 0 max 16384 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 Processor -- start 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 -- start start 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbc0f0 0x55c2afbdd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbca10 0x55c2afbb9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbc9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f97201aec00 con 0x55c2afbbc0f0 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f97201ac4d0 con 0x55c2afbc89a0 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f972701e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97201aa320 con 0x55c2afbbca10 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f971e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbc0f0 0x55c2afbdd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f971e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbc0f0 0x55c2afbdd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35508/0 (socket says 172.21.15.19:35508) 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.577+0000 7f971e59c640 1 -- 172.21.15.19:0/1358290122 learned_addr learned my addr 172.21.15.19:0/1358290122 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971dd9b640 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbca10 0x55c2afbb9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971ed9d640 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbc9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971e59c640 1 -- 172.21.15.19:0/1358290122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbca10 msgr2=0x55c2afbb9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971e59c640 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbca10 0x55c2afbb9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971e59c640 1 -- 172.21.15.19:0/1358290122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 msgr2=0x55c2afbc9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971e59c640 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbc9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971e59c640 1 -- 172.21.15.19:0/1358290122 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2afbbc840 con 0x55c2afbbc0f0 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971ed9d640 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbc9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971dd9b640 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbca10 0x55c2afbb9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f971e59c640 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbc0f0 0x55c2afbdd110 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f971000a010 tx=0x7f9710009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb850f8beba5648 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f9707fff640 1 -- 172.21.15.19:0/1358290122 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710034070 con 0x55c2afbbc0f0 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f9707fff640 1 -- 172.21.15.19:0/1358290122 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9710019410 con 0x55c2afbbc0f0 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.578+0000 7f9707fff640 1 -- 172.21.15.19:0/1358290122 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97100052a0 con 0x55c2afbbc0f0 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 -- 172.21.15.19:0/1358290122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbc0f0 msgr2=0x55c2afbdd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbc0f0 0x55c2afbdd110 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f971000a010 tx=0x7f9710009ed0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 -- 172.21.15.19:0/1358290122 shutdown_connections 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbc9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbca10 0x55c2afbb9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 --2- 172.21.15.19:0/1358290122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbc0f0 0x55c2afbdd110 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 -- 172.21.15.19:0/1358290122 >> 172.21.15.19:0/1358290122 conn(0x55c2afbb9f20 msgr2=0x55c2afbc09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 -- 172.21.15.19:0/1358290122 shutdown_connections 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.579+0000 7f972701e740 1 -- 172.21.15.19:0/1358290122 wait complete. 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 -- start start 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 Processor -- start 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbd9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbe8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbe8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f97201aa990 con 0x55c2afbbca10 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f97201abe00 con 0x55c2afbc89a0 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97201ab060 con 0x55c2afbbc0f0 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbe8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbe8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35520/0 (socket says 172.21.15.19:35520) 2024-09-11T00:03:17.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971dd9b640 1 -- 172.21.15.19:0/956213915 learned_addr learned my addr 172.21.15.19:0/956213915 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f972701e740 10 client.0 _ll_register_callbacks cb 0x7f971001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971e59c640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbd9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971ed9d640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbe8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971dd9b640 1 -- 172.21.15.19:0/956213915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 msgr2=0x55c2afbd9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971dd9b640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbd9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.580+0000 7f971dd9b640 1 -- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 msgr2=0x55c2afbe8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f971dd9b640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbe8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f971dd9b640 1 -- 172.21.15.19:0/956213915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2afbe9230 con 0x55c2afbbca10 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f971e59c640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbd9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f971dd9b640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbe8460 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9714006010 tx=0x7f97140cc4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e1e78ad6c978b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f9705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f9705ffb640 1 -- 172.21.15.19:0/956213915 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714049040 con 0x55c2afbbca10 2024-09-11T00:03:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f9705ffb640 1 -- 172.21.15.19:0/956213915 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f97140c8c90 con 0x55c2afbbca10 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9710019410 con 0x55c2afbbca10 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f9705ffb640 1 -- 172.21.15.19:0/956213915 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97140cc530 con 0x55c2afbbca10 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f972701e740 10 client.15546 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.581+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c2afc4dac0 con 0x55c2afbbca10 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f9705ffb640 1 -- 172.21.15.19:0/956213915 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97140f1e50 con 0x55c2afbbca10 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f9705ffb640 1 -- 172.21.15.19:0/956213915 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f97140ccc80 con 0x55c2afbbca10 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f972701e740 10 client.15546 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f972701e740 10 client.15546 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f972701e740 20 client.15546 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f972701e740 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afc4e210 0x55c2afc50630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f972701e740 4 client.15546 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:03:17.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9710019410 con 0x55c2afc4e210 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.582+0000 7f971e59c640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afc4e210 0x55c2afc50630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f971e59c640 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afc4e210 0x55c2afc50630 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57173b381006261e server_cookie=5602aafb3a457e06 in_seq=0 out_seq=0 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f9705ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f9705ffb640 1 -- 172.21.15.19:0/956213915 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9710019410 con 0x55c2afc4e210 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f9705ffb640 10 client.15546 handle_command_reply: tid=0 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 client.15546 shutdown 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 msgr2=0x55c2afbe8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbe8460 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9714006010 tx=0x7f97140cc4a0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 shutdown_connections 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c2afc4e210 0x55c2afc50630 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f9705ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2afbc89a0 0x55c2afbe8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c2afbbca10 0x55c2afbe8460 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 --2- 172.21.15.19:0/956213915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2afbbc0f0 0x55c2afbd9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 >> 172.21.15.19:0/956213915 conn(0x55c2afbb9f20 msgr2=0x55c2afbc6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 shutdown_connections 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.583+0000 7f972701e740 1 -- 172.21.15.19:0/956213915 wait complete. 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f972701e740 20 client.15546 trim_cache size 0 max 16384 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f97080b54f0 msgr2=0x7f97080b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f97080b54f0 0x7f97080b79b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97100198d0 tx=0x7f9710013040 comp rx=0 tx=0).stop 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97201087d0 msgr2=0x7f972019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97201087d0 0x7f972019b9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f971402a930 tx=0x7f9714031a20 comp rx=0 tx=0).stop 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 shutdown_connections 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f97080b54f0 0x7f97080b79b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9720109150 0x7f97201a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97201087d0 0x7f972019b9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 --2- 172.21.15.19:0/2648742537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9720102dc0 0x7f972019b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 >> 172.21.15.19:0/2648742537 conn(0x7f97200fe870 msgr2=0x7f9720075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 shutdown_connections 2024-09-11T00:03:17.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:17.584+0000 7f9724c49640 1 -- 172.21.15.19:0/2648742537 wait complete. 2024-09-11T00:03:17.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:17 smithi019 ceph-mon[30859]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:03:17.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:17 smithi135 ceph-mon[35432]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:03:18.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:17 smithi131 ceph-mon[35491]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:03:18.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:03:18.925 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:19.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.533+0000 7fa251648640 1 -- 172.21.15.19:0/2986755930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 msgr2=0x7fa24c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.533+0000 7fa251648640 1 --2- 172.21.15.19:0/2986755930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 0x7fa24c10e820 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa244009ca0 tx=0x7fa24402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.533+0000 7fa251648640 1 -- 172.21.15.19:0/2986755930 shutdown_connections 2024-09-11T00:03:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.533+0000 7fa251648640 1 --2- 172.21.15.19:0/2986755930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 0x7fa24c10e820 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.533+0000 7fa251648640 1 --2- 172.21.15.19:0/2986755930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa24c1076a0 0x7fa24c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.533+0000 7fa251648640 1 --2- 172.21.15.19:0/2986755930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 0x7fa24c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.533+0000 7fa251648640 1 -- 172.21.15.19:0/2986755930 >> 172.21.15.19:0/2986755930 conn(0x7fa24c0fd700 msgr2=0x7fa24c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.534+0000 7fa251648640 1 -- 172.21.15.19:0/2986755930 shutdown_connections 2024-09-11T00:03:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.534+0000 7fa251648640 1 -- 172.21.15.19:0/2986755930 wait complete. 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 Processor -- start 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 -- start start 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 0x7fa24c19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa24c1076a0 0x7fa24c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 0x7fa24c1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c110c20 con 0x7fa24c108020 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c110aa0 con 0x7fa24c1076a0 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.535+0000 7fa251648640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c110da0 con 0x7fa24c101c90 2024-09-11T00:03:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 0x7fa24c19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 0x7fa24c19b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35320/0 (socket says 172.21.15.19:35320) 2024-09-11T00:03:19.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 -- 172.21.15.19:0/2635180627 learned_addr learned my addr 172.21.15.19:0/2635180627 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:19.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 0x7fa24c1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa24c1076a0 0x7fa24c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 -- 172.21.15.19:0/2635180627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa24c1076a0 msgr2=0x7fa24c19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa24c1076a0 0x7fa24c19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 -- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 msgr2=0x7fa24c1a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 0x7fa24c1a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24affd640 1 -- 172.21.15.19:0/2635180627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c1a1510 con 0x7fa24c101c90 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.536+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 0x7fa24c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.537+0000 7fa24affd640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 0x7fa24c19b460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00d950 tx=0x7fa23c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.537+0000 7fa233fff640 1 -- 172.21.15.19:0/2635180627 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c017030 con 0x7fa24c101c90 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.537+0000 7fa233fff640 1 -- 172.21.15.19:0/2635180627 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa23c004020 con 0x7fa24c101c90 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.537+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24c1a1800 con 0x7fa24c101c90 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.537+0000 7fa233fff640 1 -- 172.21.15.19:0/2635180627 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0047a0 con 0x7fa24c101c90 2024-09-11T00:03:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.537+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24c1a7ec0 con 0x7fa24c101c90 2024-09-11T00:03:19.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.540+0000 7fa253a1d740 1 Processor -- start 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.540+0000 7fa253a1d740 1 -- start start 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa233fff640 1 -- 172.21.15.19:0/2635180627 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 153432+0+0 (secure 0 0 0) 0x7fa23c009a30 con 0x7fa24c101c90 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f14d0 0x56296b1f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b206050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 0x56296b208980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa253a1d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56296b167ea0 con 0x56296b1f14d0 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa253a1d740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56296b1572d0 con 0x56296b206590 2024-09-11T00:03:19.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa253a1d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56296b15b0e0 con 0x56296b1f1df0 2024-09-11T00:03:19.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f14d0 0x56296b1f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f14d0 0x56296b1f18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35548/0 (socket says 172.21.15.19:35548) 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 -- 172.21.15.19:0/1590602984 learned_addr learned my addr 172.21.15.19:0/1590602984 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 -- 172.21.15.19:0/1590602984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 msgr2=0x56296b206050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/1590602984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b206050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 -- 172.21.15.19:0/1590602984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 msgr2=0x56296b208980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/1590602984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 0x56296b208980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.541+0000 7fa24b7fe640 1 -- 172.21.15.19:0/1590602984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296aeb5650 con 0x56296b1f14d0 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.542+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/1590602984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f14d0 0x56296b1f18b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa244009ca0 tx=0x7fa2440099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02c8ce218fc1769 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.542+0000 7fa2317fa640 1 -- 172.21.15.19:0/1590602984 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244031650 con 0x56296b1f14d0 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.542+0000 7fa2317fa640 1 -- 172.21.15.19:0/1590602984 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa244036040 con 0x56296b1f14d0 2024-09-11T00:03:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.542+0000 7fa2317fa640 1 -- 172.21.15.19:0/1590602984 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244004670 con 0x56296b1f14d0 2024-09-11T00:03:19.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.543+0000 7fa233fff640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa2340b54c0 0x7fa2340b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.543+0000 7fa233fff640 1 -- 172.21.15.19:0/2635180627 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa23c0e5b90 con 0x7fa24c101c90 2024-09-11T00:03:19.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.543+0000 7fa253a1d740 1 -- 172.21.15.19:0/1590602984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f14d0 msgr2=0x56296b1f18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.543+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1590602984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f14d0 0x56296b1f18b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa244009ca0 tx=0x7fa2440099e0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.543+0000 7fa24affd640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa2340b54c0 0x7fa2340b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 -- 172.21.15.19:0/1590602984 shutdown_connections 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1590602984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 0x56296b208980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1590602984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b206050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1590602984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f14d0 0x56296b1f18b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 -- 172.21.15.19:0/1590602984 >> 172.21.15.19:0/1590602984 conn(0x56296b1ef300 msgr2=0x56296b1f04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa24affd640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa2340b54c0 0x7fa2340b7980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0e32a0 tx=0x7fa23c0046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 -- 172.21.15.19:0/1590602984 shutdown_connections 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 -- 172.21.15.19:0/1590602984 wait complete. 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 -- start start 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.544+0000 7fa253a1d740 1 Processor -- start 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b205f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f1df0 0x56296b2033d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b203b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa253a1d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56296afb8700 con 0x56296b206590 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa253a1d740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56296b0f2160 con 0x56296b1f1df0 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa253a1d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56296b209060 con 0x56296b1f14d0 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa253a1d740 10 client.0 _ll_register_callbacks cb 0x56296b10b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b203b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b203b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35564/0 (socket says 172.21.15.19:35564) 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 -- 172.21.15.19:0/3503032825 learned_addr learned my addr 172.21.15.19:0/3503032825 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b205f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f1df0 0x56296b2033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 -- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 msgr2=0x56296b205f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b205f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 -- 172.21.15.19:0/3503032825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f1df0 msgr2=0x56296b2033d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f1df0 0x56296b2033d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.545+0000 7fa24b7fe640 1 -- 172.21.15.19:0/3503032825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296b11fc90 con 0x56296b206590 2024-09-11T00:03:19.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b203b60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa24402ade0 tx=0x7fa244004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68db716c9aa7a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:19.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa22eff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:03:19.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa22eff5640 1 -- 172.21.15.19:0/3503032825 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244058060 con 0x56296b206590 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa22eff5640 1 -- 172.21.15.19:0/3503032825 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa244003970 con 0x56296b206590 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa244036040 con 0x56296b206590 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa22eff5640 1 -- 172.21.15.19:0/3503032825 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa244004b40 con 0x56296b206590 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa253a1d740 10 client.15558 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56296b214a90 con 0x56296b206590 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.546+0000 7fa22eff5640 1 -- 172.21.15.19:0/3503032825 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa244036040 con 0x56296b206590 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa22eff5640 1 -- 172.21.15.19:0/3503032825 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa244044070 con 0x56296b206590 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa253a1d740 10 client.15558 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa253a1d740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa253a1d740 20 client.15558 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa253a1d740 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b215de0 0x56296b2181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa253a1d740 4 client.15558 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56296b169df0 con 0x56296b215de0 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.547+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b215de0 0x56296b2181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.548+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b215de0 0x56296b2181d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d2cab7b6ad89e9 server_cookie=53fd4255602849f7 in_seq=0 out_seq=0 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.548+0000 7fa22eff5640 10 client.15558 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa22eff5640 1 -- 172.21.15.19:0/3503032825 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56296b169df0 con 0x56296b215de0 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa22eff5640 10 client.15558 handle_command_reply: tid=0 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 client.15558 shutdown 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 msgr2=0x56296b203b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b203b60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa24402ade0 tx=0x7fa244004250 comp rx=0 tx=0).stop 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 shutdown_connections 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b215de0 0x56296b2181d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b203b60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f1df0 0x56296b2033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 --2- 172.21.15.19:0/3503032825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b205f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 >> 172.21.15.19:0/3503032825 conn(0x56296b1ef300 msgr2=0x56296b1f4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:19.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.549+0000 7fa22eff5640 0 client.15558 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:19.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.550+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 shutdown_connections 2024-09-11T00:03:19.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.550+0000 7fa253a1d740 1 -- 172.21.15.19:0/3503032825 wait complete. 2024-09-11T00:03:19.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.550+0000 7fa253a1d740 20 client.15558 trim_cache size 0 max 16384 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.563+0000 7fa253a1d740 1 Processor -- start 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.563+0000 7fa253a1d740 1 -- start start 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f14d0 0x56296b1eec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b217df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b205110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa253a1d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1aebb0 con 0x56296b206590 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa253a1d740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1ac480 con 0x56296b1f14d0 2024-09-11T00:03:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa253a1d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1aa2d0 con 0x56296b1f1df0 2024-09-11T00:03:19.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa24a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b217df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa24a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b217df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35330/0 (socket says 172.21.15.19:35330) 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa24a7fc640 1 -- 172.21.15.19:0/176617445 learned_addr learned my addr 172.21.15.19:0/176617445 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.564+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b205110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa24a7fc640 1 -- 172.21.15.19:0/176617445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f14d0 msgr2=0x56296b1eec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f14d0 0x56296b1eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa24a7fc640 1 -- 172.21.15.19:0/176617445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 msgr2=0x56296b205110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b205110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa24a7fc640 1 -- 172.21.15.19:0/176617445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296b1f1c20 con 0x56296b1f1df0 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b205110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b217df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa240005780 tx=0x7fa24000bd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc26192f220ca72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa230ff9640 1 -- 172.21.15.19:0/176617445 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240003be0 con 0x56296b1f1df0 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa230ff9640 1 -- 172.21.15.19:0/176617445 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2400054d0 con 0x56296b1f1df0 2024-09-11T00:03:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.565+0000 7fa230ff9640 1 -- 172.21.15.19:0/176617445 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240004d20 con 0x56296b1f1df0 2024-09-11T00:03:19.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 -- 172.21.15.19:0/176617445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 msgr2=0x56296b217df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b217df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa240005780 tx=0x7fa24000bd10 comp rx=0 tx=0).stop 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 -- 172.21.15.19:0/176617445 shutdown_connections 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b206590 0x56296b205110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f1df0 0x56296b217df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 --2- 172.21.15.19:0/176617445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b1f14d0 0x56296b1eec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 -- 172.21.15.19:0/176617445 >> 172.21.15.19:0/176617445 conn(0x56296b1ef300 msgr2=0x56296b204a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 -- 172.21.15.19:0/176617445 shutdown_connections 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.566+0000 7fa253a1d740 1 -- 172.21.15.19:0/176617445 wait complete. 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.567+0000 7fa253a1d740 1 -- start start 2024-09-11T00:03:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.567+0000 7fa253a1d740 1 Processor -- start 2024-09-11T00:03:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.567+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b20ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa253a1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f1df0 0x56296b20c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b20ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b20ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35342/0 (socket says 172.21.15.19:35342) 2024-09-11T00:03:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa24a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f1df0 0x56296b20c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa24a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f1df0 0x56296b20c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35578/0 (socket says 172.21.15.19:35578) 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa24b7fe640 1 -- 172.21.15.19:0/1361591951 learned_addr learned my addr 172.21.15.19:0/1361591951 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 0x56296b20c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1aa940 con 0x56296b1f1df0 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1abdb0 con 0x56296b206590 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.568+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1ab010 con 0x56296b1f14d0 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 0x56296b20c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa24a7fc640 1 -- 172.21.15.19:0/1361591951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 msgr2=0x56296b20ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b20ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa24a7fc640 1 -- 172.21.15.19:0/1361591951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 msgr2=0x56296b20c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 0x56296b20c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa24a7fc640 1 -- 172.21.15.19:0/1361591951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296b20d190 con 0x56296b1f1df0 2024-09-11T00:03:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa253a1d740 10 client.0 _ll_register_callbacks cb 0x7fa244009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2400054d0 con 0x56296b1f1df0 2024-09-11T00:03:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.569+0000 7fa24a7fc640 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f1df0 0x56296b20c420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x56296b2041a0 tx=0x7fa2400052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a587835131611f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.570+0000 7fa22eff5640 10 client.15564 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:03:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.570+0000 7fa22eff5640 1 -- 172.21.15.19:0/1361591951 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240003be0 con 0x56296b1f1df0 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.570+0000 7fa22eff5640 1 -- 172.21.15.19:0/1361591951 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa240003d80 con 0x56296b1f1df0 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.570+0000 7fa22eff5640 1 -- 172.21.15.19:0/1361591951 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2400049a0 con 0x56296b1f1df0 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.570+0000 7fa253a1d740 10 client.15564 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.570+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=25}) -- 0x56296b2836f0 con 0x56296b1f1df0 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa22eff5640 1 -- 172.21.15.19:0/1361591951 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa24002b070 con 0x56296b1f1df0 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa253a1d740 10 client.15564 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa253a1d740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa253a1d740 20 client.15564 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b283d60 0x56296b286220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa253a1d740 4 client.15564 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56296b1658a0 con 0x56296b283d60 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.571+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b283d60 0x56296b286220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.572+0000 7fa24b7fe640 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b283d60 0x56296b286220 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b33ed1cbf586ce05 server_cookie=d642fd66370c1f66 in_seq=0 out_seq=0 2024-09-11T00:03:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.572+0000 7fa22eff5640 10 client.15564 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.572+0000 7fa22eff5640 1 -- 172.21.15.19:0/1361591951 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56296b1658a0 con 0x56296b283d60 2024-09-11T00:03:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.572+0000 7fa22eff5640 10 client.15564 handle_command_reply: tid=0 2024-09-11T00:03:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.572+0000 7fa253a1d740 1 client.15564 shutdown 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.572+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f1df0 msgr2=0x56296b20c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.572+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f1df0 0x56296b20c420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x56296b2041a0 tx=0x7fa2400052a0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 shutdown_connections 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56296b206590 0x56296b20c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56296b283d60 0x56296b286220 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56296b1f1df0 0x56296b20c420 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 --2- 172.21.15.19:0/1361591951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56296b1f14d0 0x56296b20ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa22eff5640 0 client.15564 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 >> 172.21.15.19:0/1361591951 conn(0x56296b1ef300 msgr2=0x56296b205220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 shutdown_connections 2024-09-11T00:03:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 1 -- 172.21.15.19:0/1361591951 wait complete. 2024-09-11T00:03:19.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.573+0000 7fa253a1d740 20 client.15564 trim_cache size 0 max 16384 2024-09-11T00:03:19.577 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:03:19.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa2340b54c0 msgr2=0x7fa2340b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa2340b54c0 0x7fa2340b7980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0e32a0 tx=0x7fa23c0046c0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 msgr2=0x7fa24c19b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 0x7fa24c19b460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00d950 tx=0x7fa23c00de10 comp rx=0 tx=0).stop 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 shutdown_connections 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa2340b54c0 0x7fa2340b7980 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa24c108020 0x7fa24c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa24c1076a0 0x7fa24c19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 --2- 172.21.15.19:0/2635180627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa24c101c90 0x7fa24c19b460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 >> 172.21.15.19:0/2635180627 conn(0x7fa24c0fd700 msgr2=0x7fa24c0fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 shutdown_connections 2024-09-11T00:03:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:19.574+0000 7fa251648640 1 -- 172.21.15.19:0/2635180627 wait complete. 2024-09-11T00:03:19.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:19 smithi019 ceph-mon[30859]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T00:03:19.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:19 smithi135 ceph-mon[35432]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T00:03:20.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:19 smithi131 ceph-mon[35491]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T00:03:21.502 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:03:21.502 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:03:21.870 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:21.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:21 smithi135 ceph-mon[35432]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T00:03:21.992 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:21 smithi019 ceph-mon[30859]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T00:03:22.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:21 smithi131 ceph-mon[35491]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T00:03:22.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 -- 172.21.15.19:0/2669262824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b68103ca0 msgr2=0x7f6b68104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 --2- 172.21.15.19:0/2669262824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b68103ca0 0x7f6b68104080 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009900 tx=0x7f6b6402a410 comp rx=0 tx=0).stop 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 -- 172.21.15.19:0/2669262824 shutdown_connections 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 --2- 172.21.15.19:0/2669262824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b6810d100 0x7f6b6810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 --2- 172.21.15.19:0/2669262824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b681045c0 0x7f6b6810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 --2- 172.21.15.19:0/2669262824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b68103ca0 0x7f6b68104080 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 -- 172.21.15.19:0/2669262824 >> 172.21.15.19:0/2669262824 conn(0x7f6b680fd700 msgr2=0x7f6b680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 -- 172.21.15.19:0/2669262824 shutdown_connections 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.395+0000 7f6b6f351640 1 -- 172.21.15.19:0/2669262824 wait complete. 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 Processor -- start 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 -- start start 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b68103ca0 0x7f6b68199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b681045c0 0x7f6b681997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b6810d100 0x7f6b6819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68112d70 con 0x7f6b6810d100 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68112bf0 con 0x7f6b68103ca0 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.396+0000 7f6b6f351640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68112ef0 con 0x7f6b681045c0 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b68103ca0 0x7f6b68199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b68103ca0 0x7f6b68199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54766/0 (socket says 172.21.15.19:54766) 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 -- 172.21.15.19:0/1737412322 learned_addr learned my addr 172.21.15.19:0/1737412322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b6810d100 0x7f6b6819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b681045c0 0x7f6b681997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 -- 172.21.15.19:0/1737412322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b681045c0 msgr2=0x7f6b681997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b681045c0 0x7f6b681997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 -- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b6810d100 msgr2=0x7f6b6819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b6810d100 0x7f6b6819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 -- 172.21.15.19:0/1737412322 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6819f330 con 0x7f6b68103ca0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b6810d100 0x7f6b6819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.397+0000 7f6b6d0ed640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b68103ca0 0x7f6b68199280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b64005940 tx=0x7f6b640042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.398+0000 7f6b5e7fc640 1 -- 172.21.15.19:0/1737412322 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6403f030 con 0x7f6b68103ca0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.398+0000 7f6b5e7fc640 1 -- 172.21.15.19:0/1737412322 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b64003cb0 con 0x7f6b68103ca0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.398+0000 7f6b5e7fc640 1 -- 172.21.15.19:0/1737412322 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64035070 con 0x7f6b68103ca0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.398+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6819f5c0 con 0x7f6b68103ca0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.398+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6819f990 con 0x7f6b68103ca0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.401+0000 7f6b71726740 1 Processor -- start 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.401+0000 7f6b71726740 1 -- start start 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b5e7fc640 1 -- 172.21.15.19:0/1737412322 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) ==== 153432+0+0 (secure 0 0 0) 0x7f6b6403bbf0 con 0x7f6b68103ca0 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b71726740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c6ee0 0x56097b0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b71726740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c7800 0x56097b0d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b71726740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0d7ba0 0x56097b0d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b71726740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56097b03de60 con 0x56097b0c7800 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b71726740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56097b02d290 con 0x56097b0d7ba0 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b71726740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56097b0310a0 con 0x56097b0c6ee0 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d0ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c7800 0x56097b0d7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d0ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c7800 0x56097b0d7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57492/0 (socket says 172.21.15.19:57492) 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d0ed640 1 -- 172.21.15.19:0/3737815438 learned_addr learned my addr 172.21.15.19:0/3737815438 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c6ee0 0x56097b0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0d7ba0 0x56097b0d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/3737815438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0d7ba0 msgr2=0x56097b0d9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0d7ba0 0x56097b0d9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/3737815438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c7800 msgr2=0x56097b0d7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:22.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c7800 0x56097b0d7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/3737815438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56097ad8b930 con 0x56097b0c6ee0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.402+0000 7f6b6d0ed640 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c7800 0x56097b0d7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.403+0000 7f6b5e7fc640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b540b54e0 0x7f6b540b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.403+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c6ee0 0x56097b0c72c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b60010690 tx=0x7f6b60010b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=176c57543601d59b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.403+0000 7f6b537fe640 1 -- 172.21.15.19:0/3737815438 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60004b20 con 0x56097b0c6ee0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.403+0000 7f6b6d0ed640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b540b54e0 0x7f6b540b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.403+0000 7f6b5e7fc640 1 -- 172.21.15.19:0/1737412322 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6b64106bd0 con 0x7f6b68103ca0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.403+0000 7f6b537fe640 1 -- 172.21.15.19:0/3737815438 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b6000ed80 con 0x56097b0c6ee0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.403+0000 7f6b537fe640 1 -- 172.21.15.19:0/3737815438 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60005780 con 0x56097b0c6ee0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b6d0ed640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b540b54e0 0x7f6b540b79a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6b64003fd0 tx=0x7f6b6410a650 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b71726740 1 -- 172.21.15.19:0/3737815438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c6ee0 msgr2=0x56097b0c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b71726740 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c6ee0 0x56097b0c72c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b60010690 tx=0x7f6b60010b50 comp rx=0 tx=0).stop 2024-09-11T00:03:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b71726740 1 -- 172.21.15.19:0/3737815438 shutdown_connections 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b71726740 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0d7ba0 0x56097b0d9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b71726740 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c7800 0x56097b0d7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b71726740 1 --2- 172.21.15.19:0/3737815438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c6ee0 0x56097b0c72c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.404+0000 7f6b71726740 1 -- 172.21.15.19:0/3737815438 >> 172.21.15.19:0/3737815438 conn(0x56097b0c4d10 msgr2=0x56097b0c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.405+0000 7f6b71726740 1 -- 172.21.15.19:0/3737815438 shutdown_connections 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.405+0000 7f6b71726740 1 -- 172.21.15.19:0/3737815438 wait complete. 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.405+0000 7f6b71726740 1 -- start start 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.405+0000 7f6b71726740 1 Processor -- start 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b71726740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c6ee0 0x56097b0d4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b71726740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c7800 0x56097b0d5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b71726740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0d7ba0 0x56097b0d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b6d8ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c6ee0 0x56097b0d4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b6d8ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c6ee0 0x56097b0d4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57494/0 (socket says 172.21.15.19:57494) 2024-09-11T00:03:22.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/2819942298 learned_addr learned my addr 172.21.15.19:0/2819942298 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56097ae8e890 con 0x56097b0c6ee0 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56097afc7d40 con 0x56097b0c7800 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c7800 0x56097b0d5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56097b0da850 con 0x56097b0d7ba0 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.406+0000 7f6b71726740 10 client.0 _ll_register_callbacks cb 0x56097b02bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0d7ba0 0x56097b0d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6c8ec640 1 -- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0d7ba0 msgr2=0x56097b0d55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0d7ba0 0x56097b0d55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6c8ec640 1 -- 172.21.15.19:0/2819942298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c6ee0 msgr2=0x56097b0d4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c6ee0 0x56097b0d4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6c8ec640 1 -- 172.21.15.19:0/2819942298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56097b0e3bb0 con 0x56097b0c7800 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c6ee0 0x56097b0d4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:22.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c7800 0x56097b0d5070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b6806b950 tx=0x7f6b5800bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=559837ea229e4609 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b50ff9640 1 -- 172.21.15.19:0/2819942298 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58003d00 con 0x56097b0c7800 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b50ff9640 1 -- 172.21.15.19:0/2819942298 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6b58011440 con 0x56097b0c7800 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b6000ed80 con 0x56097b0c7800 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.407+0000 7f6b50ff9640 1 -- 172.21.15.19:0/2819942298 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b58011640 con 0x56097b0c7800 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 10 client.25079 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56097b0e6580 con 0x56097b0c7800 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b50ff9640 1 -- 172.21.15.19:0/2819942298 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b6000ed80 con 0x56097b0c7800 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b50ff9640 1 -- 172.21.15.19:0/2819942298 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b5801b830 con 0x56097b0c7800 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 10 client.25079 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 10 client.25079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 20 client.25079 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b0e7a90 0x56097b0e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 4 client.25079 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.408+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56097b03fdb0 con 0x56097b0e7a90 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.409+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b0e7a90 0x56097b0e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.409+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b0e7a90 0x56097b0e9f30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec2190986eb599ee server_cookie=7acb3d497f1e19f2 in_seq=0 out_seq=0 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.409+0000 7f6b50ff9640 10 client.25079 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b50ff9640 1 -- 172.21.15.19:0/2819942298 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56097b03fdb0 con 0x56097b0e7a90 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b50ff9640 10 client.25079 handle_command_reply: tid=0 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 client.25079 shutdown 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c7800 msgr2=0x56097b0d5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c7800 0x56097b0d5070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b6806b950 tx=0x7f6b5800bf20 comp rx=0 tx=0).stop 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 shutdown_connections 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0d7ba0 0x56097b0d55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c7800 0x56097b0d5070 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b0e7a90 0x56097b0e9f30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 --2- 172.21.15.19:0/2819942298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0c6ee0 0x56097b0d4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 >> 172.21.15.19:0/2819942298 conn(0x56097b0c4d10 msgr2=0x56097b0c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:22.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.410+0000 7f6b50ff9640 0 client.25079 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:22.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.411+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 shutdown_connections 2024-09-11T00:03:22.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.411+0000 7f6b71726740 1 -- 172.21.15.19:0/2819942298 wait complete. 2024-09-11T00:03:22.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.411+0000 7f6b71726740 20 client.25079 trim_cache size 0 max 16384 2024-09-11T00:03:22.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 Processor -- start 2024-09-11T00:03:22.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 -- start start 2024-09-11T00:03:22.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 0x56097b0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0ef800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0efd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b681aec10 con 0x56097b0d7ba0 2024-09-11T00:03:22.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b681ac4e0 con 0x56097b0c6ee0 2024-09-11T00:03:22.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b71726740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b681aa330 con 0x56097b0c7800 2024-09-11T00:03:22.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6d8ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6d8ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57504/0 (socket says 172.21.15.19:57504) 2024-09-11T00:03:22.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/2304717887 learned_addr learned my addr 172.21.15.19:0/2304717887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 0x56097b0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0ef800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/2304717887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 msgr2=0x56097b0ef800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0ef800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.429+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/2304717887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 msgr2=0x56097b0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.430+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 0x56097b0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.430+0000 7f6b6d8ee640 1 -- 172.21.15.19:0/2304717887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56097b0c4760 con 0x56097b0d7ba0 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.430+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0efd40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009880 tx=0x7f6b6001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b7076c3db56022 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.430+0000 7f6b52ffd640 1 -- 172.21.15.19:0/2304717887 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b600053f0 con 0x56097b0d7ba0 2024-09-11T00:03:22.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.430+0000 7f6b52ffd640 1 -- 172.21.15.19:0/2304717887 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b600049e0 con 0x56097b0d7ba0 2024-09-11T00:03:22.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.430+0000 7f6b52ffd640 1 -- 172.21.15.19:0/2304717887 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60012450 con 0x56097b0d7ba0 2024-09-11T00:03:22.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 -- 172.21.15.19:0/2304717887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 msgr2=0x56097b0efd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0efd40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009880 tx=0x7f6b6001f040 comp rx=0 tx=0).stop 2024-09-11T00:03:22.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 -- 172.21.15.19:0/2304717887 shutdown_connections 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0efd40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0ef800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 --2- 172.21.15.19:0/2304717887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 0x56097b0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 -- 172.21.15.19:0/2304717887 >> 172.21.15.19:0/2304717887 conn(0x56097b0c4d10 msgr2=0x56097b0c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 -- 172.21.15.19:0/2304717887 shutdown_connections 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.431+0000 7f6b71726740 1 -- 172.21.15.19:0/2304717887 wait complete. 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 -- start start 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 Processor -- start 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 0x56097b0dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b681aa9a0 con 0x56097b0d7ba0 2024-09-11T00:03:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b681abe10 con 0x56097b0c6ee0 2024-09-11T00:03:22.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b681ab070 con 0x56097b0c7800 2024-09-11T00:03:22.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b71726740 10 client.0 _ll_register_callbacks cb 0x7f6b58004350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:22.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.432+0000 7f6b6c8ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6d8ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0e02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43642/0 (socket says 172.21.15.19:43642) 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 -- 172.21.15.19:0/4288131153 learned_addr learned my addr 172.21.15.19:0/4288131153 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 -- 172.21.15.19:0/4288131153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 msgr2=0x56097b0dfd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 0x56097b0dfd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 -- 172.21.15.19:0/4288131153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 msgr2=0x56097b0d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0d4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 -- 172.21.15.19:0/4288131153 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56097b0d4fe0 con 0x56097b0c7800 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b6c8ec640 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0e02c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b58004320 tx=0x7f6b580052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7043dae8aca3fc1b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.433+0000 7f6b50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b50ff9640 1 -- 172.21.15.19:0/4288131153 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58028070 con 0x56097b0c7800 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b600049e0 con 0x56097b0c7800 2024-09-11T00:03:22.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b50ff9640 1 -- 172.21.15.19:0/4288131153 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f6b58011440 con 0x56097b0c7800 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b50ff9640 1 -- 172.21.15.19:0/4288131153 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b580117e0 con 0x56097b0c7800 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 10 client.25204 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56097b1598f0 con 0x56097b0c7800 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b50ff9640 1 -- 172.21.15.19:0/4288131153 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b58032070 con 0x56097b0c7800 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b50ff9640 1 -- 172.21.15.19:0/4288131153 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b5801b810 con 0x56097b0c7800 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 10 client.25204 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 10 client.25204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 20 client.25204 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b15a090 0x56097b15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 4 client.25204 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.434+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f6b600049e0 con 0x56097b15a090 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.435+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b15a090 0x56097b15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:22.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.435+0000 7f6b6d8ee640 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b15a090 0x56097b15c4b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8cb1fd3fc39e7f server_cookie=d192a7c220402b89 in_seq=0 out_seq=0 2024-09-11T00:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.435+0000 7f6b50ff9640 10 client.25204 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.437+0000 7f6b50ff9640 1 -- 172.21.15.19:0/4288131153 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f6b600049e0 con 0x56097b15a090 2024-09-11T00:03:22.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.437+0000 7f6b50ff9640 10 client.25204 handle_command_reply: tid=0 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.437+0000 7f6b71726740 1 client.25204 shutdown 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 msgr2=0x56097b0e02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0e02c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b58004320 tx=0x7f6b580052f0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 shutdown_connections 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56097b15a090 0x56097b15c4b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56097b0d7ba0 0x56097b0d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56097b0c7800 0x56097b0e02c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 --2- 172.21.15.19:0/4288131153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56097b0c6ee0 0x56097b0dfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 >> 172.21.15.19:0/4288131153 conn(0x56097b0c4d10 msgr2=0x56097b0c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b50ff9640 0 client.25204 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 shutdown_connections 2024-09-11T00:03:22.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 1 -- 172.21.15.19:0/4288131153 wait complete. 2024-09-11T00:03:22.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.438+0000 7f6b71726740 20 client.25204 trim_cache size 0 max 16384 2024-09-11T00:03:22.441 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:03:22.441 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:03:22.441 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "74f81914-42a9-47dd-927f-09a7b533e2da", 2024-09-11T00:03:22.441 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:03:22.441 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:03:22.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b540b54e0 msgr2=0x7f6b540b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b540b54e0 0x7f6b540b79a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6b64003fd0 tx=0x7f6b6410a650 comp rx=0 tx=0).stop 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b68103ca0 msgr2=0x7f6b68199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b68103ca0 0x7f6b68199280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b64005940 tx=0x7f6b640042f0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 shutdown_connections 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6b540b54e0 0x7f6b540b79a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b6810d100 0x7f6b6819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b681045c0 0x7f6b681997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 --2- 172.21.15.19:0/1737412322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b68103ca0 0x7f6b68199280 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 >> 172.21.15.19:0/1737412322 conn(0x7f6b680fd700 msgr2=0x7f6b680fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 shutdown_connections 2024-09-11T00:03:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:22.439+0000 7f6b6f351640 1 -- 172.21.15.19:0/1737412322 wait complete. 2024-09-11T00:03:23.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:03:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:23.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:23 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:03:23.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:23 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:03:23.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:23 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:03:23.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:23 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:03:23.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:23 smithi019 ceph-mon[30859]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-11T00:03:23.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:23 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:03:23.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:23 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:03:23.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:23 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:03:23.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:23 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:03:23.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:23 smithi135 ceph-mon[35432]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-11T00:03:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:23 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:03:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:23 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:03:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:23 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:03:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:23 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:03:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:23 smithi131 ceph-mon[35491]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 -- 172.21.15.19:0/3064683986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70103b40 msgr2=0x7feb70103f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 --2- 172.21.15.19:0/3064683986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70103b40 0x7feb70103f20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feb60009900 tx=0x7feb6002a410 comp rx=0 tx=0).stop 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 -- 172.21.15.19:0/3064683986 shutdown_connections 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 --2- 172.21.15.19:0/3064683986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb7010d0f0 0x7feb7010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 --2- 172.21.15.19:0/3064683986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb70104540 0x7feb7010cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 --2- 172.21.15.19:0/3064683986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70103b40 0x7feb70103f20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 -- 172.21.15.19:0/3064683986 >> 172.21.15.19:0/3064683986 conn(0x7feb700fd730 msgr2=0x7feb700ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 -- 172.21.15.19:0/3064683986 shutdown_connections 2024-09-11T00:03:24.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.213+0000 7feb74afc640 1 -- 172.21.15.19:0/3064683986 wait complete. 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 Processor -- start 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 -- start start 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb70103b40 0x7feb70199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70104540 0x7feb701997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb7010d0f0 0x7feb7019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb70112dc0 con 0x7feb70104540 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb70112c40 con 0x7feb70103b40 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.215+0000 7feb74afc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb70112f40 con 0x7feb7010d0f0 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb7010d0f0 0x7feb7019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb70103b40 0x7feb70199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb7010d0f0 0x7feb7019eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43664/0 (socket says 172.21.15.19:43664) 2024-09-11T00:03:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6ed9d640 1 -- 172.21.15.19:0/2386789520 learned_addr learned my addr 172.21.15.19:0/2386789520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70104540 0x7feb701997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6e59c640 1 -- 172.21.15.19:0/2386789520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb7010d0f0 msgr2=0x7feb7019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6e59c640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb7010d0f0 0x7feb7019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6e59c640 1 -- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70104540 msgr2=0x7feb701997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6e59c640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70104540 0x7feb701997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6e59c640 1 -- 172.21.15.19:0/2386789520 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7019f340 con 0x7feb70103b40 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70104540 0x7feb701997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:24.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.216+0000 7feb6e59c640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb70103b40 0x7feb70199290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb6002aa00 tx=0x7feb60003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.217+0000 7feb5f7fe640 1 -- 172.21.15.19:0/2386789520 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6003f070 con 0x7feb70103b40 2024-09-11T00:03:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.217+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7019f5d0 con 0x7feb70103b40 2024-09-11T00:03:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.217+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb701a5cf0 con 0x7feb70103b40 2024-09-11T00:03:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.217+0000 7feb5f7fe640 1 -- 172.21.15.19:0/2386789520 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb60031d60 con 0x7feb70103b40 2024-09-11T00:03:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.217+0000 7feb5f7fe640 1 -- 172.21.15.19:0/2386789520 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60035030 con 0x7feb70103b40 2024-09-11T00:03:24.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.219+0000 7feb76ed1740 1 Processor -- start 2024-09-11T00:03:24.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.220+0000 7feb76ed1740 1 -- start start 2024-09-11T00:03:24.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.220+0000 7feb5f7fe640 1 -- 172.21.15.19:0/2386789520 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) ==== 153432+0+0 (secure 0 0 0) 0x7feb6003b460 con 0x7feb70103b40 2024-09-11T00:03:24.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.220+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec50a0 0x558888ec5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ed1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ed1950 0x558888ed3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb76ed1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558888e3be50 con 0x558888ec59c0 2024-09-11T00:03:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb76ed1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558888e2b280 con 0x558888ed1950 2024-09-11T00:03:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb76ed1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558888e2f090 con 0x558888ec50a0 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ed1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb6ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec50a0 0x558888ec5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb6ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec50a0 0x558888ec5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43674/0 (socket says 172.21.15.19:43674) 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb6ed9d640 1 -- 172.21.15.19:0/2185500276 learned_addr learned my addr 172.21.15.19:0/2185500276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.221+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ed1950 0x558888ed3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.222+0000 7feb6e59c640 1 -- 172.21.15.19:0/2185500276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec50a0 msgr2=0x558888ec5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.222+0000 7feb6e59c640 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec50a0 0x558888ec5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.222+0000 7feb6e59c640 1 -- 172.21.15.19:0/2185500276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ed1950 msgr2=0x558888ed3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.222+0000 7feb6e59c640 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ed1950 0x558888ed3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.222+0000 7feb6e59c640 1 -- 172.21.15.19:0/2185500276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558888b89650 con 0x558888ec59c0 2024-09-11T00:03:24.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.222+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ed1950 0x558888ed3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.222+0000 7feb6e59c640 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ed1410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb60104270 tx=0x7feb6010ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa562d71f62e4bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.223+0000 7feb5f7fe640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb580b9970 0x7feb580bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.223+0000 7feb5cff9640 1 -- 172.21.15.19:0/2185500276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60116020 con 0x558888ec59c0 2024-09-11T00:03:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.223+0000 7feb5cff9640 1 -- 172.21.15.19:0/2185500276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb6010fd70 con 0x558888ec59c0 2024-09-11T00:03:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.223+0000 7feb5cff9640 1 -- 172.21.15.19:0/2185500276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60112de0 con 0x558888ec59c0 2024-09-11T00:03:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.223+0000 7feb6ed9d640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb580b9970 0x7feb580bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.223+0000 7feb5f7fe640 1 -- 172.21.15.19:0/2386789520 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7feb60106b80 con 0x7feb70103b40 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 -- 172.21.15.19:0/2185500276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 msgr2=0x558888ed1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ed1410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb60104270 tx=0x7feb6010ad40 comp rx=0 tx=0).stop 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb6ed9d640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb580b9970 0x7feb580bbe30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb68009fd0 tx=0x7feb68009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 -- 172.21.15.19:0/2185500276 shutdown_connections 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ed1950 0x558888ed3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ed1410 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 --2- 172.21.15.19:0/2185500276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec50a0 0x558888ec5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 -- 172.21.15.19:0/2185500276 >> 172.21.15.19:0/2185500276 conn(0x558888ec2ed0 msgr2=0x558888ec4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 -- 172.21.15.19:0/2185500276 shutdown_connections 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.224+0000 7feb76ed1740 1 -- 172.21.15.19:0/2185500276 wait complete. 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.225+0000 7feb76ed1740 1 -- start start 2024-09-11T00:03:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.225+0000 7feb76ed1740 1 Processor -- start 2024-09-11T00:03:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.225+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888ed1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.225+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ece790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.225+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.225+0000 7feb76ed1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558888c8c700 con 0x558888ec59c0 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.225+0000 7feb76ed1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558888dc6110 con 0x558888ec50a0 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb76ed1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558888ed4390 con 0x558888ed1950 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ece790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ece790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57564/0 (socket says 172.21.15.19:57564) 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 -- 172.21.15.19:0/1343980165 learned_addr learned my addr 172.21.15.19:0/1343980165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6e59c640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888ed1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb76ed1740 10 client.0 _ll_register_callbacks cb 0x558888ddf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6ed9d640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 -- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 msgr2=0x558888ecef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 -- 172.21.15.19:0/1343980165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 msgr2=0x558888ed1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888ed1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 -- 172.21.15.19:0/1343980165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558888df3c40 con 0x558888ec59c0 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6ed9d640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ece790 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feb64010770 tx=0x7feb64010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cd01ded539167b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.226+0000 7feb55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.227+0000 7feb55ffb640 1 -- 172.21.15.19:0/1343980165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6400ccc0 con 0x558888ec59c0 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.227+0000 7feb55ffb640 1 -- 172.21.15.19:0/1343980165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7feb6401c480 con 0x558888ec59c0 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.227+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb6010fd70 con 0x558888ec59c0 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.227+0000 7feb55ffb640 1 -- 172.21.15.19:0/1343980165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feb64010e80 con 0x558888ec59c0 2024-09-11T00:03:24.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.227+0000 7feb76ed1740 10 client.15594 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.227+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558888edfdb0 con 0x558888ec59c0 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.227+0000 7feb55ffb640 1 -- 172.21.15.19:0/1343980165 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb6010fd70 con 0x558888ec59c0 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb55ffb640 1 -- 172.21.15.19:0/1343980165 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feb640116c0 con 0x558888ec59c0 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb76ed1740 10 client.15594 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb76ed1740 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb76ed1740 20 client.15594 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888ee3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb76ed1740 4 client.15594 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558888e3dda0 con 0x558888ee1210 2024-09-11T00:03:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.228+0000 7feb6e59c640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888ee3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.229+0000 7feb6e59c640 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888ee3630 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfa88a33c573f487 server_cookie=5ba5a42ec0e6e731 in_seq=0 out_seq=0 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.229+0000 7feb55ffb640 10 client.15594 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.229+0000 7feb55ffb640 1 -- 172.21.15.19:0/1343980165 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558888e3dda0 con 0x558888ee1210 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.229+0000 7feb55ffb640 10 client.15594 handle_command_reply: tid=0 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.229+0000 7feb76ed1740 1 client.15594 shutdown 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 msgr2=0x558888ece790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ece790 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feb64010770 tx=0x7feb64010c30 comp rx=0 tx=0).stop 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 shutdown_connections 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888ee3630 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec59c0 0x558888ece790 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb55ffb640 0 client.15594 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1343980165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888ed1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 >> 172.21.15.19:0/1343980165 conn(0x558888ec2ed0 msgr2=0x558888ec8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 shutdown_connections 2024-09-11T00:03:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.230+0000 7feb76ed1740 1 -- 172.21.15.19:0/1343980165 wait complete. 2024-09-11T00:03:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.231+0000 7feb76ed1740 20 client.15594 trim_cache size 0 max 16384 2024-09-11T00:03:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 Processor -- start 2024-09-11T00:03:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 -- start start 2024-09-11T00:03:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888edcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec59c0 0x558888ed2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ed1950 0x558888ed3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb701aeca0 con 0x558888ed1950 2024-09-11T00:03:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb701ac570 con 0x558888ec50a0 2024-09-11T00:03:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.266+0000 7feb76ed1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb701aa3c0 con 0x558888ec59c0 2024-09-11T00:03:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ed1950 0x558888ed3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec59c0 0x558888ed2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ed1950 0x558888ed3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57578/0 (socket says 172.21.15.19:57578) 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6ed9d640 1 -- 172.21.15.19:0/4226714912 learned_addr learned my addr 172.21.15.19:0/4226714912 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6e59c640 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888edcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6dd9b640 1 -- 172.21.15.19:0/4226714912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 msgr2=0x558888edcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888edcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6dd9b640 1 -- 172.21.15.19:0/4226714912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ed1950 msgr2=0x558888ed3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ed1950 0x558888ed3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6dd9b640 1 -- 172.21.15.19:0/4226714912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558888ec57f0 con 0x558888ec59c0 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.267+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec59c0 0x558888ed2d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb64011c30 tx=0x7feb64011f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd9ac31d80d3507 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.268+0000 7feb57fff640 1 -- 172.21.15.19:0/4226714912 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6402c070 con 0x558888ec59c0 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.268+0000 7feb57fff640 1 -- 172.21.15.19:0/4226714912 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb6400ccc0 con 0x558888ec59c0 2024-09-11T00:03:24.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.268+0000 7feb57fff640 1 -- 172.21.15.19:0/4226714912 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb64005390 con 0x558888ec59c0 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.268+0000 7feb76ed1740 1 -- 172.21.15.19:0/4226714912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec59c0 msgr2=0x558888ed2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec59c0 0x558888ed2d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb64011c30 tx=0x7feb64011f40 comp rx=0 tx=0).stop 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 -- 172.21.15.19:0/4226714912 shutdown_connections 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ed1950 0x558888ed3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ec59c0 0x558888ed2d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 --2- 172.21.15.19:0/4226714912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec50a0 0x558888edcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 -- 172.21.15.19:0/4226714912 >> 172.21.15.19:0/4226714912 conn(0x558888ec2ed0 msgr2=0x558888edc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 -- 172.21.15.19:0/4226714912 shutdown_connections 2024-09-11T00:03:24.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 -- 172.21.15.19:0/4226714912 wait complete. 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 -- start start 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.269+0000 7feb76ed1740 1 Processor -- start 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec50a0 0x558888ed95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec59c0 0x558888ed9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb76ed1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb76ed1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb701aaa30 con 0x558888ec50a0 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb76ed1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb701abea0 con 0x558888ec59c0 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb76ed1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb701ab100 con 0x558888ed1950 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec50a0 0x558888ed95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb76ed1740 10 client.0 _ll_register_callbacks cb 0x7feb6400e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec50a0 0x558888ed95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57594/0 (socket says 172.21.15.19:57594) 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6e59c640 1 -- 172.21.15.19:0/1377601207 learned_addr learned my addr 172.21.15.19:0/1377601207 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:24.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec59c0 0x558888ed9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6ed9d640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6dd9b640 1 -- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 msgr2=0x558888ecae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6dd9b640 1 -- 172.21.15.19:0/1377601207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec50a0 msgr2=0x558888ed95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec50a0 0x558888ed95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.270+0000 7feb6dd9b640 1 -- 172.21.15.19:0/1377601207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558888eda370 con 0x558888ec59c0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.271+0000 7feb6e59c640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec50a0 0x558888ed95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.271+0000 7feb6dd9b640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec59c0 0x558888ed9b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x558888eb49d0 tx=0x7feb640116f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62bfe8093f375b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.271+0000 7feb55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.271+0000 7feb55ffb640 1 -- 172.21.15.19:0/1377601207 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6402c040 con 0x558888ec59c0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.271+0000 7feb55ffb640 1 -- 172.21.15.19:0/1377601207 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7feb64005240 con 0x558888ec59c0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.271+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb6400ccc0 con 0x558888ec59c0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.271+0000 7feb55ffb640 1 -- 172.21.15.19:0/1377601207 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feb64041050 con 0x558888ec59c0 2024-09-11T00:03:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.272+0000 7feb76ed1740 10 client.25094 fetch_fsmap learned FSMap version 25 2024-09-11T00:03:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.272+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558888f4f740 con 0x558888ec59c0 2024-09-11T00:03:24.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.272+0000 7feb55ffb640 1 -- 172.21.15.19:0/1377601207 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb6400ce70 con 0x558888ec59c0 2024-09-11T00:03:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb55ffb640 1 -- 172.21.15.19:0/1377601207 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feb64038070 con 0x558888ec59c0 2024-09-11T00:03:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb76ed1740 10 client.25094 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T00:03:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb76ed1740 10 client.25094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:24.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb76ed1740 20 client.25094 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888f51d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb76ed1740 4 client.25094 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7feb6400ccc0 con 0x558888ee1210 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb6e59c640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888f51d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb55ffb640 10 client.25094 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.273+0000 7feb6e59c640 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888f51d50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0af62a2b22f632 server_cookie=fdffd739571a79cc in_seq=0 out_seq=0 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb55ffb640 1 -- 172.21.15.19:0/1377601207 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x7feb6400ccc0 con 0x558888ee1210 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb55ffb640 10 client.25094 handle_command_reply: tid=0 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 client.25094 shutdown 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec59c0 msgr2=0x558888ed9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec59c0 0x558888ed9b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x558888eb49d0 tx=0x7feb640116f0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 shutdown_connections 2024-09-11T00:03:24.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558888ed1950 0x558888ecae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558888ec59c0 0x558888ed9b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558888ee1210 0x558888f51d50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 --2- 172.21.15.19:0/1377601207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558888ec50a0 0x558888ed95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 >> 172.21.15.19:0/1377601207 conn(0x558888ec2ed0 msgr2=0x558888edcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb55ffb640 0 client.25094 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 shutdown_connections 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 1 -- 172.21.15.19:0/1377601207 wait complete. 2024-09-11T00:03:24.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.274+0000 7feb76ed1740 20 client.25094 trim_cache size 0 max 16384 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "74f81914-42a9-47dd-927f-09a7b533e2da", 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:03:24.280 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:03:24.281 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:03:24.282 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:03:24.282 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:03:24.282 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:03:24.282 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb580b9970 msgr2=0x7feb580bbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb580b9970 0x7feb580bbe30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb68009fd0 tx=0x7feb68009680 comp rx=0 tx=0).stop 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb70103b40 msgr2=0x7feb70199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb70103b40 0x7feb70199290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb6002aa00 tx=0x7feb60003cd0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 shutdown_connections 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb7010d0f0 0x7feb7019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feb580b9970 0x7feb580bbe30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb70104540 0x7feb701997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 --2- 172.21.15.19:0/2386789520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb70103b40 0x7feb70199290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 >> 172.21.15.19:0/2386789520 conn(0x7feb700fd730 msgr2=0x7feb700fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 shutdown_connections 2024-09-11T00:03:24.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:24.275+0000 7feb74afc640 1 -- 172.21.15.19:0/2386789520 wait complete. 2024-09-11T00:03:25.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:25 smithi135 ceph-mon[35432]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T00:03:25.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:25 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:03:26.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:25 smithi019 ceph-mon[30859]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T00:03:26.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:25 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:03:26.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:25 smithi131 ceph-mon[35491]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T00:03:26.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:25 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:03:26.467 INFO:tasks.cephfs.filesystem:scrub status for tag:74f81914-42a9-47dd-927f-09a7b533e2da - {'path': '/', 'tag': '74f81914-42a9-47dd-927f-09a7b533e2da', 'options': 'recursive,force'} 2024-09-11T00:03:27.642 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:27 smithi019 ceph-mon[30859]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-11T00:03:27.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:27 smithi135 ceph-mon[35432]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-11T00:03:28.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:27 smithi131 ceph-mon[35491]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-11T00:03:29.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:29 smithi135 ceph-mon[35432]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-11T00:03:30.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:29 smithi019 ceph-mon[30859]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-11T00:03:30.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:29 smithi131 ceph-mon[35491]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-11T00:03:31.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:31 smithi135 ceph-mon[35432]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:03:32.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:31 smithi019 ceph-mon[30859]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:03:32.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:31 smithi131 ceph-mon[35491]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:03:32.492 INFO:tasks.workunit.client.0.smithi019.stderr:Updating files: 95% (11523/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T00:03:33.407 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:33.408 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:03:33.412 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T00:03:33.448 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T00:03:33.450 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:03:33.451 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T00:03:33.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:33 smithi135 ceph-mon[35432]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:03:34.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:33 smithi019 ceph-mon[30859]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:03:34.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:33 smithi131 ceph-mon[35491]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:03:34.113 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T00:03:34.180 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T00:03:34.221 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:03:34.223 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:03:34.223 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T00:03:34.263 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:03:34.266 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-11T00:03:34.266 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T00:03:34.323 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-11T00:03:34.324 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-11T00:03:34.324 DEBUG:teuthology.orchestra.run.smithi019:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-11T00:03:34.386 INFO:tasks.workunit.client.0.smithi019.stdout:getting blogbench 2024-09-11T00:03:34.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'getting blogbench' 2024-09-11T00:03:34.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-11T00:03:34.404 INFO:tasks.workunit.client.0.smithi019.stderr:--2024-09-11 00:03:34-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-11T00:03:34.405 INFO:tasks.workunit.client.0.smithi019.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-11T00:03:34.426 INFO:tasks.workunit.client.0.smithi019.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-11T00:03:34.447 INFO:tasks.workunit.client.0.smithi019.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-11T00:03:34.447 INFO:tasks.workunit.client.0.smithi019.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-11T00:03:34.448 INFO:tasks.workunit.client.0.smithi019.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-11T00:03:34.451 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:34.488 INFO:tasks.workunit.client.0.smithi019.stderr: 0K .......... .......... .......... .......... .......... 49% 1.25M 0s 2024-09-11T00:03:34.508 INFO:tasks.workunit.client.0.smithi019.stderr: 50K .......... .......... .......... .......... .......... 99% 2.34M 0s 2024-09-11T00:03:34.509 INFO:tasks.workunit.client.0.smithi019.stderr: 100K 100% 1.74T=0.06s 2024-09-11T00:03:34.509 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:34.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-11 00:03:34 (1.65 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-11T00:03:34.509 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-11T00:03:34.509 INFO:tasks.workunit.client.0.smithi019.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-11T00:03:34.537 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/ 2024-09-11T00:03:34.538 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/m4/ 2024-09-11T00:03:34.540 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-11T00:03:34.541 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/man/ 2024-09-11T00:03:34.542 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/man/blogbench.8 2024-09-11T00:03:34.543 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/man/Makefile.am 2024-09-11T00:03:34.545 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/man/Makefile.in 2024-09-11T00:03:34.546 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/ 2024-09-11T00:03:34.548 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-11T00:03:34.549 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-11T00:03:34.550 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/blogbench.c 2024-09-11T00:03:34.552 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/blogbench.h 2024-09-11T00:03:34.553 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-11T00:03:34.555 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-11T00:03:34.556 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-11T00:03:34.558 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-11T00:03:34.559 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-11T00:03:34.561 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/Makefile.am 2024-09-11T00:03:34.562 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/Makefile.in 2024-09-11T00:03:34.563 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/process.c 2024-09-11T00:03:34.565 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/globals.h 2024-09-11T00:03:34.566 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/commenter.c 2024-09-11T00:03:34.567 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/rewriter.c 2024-09-11T00:03:34.567 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/reader.c 2024-09-11T00:03:34.568 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/writer.c 2024-09-11T00:03:34.569 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/src/helpers.c 2024-09-11T00:03:34.570 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/NEWS 2024-09-11T00:03:34.571 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/compile 2024-09-11T00:03:34.572 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/depcomp 2024-09-11T00:03:34.573 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/aclocal.m4 2024-09-11T00:03:34.574 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/README 2024-09-11T00:03:34.575 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/configure 2024-09-11T00:03:34.578 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/configure.ac 2024-09-11T00:03:34.579 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/config.guess 2024-09-11T00:03:34.581 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/install-sh 2024-09-11T00:03:34.582 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/config.sub 2024-09-11T00:03:34.583 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/missing 2024-09-11T00:03:34.584 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/mkinstalldirs 2024-09-11T00:03:34.585 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/Makefile.am 2024-09-11T00:03:34.586 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/Makefile.in 2024-09-11T00:03:34.588 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/config.h.in 2024-09-11T00:03:34.589 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/AUTHORS 2024-09-11T00:03:34.590 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/INSTALL 2024-09-11T00:03:34.592 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/ChangeLog 2024-09-11T00:03:34.593 INFO:tasks.workunit.client.0.smithi019.stdout:blogbench-1.0/COPYING 2024-09-11T00:03:34.594 INFO:tasks.workunit.client.0.smithi019.stderr:+ cd blogbench-1.0/ 2024-09-11T00:03:34.595 INFO:tasks.workunit.client.0.smithi019.stdout:making blogbench 2024-09-11T00:03:34.595 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'making blogbench' 2024-09-11T00:03:34.595 INFO:tasks.workunit.client.0.smithi019.stderr:+ ./configure 2024-09-11T00:03:34.694 INFO:tasks.workunit.client.0.smithi019.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T00:03:35.704 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether build environment is sane... yes 2024-09-11T00:03:35.716 INFO:tasks.workunit.client.0.smithi019.stdout:checking for gawk... gawk 2024-09-11T00:03:35.733 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T00:03:35.760 INFO:tasks.workunit.client.0.smithi019.stdout:checking for gcc... gcc 2024-09-11T00:03:35.814 INFO:tasks.workunit.client.0.smithi019.stdout:checking for C compiler default output file name... a.out 2024-09-11T00:03:35.815 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether the C compiler works... yes 2024-09-11T00:03:35.818 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether we are cross compiling... no 2024-09-11T00:03:35.857 INFO:tasks.workunit.client.0.smithi019.stdout:checking for suffix of executables... 2024-09-11T00:03:35.896 INFO:tasks.workunit.client.0.smithi019.stdout:checking for suffix of object files... o 2024-09-11T00:03:35.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:35 smithi135 ceph-mon[35432]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T00:03:35.929 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T00:03:35.963 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether gcc accepts -g... yes 2024-09-11T00:03:36.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:35 smithi019 ceph-mon[30859]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T00:03:36.028 INFO:tasks.workunit.client.0.smithi019.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-11T00:03:36.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:35 smithi131 ceph-mon[35491]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T00:03:36.072 INFO:tasks.workunit.client.0.smithi019.stdout:checking for style of include used by make... GNU 2024-09-11T00:03:36.167 INFO:tasks.workunit.client.0.smithi019.stdout:checking dependency style of gcc... gcc3 2024-09-11T00:03:36.167 INFO:tasks.workunit.client.0.smithi019.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T00:03:36.221 INFO:tasks.workunit.client.0.smithi019.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T00:03:36.263 INFO:tasks.workunit.client.0.smithi019.stdout:checking for egrep... grep -E 2024-09-11T00:03:36.272 INFO:tasks.workunit.client.0.smithi019.stdout:checking for AIX... no 2024-09-11T00:03:36.414 INFO:tasks.workunit.client.0.smithi019.stdout:checking for library containing strerror... none required 2024-09-11T00:03:36.564 INFO:tasks.workunit.client.0.smithi019.stdout:checking for ANSI C header files... yes 2024-09-11T00:03:36.610 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T00:03:36.656 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sys/types.h... yes 2024-09-11T00:03:36.710 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sys/stat.h... yes 2024-09-11T00:03:36.763 INFO:tasks.workunit.client.0.smithi019.stdout:checking for stdlib.h... yes 2024-09-11T00:03:36.816 INFO:tasks.workunit.client.0.smithi019.stdout:checking for string.h... yes 2024-09-11T00:03:36.870 INFO:tasks.workunit.client.0.smithi019.stdout:checking for memory.h... yes 2024-09-11T00:03:36.924 INFO:tasks.workunit.client.0.smithi019.stdout:checking for strings.h... yes 2024-09-11T00:03:36.975 INFO:tasks.workunit.client.0.smithi019.stdout:checking for inttypes.h... yes 2024-09-11T00:03:37.024 INFO:tasks.workunit.client.0.smithi019.stdout:checking for stdint.h... yes 2024-09-11T00:03:37.075 INFO:tasks.workunit.client.0.smithi019.stdout:checking for unistd.h... yes 2024-09-11T00:03:37.086 INFO:tasks.workunit.client.0.smithi019.stdout:checking for memory.h... (cached) yes 2024-09-11T00:03:37.091 INFO:tasks.workunit.client.0.smithi019.stdout:checking for strings.h... (cached) yes 2024-09-11T00:03:37.096 INFO:tasks.workunit.client.0.smithi019.stdout:checking for unistd.h... (cached) yes 2024-09-11T00:03:37.152 INFO:tasks.workunit.client.0.smithi019.stdout:checking locale.h usability... yes 2024-09-11T00:03:37.172 INFO:tasks.workunit.client.0.smithi019.stdout:checking locale.h presence... yes 2024-09-11T00:03:37.172 INFO:tasks.workunit.client.0.smithi019.stdout:checking for locale.h... yes 2024-09-11T00:03:37.186 INFO:tasks.workunit.client.0.smithi019.stdout:checking for stdlib.h... (cached) yes 2024-09-11T00:03:37.191 INFO:tasks.workunit.client.0.smithi019.stdout:checking for string.h... (cached) yes 2024-09-11T00:03:37.240 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/socket.h usability... yes 2024-09-11T00:03:37.262 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/socket.h presence... yes 2024-09-11T00:03:37.263 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sys/socket.h... yes 2024-09-11T00:03:37.317 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/time.h usability... yes 2024-09-11T00:03:37.336 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/time.h presence... yes 2024-09-11T00:03:37.337 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sys/time.h... yes 2024-09-11T00:03:37.391 INFO:tasks.workunit.client.0.smithi019.stdout:checking fcntl.h usability... yes 2024-09-11T00:03:37.412 INFO:tasks.workunit.client.0.smithi019.stdout:checking fcntl.h presence... yes 2024-09-11T00:03:37.413 INFO:tasks.workunit.client.0.smithi019.stdout:checking for fcntl.h... yes 2024-09-11T00:03:37.466 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/fcntl.h usability... yes 2024-09-11T00:03:37.487 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/fcntl.h presence... yes 2024-09-11T00:03:37.488 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sys/fcntl.h... yes 2024-09-11T00:03:37.556 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/param.h usability... yes 2024-09-11T00:03:37.579 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/param.h presence... yes 2024-09-11T00:03:37.580 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sys/param.h... yes 2024-09-11T00:03:37.630 INFO:tasks.workunit.client.0.smithi019.stdout:checking ioctl.h usability... no 2024-09-11T00:03:37.651 INFO:tasks.workunit.client.0.smithi019.stdout:checking ioctl.h presence... no 2024-09-11T00:03:37.651 INFO:tasks.workunit.client.0.smithi019.stdout:checking for ioctl.h... no 2024-09-11T00:03:37.709 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/ioctl.h usability... yes 2024-09-11T00:03:37.733 INFO:tasks.workunit.client.0.smithi019.stdout:checking sys/ioctl.h presence... yes 2024-09-11T00:03:37.733 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sys/ioctl.h... yes 2024-09-11T00:03:37.784 INFO:tasks.workunit.client.0.smithi019.stdout:checking return type of signal handlers... void 2024-09-11T00:03:37.829 INFO:tasks.workunit.client.0.smithi019.stdout:checking for size_t... yes 2024-09-11T00:03:37.868 INFO:tasks.workunit.client.0.smithi019.stdout:checking for dev_t... yes 2024-09-11T00:03:37.911 INFO:tasks.workunit.client.0.smithi019.stdout:checking for short... yes 2024-09-11T00:03:37.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:37 smithi135 ceph-mon[35432]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:03:37.988 INFO:tasks.workunit.client.0.smithi019.stdout:checking size of short... 2 2024-09-11T00:03:38.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:37 smithi019 ceph-mon[30859]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:03:38.034 INFO:tasks.workunit.client.0.smithi019.stdout:checking for int... yes 2024-09-11T00:03:38.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:37 smithi131 ceph-mon[35491]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:03:38.107 INFO:tasks.workunit.client.0.smithi019.stdout:checking size of int... 4 2024-09-11T00:03:38.153 INFO:tasks.workunit.client.0.smithi019.stdout:checking for long... yes 2024-09-11T00:03:38.222 INFO:tasks.workunit.client.0.smithi019.stdout:checking size of long... 8 2024-09-11T00:03:38.267 INFO:tasks.workunit.client.0.smithi019.stdout:checking for long long... yes 2024-09-11T00:03:38.335 INFO:tasks.workunit.client.0.smithi019.stdout:checking size of long long... 8 2024-09-11T00:03:38.378 INFO:tasks.workunit.client.0.smithi019.stdout:checking for ssize_t... yes 2024-09-11T00:03:38.418 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sig_atomic_t... yes 2024-09-11T00:03:38.464 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether gcc needs -traditional... no 2024-09-11T00:03:38.500 INFO:tasks.workunit.client.0.smithi019.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T00:03:38.523 INFO:tasks.workunit.client.0.smithi019.stdout:checking for inline... inline 2024-09-11T00:03:38.582 INFO:tasks.workunit.client.0.smithi019.stdout:checking for working alloca.h... yes 2024-09-11T00:03:38.629 INFO:tasks.workunit.client.0.smithi019.stdout:checking for alloca... yes 2024-09-11T00:03:38.696 INFO:tasks.workunit.client.0.smithi019.stdout:checking for working memcmp... yes 2024-09-11T00:03:38.752 INFO:tasks.workunit.client.0.smithi019.stdout:checking for strftime... yes 2024-09-11T00:03:38.824 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-11T00:03:38.883 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether stat accepts an empty string... no 2024-09-11T00:03:38.939 INFO:tasks.workunit.client.0.smithi019.stdout:checking for vprintf... yes 2024-09-11T00:03:38.995 INFO:tasks.workunit.client.0.smithi019.stdout:checking for _doprnt... no 2024-09-11T00:03:39.017 INFO:tasks.workunit.client.0.smithi019.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T00:03:39.030 INFO:tasks.workunit.client.0.smithi019.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T00:03:39.079 INFO:tasks.workunit.client.0.smithi019.stdout:checking for the pthreads library -lpthreads... no 2024-09-11T00:03:39.133 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether pthreads work without any flags... yes 2024-09-11T00:03:39.179 INFO:tasks.workunit.client.0.smithi019.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-11T00:03:39.179 INFO:tasks.workunit.client.0.smithi019.stdout:checking if more special flags are required for pthreads... no 2024-09-11T00:03:39.179 INFO:tasks.workunit.client.0.smithi019.stdout:checking for cc_r... gcc 2024-09-11T00:03:39.252 INFO:tasks.workunit.client.0.smithi019.stdout:checking for setrlimit... yes 2024-09-11T00:03:39.313 INFO:tasks.workunit.client.0.smithi019.stdout:checking for setproctitle... no 2024-09-11T00:03:39.371 INFO:tasks.workunit.client.0.smithi019.stdout:checking for getopt_long... yes 2024-09-11T00:03:39.433 INFO:tasks.workunit.client.0.smithi019.stdout:checking for strtoull... yes 2024-09-11T00:03:39.495 INFO:tasks.workunit.client.0.smithi019.stdout:checking for strtoq... yes 2024-09-11T00:03:39.607 INFO:tasks.workunit.client.0.smithi019.stdout:checking for snprintf... yes 2024-09-11T00:03:39.675 INFO:tasks.workunit.client.0.smithi019.stdout:checking for vsnprintf... yes 2024-09-11T00:03:39.737 INFO:tasks.workunit.client.0.smithi019.stdout:checking for vfprintf... yes 2024-09-11T00:03:39.799 INFO:tasks.workunit.client.0.smithi019.stdout:checking for gethostname... yes 2024-09-11T00:03:39.860 INFO:tasks.workunit.client.0.smithi019.stdout:checking for setlocale... yes 2024-09-11T00:03:39.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:39 smithi135 ceph-mon[35432]: pgmap v359: 97 pgs: 97 active+clean; 2.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 77 KiB/s wr, 10 op/s 2024-09-11T00:03:39.925 INFO:tasks.workunit.client.0.smithi019.stdout:checking for sync... yes 2024-09-11T00:03:39.993 INFO:tasks.workunit.client.0.smithi019.stdout:checking whether snprintf is C99 conformant... done 2024-09-11T00:03:40.005 INFO:tasks.workunit.client.0.smithi019.stdout:configure: creating ./config.status 2024-09-11T00:03:40.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:39 smithi019 ceph-mon[30859]: pgmap v359: 97 pgs: 97 active+clean; 2.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 77 KiB/s wr, 10 op/s 2024-09-11T00:03:40.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:39 smithi131 ceph-mon[35491]: pgmap v359: 97 pgs: 97 active+clean; 2.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 77 KiB/s wr, 10 op/s 2024-09-11T00:03:40.183 INFO:tasks.workunit.client.0.smithi019.stdout:config.status: creating Makefile 2024-09-11T00:03:40.201 INFO:tasks.workunit.client.0.smithi019.stdout:config.status: creating src/Makefile 2024-09-11T00:03:40.222 INFO:tasks.workunit.client.0.smithi019.stdout:config.status: creating man/Makefile 2024-09-11T00:03:40.235 INFO:tasks.workunit.client.0.smithi019.stdout:config.status: creating config.h 2024-09-11T00:03:40.289 INFO:tasks.workunit.client.0.smithi019.stdout:config.status: executing depfiles commands 2024-09-11T00:03:40.448 INFO:tasks.workunit.client.0.smithi019.stderr:+ make 2024-09-11T00:03:40.457 INFO:tasks.workunit.client.0.smithi019.stdout:make all-recursive 2024-09-11T00:03:40.459 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-11T00:03:40.462 INFO:tasks.workunit.client.0.smithi019.stdout:Making all in src 2024-09-11T00:03:40.468 INFO:tasks.workunit.client.0.smithi019.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-11T00:03:40.468 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-11T00:03:40.468 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-11T00:03:40.568 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-11T00:03:40.568 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-11T00:03:40.634 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-11T00:03:40.634 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-11T00:03:40.687 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-11T00:03:40.687 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-11T00:03:40.737 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-11T00:03:40.737 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-11T00:03:40.787 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-11T00:03:40.787 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-11T00:03:40.834 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-11T00:03:40.835 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-11T00:03:40.912 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-11T00:03:40.912 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-11T00:03:40.946 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-11T00:03:40.946 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-11T00:03:40.981 INFO:tasks.workunit.client.0.smithi019.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-11T00:03:40.981 INFO:tasks.workunit.client.0.smithi019.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-11T00:03:41.018 INFO:tasks.workunit.client.0.smithi019.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-11T00:03:41.037 INFO:tasks.workunit.client.0.smithi019.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-11T00:03:41.037 INFO:tasks.workunit.client.0.smithi019.stdout:Making all in man 2024-09-11T00:03:41.041 INFO:tasks.workunit.client.0.smithi019.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-11T00:03:41.041 INFO:tasks.workunit.client.0.smithi019.stdout:make[2]: Nothing to be done for 'all'. 2024-09-11T00:03:41.041 INFO:tasks.workunit.client.0.smithi019.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-11T00:03:41.042 INFO:tasks.workunit.client.0.smithi019.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-11T00:03:41.043 INFO:tasks.workunit.client.0.smithi019.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-11T00:03:41.043 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-11T00:03:41.044 INFO:tasks.workunit.client.0.smithi019.stderr:+ cd src 2024-09-11T00:03:41.044 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir blogtest_in 2024-09-11T00:03:41.046 INFO:tasks.workunit.client.0.smithi019.stdout:running blogbench 2024-09-11T00:03:41.046 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'running blogbench' 2024-09-11T00:03:41.046 INFO:tasks.workunit.client.0.smithi019.stderr:+ ./blogbench -d blogtest_in 2024-09-11T00:03:41.047 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-11T00:03:41.047 INFO:tasks.workunit.client.0.smithi019.stdout:Frequency = 10 secs 2024-09-11T00:03:41.047 INFO:tasks.workunit.client.0.smithi019.stdout:Scratch dir = [blogtest_in] 2024-09-11T00:03:41.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:41 smithi135 ceph-mon[35432]: pgmap v360: 97 pgs: 97 active+clean; 2.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 127 KiB/s wr, 13 op/s 2024-09-11T00:03:42.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:41 smithi019 ceph-mon[30859]: pgmap v360: 97 pgs: 97 active+clean; 2.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 127 KiB/s wr, 13 op/s 2024-09-11T00:03:42.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:41 smithi131 ceph-mon[35491]: pgmap v360: 97 pgs: 97 active+clean; 2.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 127 KiB/s wr, 13 op/s 2024-09-11T00:03:43.100 INFO:tasks.workunit.client.0.smithi019.stdout:Spawning 3 writers... 2024-09-11T00:03:43.100 INFO:tasks.workunit.client.0.smithi019.stdout:Spawning 1 rewriters... 2024-09-11T00:03:43.100 INFO:tasks.workunit.client.0.smithi019.stdout:Spawning 5 commenters... 2024-09-11T00:03:43.100 INFO:tasks.workunit.client.0.smithi019.stdout:Spawning 100 readers... 2024-09-11T00:03:43.102 INFO:tasks.workunit.client.0.smithi019.stdout:Benchmarking for 30 iterations. 2024-09-11T00:03:43.102 INFO:tasks.workunit.client.0.smithi019.stdout:The test will run during 5 minutes. 2024-09-11T00:03:43.102 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-11T00:03:43.102 INFO:tasks.workunit.client.0.smithi019.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-11T00:03:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:43 smithi135 ceph-mon[35432]: pgmap v361: 97 pgs: 97 active+clean; 5.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 378 KiB/s wr, 40 op/s 2024-09-11T00:03:44.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:43 smithi019 ceph-mon[30859]: pgmap v361: 97 pgs: 97 active+clean; 5.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 378 KiB/s wr, 40 op/s 2024-09-11T00:03:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:43 smithi131 ceph-mon[35491]: pgmap v361: 97 pgs: 97 active+clean; 5.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 378 KiB/s wr, 40 op/s 2024-09-11T00:03:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:45 smithi135 ceph-mon[35432]: pgmap v362: 97 pgs: 97 active+clean; 5.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 407 KiB/s wr, 46 op/s 2024-09-11T00:03:46.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:45 smithi019 ceph-mon[30859]: pgmap v362: 97 pgs: 97 active+clean; 5.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 407 KiB/s wr, 46 op/s 2024-09-11T00:03:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:45 smithi131 ceph-mon[35491]: pgmap v362: 97 pgs: 97 active+clean; 5.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 407 KiB/s wr, 46 op/s 2024-09-11T00:03:46.935 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:46 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:03:47.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:46 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:03:47.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:46 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:03:48.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:47 smithi019 ceph-mon[30859]: pgmap v363: 97 pgs: 97 active+clean; 5.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 430 KiB/s wr, 55 op/s 2024-09-11T00:03:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:47 smithi131 ceph-mon[35491]: pgmap v363: 97 pgs: 97 active+clean; 5.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 430 KiB/s wr, 55 op/s 2024-09-11T00:03:48.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:47 smithi135 ceph-mon[35432]: pgmap v363: 97 pgs: 97 active+clean; 5.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 430 KiB/s wr, 55 op/s 2024-09-11T00:03:50.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: pgmap v364: 97 pgs: 97 active+clean; 12 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:03:50.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: pgmap v364: 97 pgs: 97 active+clean; 12 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-11T00:03:50.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:03:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:03:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:03:50.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: pgmap v364: 97 pgs: 97 active+clean; 12 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-11T00:03:50.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:03:50.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:03:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:03:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:03:52.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:51 smithi019 ceph-mon[30859]: pgmap v365: 97 pgs: 97 active+clean; 27 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 124 op/s 2024-09-11T00:03:52.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:51 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:03:52.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:51 smithi131 ceph-mon[35491]: pgmap v365: 97 pgs: 97 active+clean; 27 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 124 op/s 2024-09-11T00:03:52.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:51 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:03:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:51 smithi135 ceph-mon[35432]: pgmap v365: 97 pgs: 97 active+clean; 27 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 124 op/s 2024-09-11T00:03:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:51 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:03:53.102 INFO:tasks.workunit.client.0.smithi019.stdout: 13 56822 880 29867 762 7966 553 2024-09-11T00:03:54.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:53 smithi019 ceph-mon[30859]: pgmap v366: 97 pgs: 97 active+clean; 43 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 196 op/s 2024-09-11T00:03:54.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:53 smithi131 ceph-mon[35491]: pgmap v366: 97 pgs: 97 active+clean; 43 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 196 op/s 2024-09-11T00:03:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:53 smithi135 ceph-mon[35432]: pgmap v366: 97 pgs: 97 active+clean; 43 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 196 op/s 2024-09-11T00:03:56.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:55 smithi019 ceph-mon[30859]: pgmap v367: 97 pgs: 97 active+clean; 48 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2024-09-11T00:03:56.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:55 smithi019 ceph-mon[30859]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-09-11T00:03:56.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:55 smithi131 ceph-mon[35491]: pgmap v367: 97 pgs: 97 active+clean; 48 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2024-09-11T00:03:56.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:55 smithi131 ceph-mon[35491]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-09-11T00:03:56.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:55 smithi135 ceph-mon[35432]: pgmap v367: 97 pgs: 97 active+clean; 48 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2024-09-11T00:03:56.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:55 smithi135 ceph-mon[35432]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-09-11T00:03:56.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:03:56.828 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 -- 172.21.15.19:0/2060433443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10981087d0 msgr2=0x7f1098108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 --2- 172.21.15.19:0/2060433443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10981087d0 0x7f1098108c10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1080009ca0 tx=0x7f108002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 -- 172.21.15.19:0/2060433443 shutdown_connections 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 --2- 172.21.15.19:0/2060433443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1098109150 0x7f109810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 --2- 172.21.15.19:0/2060433443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10981087d0 0x7f1098108c10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 --2- 172.21.15.19:0/2060433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1098102dc0 0x7f10981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 -- 172.21.15.19:0/2060433443 >> 172.21.15.19:0/2060433443 conn(0x7f10980fe830 msgr2=0x7f1098100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 -- 172.21.15.19:0/2060433443 shutdown_connections 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.486+0000 7f109ef06640 1 -- 172.21.15.19:0/2060433443 wait complete. 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 Processor -- start 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 -- start start 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1098102dc0 0x7f1098199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10981087d0 0x7f1098199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1098109150 0x7f109819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1098112e10 con 0x7f1098102dc0 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1098112c90 con 0x7f1098109150 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.487+0000 7f109ef06640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1098112f90 con 0x7f10981087d0 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1098102dc0 0x7f1098199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1098102dc0 0x7f1098199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41508/0 (socket says 172.21.15.19:41508) 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 -- 172.21.15.19:0/580248752 learned_addr learned my addr 172.21.15.19:0/580248752 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f1097fff640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10981087d0 0x7f1098199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109d4a3640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1098109150 0x7f109819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 -- 172.21.15.19:0/580248752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10981087d0 msgr2=0x7f1098199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10981087d0 0x7f1098199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 -- 172.21.15.19:0/580248752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1098109150 msgr2=0x7f109819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1098109150 0x7f109819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 -- 172.21.15.19:0/580248752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109819f3f0 con 0x7f1098102dc0 2024-09-11T00:03:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109cca2640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1098102dc0 0x7f1098199340 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f109000e9f0 tx=0x7f109000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f1095ffb640 1 -- 172.21.15.19:0/580248752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109000cd80 con 0x7f1098102dc0 2024-09-11T00:03:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f1095ffb640 1 -- 172.21.15.19:0/580248752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10900054d0 con 0x7f1098102dc0 2024-09-11T00:03:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f1095ffb640 1 -- 172.21.15.19:0/580248752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090010690 con 0x7f1098102dc0 2024-09-11T00:03:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.488+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109819f6e0 con 0x7f1098102dc0 2024-09-11T00:03:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.489+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10981a5da0 con 0x7f1098102dc0 2024-09-11T00:03:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.491+0000 7f10a12db740 1 Processor -- start 2024-09-11T00:03:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.491+0000 7f10a12db740 1 -- start start 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.491+0000 7f1095ffb640 1 -- 172.21.15.19:0/580248752 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f1090004e90 con 0x7f1098102dc0 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f10a12db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12480 0x5608e6c12860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f10a12db740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c1e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f10a12db740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 0x5608e6c21120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12480 0x5608e6c12860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12480 0x5608e6c12860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41172/0 (socket says 172.21.15.19:41172) 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f10a12db740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5608e6b88e50 con 0x5608e6c12da0 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f10a12db740 1 -- 172.21.15.19:0/2317234743 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5608e6b78280 con 0x5608e6c1ed30 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 -- 172.21.15.19:0/2317234743 learned_addr learned my addr 172.21.15.19:0/2317234743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f10a12db740 1 -- 172.21.15.19:0/2317234743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5608e6b7c090 con 0x5608e6c12480 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109cca2640 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c1e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 -- 172.21.15.19:0/2317234743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 msgr2=0x5608e6c21120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 0x5608e6c21120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 -- 172.21.15.19:0/2317234743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 msgr2=0x5608e6c1e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c1e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.492+0000 7f109d4a3640 1 -- 172.21.15.19:0/2317234743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e68d6650 con 0x5608e6c12480 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.493+0000 7f109d4a3640 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12480 0x5608e6c12860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f108800cb40 tx=0x7f108800e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40efdfed04ee4ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.493+0000 7f1095ffb640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10840b5450 0x7f10840b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.493+0000 7f108effd640 1 -- 172.21.15.19:0/2317234743 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088005020 con 0x5608e6c12480 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.493+0000 7f109cca2640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10840b5450 0x7f10840b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.493+0000 7f108effd640 1 -- 172.21.15.19:0/2317234743 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10880047a0 con 0x5608e6c12480 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.493+0000 7f108effd640 1 -- 172.21.15.19:0/2317234743 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088010690 con 0x5608e6c12480 2024-09-11T00:03:57.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.493+0000 7f1095ffb640 1 -- 172.21.15.19:0/580248752 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f10900e6420 con 0x7f1098102dc0 2024-09-11T00:03:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 -- 172.21.15.19:0/2317234743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12480 msgr2=0x5608e6c12860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12480 0x5608e6c12860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f108800cb40 tx=0x7f108800e350 comp rx=0 tx=0).stop 2024-09-11T00:03:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f109cca2640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10840b5450 0x7f10840b7910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f10900e3ca0 tx=0x7f1090004a90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 -- 172.21.15.19:0/2317234743 shutdown_connections 2024-09-11T00:03:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 0x5608e6c21120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c1e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 --2- 172.21.15.19:0/2317234743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12480 0x5608e6c12860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 -- 172.21.15.19:0/2317234743 >> 172.21.15.19:0/2317234743 conn(0x5608e6c102b0 msgr2=0x5608e6c11450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 -- 172.21.15.19:0/2317234743 shutdown_connections 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 -- 172.21.15.19:0/2317234743 wait complete. 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.494+0000 7f10a12db740 1 -- start start 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 1 Processor -- start 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c1e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12da0 0x5608e6c1baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c1c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5608e69d9700 con 0x5608e6c12480 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5608e6b13110 con 0x5608e6c12da0 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5608e6c25dc0 con 0x5608e6c1ed30 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f10a12db740 10 client.0 _ll_register_callbacks cb 0x5608e6b2c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c1e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c1e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41514/0 (socket says 172.21.15.19:41514) 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f109d4a3640 1 -- 172.21.15.19:0/637379085 learned_addr learned my addr 172.21.15.19:0/637379085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f109d4a3640 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c1c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.495+0000 7f1097fff640 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12da0 0x5608e6c1baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f109d4a3640 1 -- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 msgr2=0x5608e6c1c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f109d4a3640 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c1c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f109d4a3640 1 -- 172.21.15.19:0/637379085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12da0 msgr2=0x5608e6c1baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f109d4a3640 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12da0 0x5608e6c1baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f109d4a3640 1 -- 172.21.15.19:0/637379085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e6b40c40 con 0x5608e6c12480 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f109d4a3640 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c1e6a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1088005890 tx=0x7f10880052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ede065a697083c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f1077fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f1077fff640 1 -- 172.21.15.19:0/637379085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088024070 con 0x5608e6c12480 2024-09-11T00:03:57.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f1077fff640 1 -- 172.21.15.19:0/637379085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f1088004230 con 0x5608e6c12480 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10880047a0 con 0x5608e6c12480 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f1077fff640 1 -- 172.21.15.19:0/637379085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1088005530 con 0x5608e6c12480 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f10a12db740 10 client.15612 fetch_fsmap learned FSMap version 27 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.496+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5608e6c31770 con 0x5608e6c12480 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f1077fff640 1 -- 172.21.15.19:0/637379085 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10880047a0 con 0x5608e6c12480 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f1077fff640 1 -- 172.21.15.19:0/637379085 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1088010430 con 0x5608e6c12480 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f10a12db740 10 client.15612 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f10a12db740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f10a12db740 20 client.15612 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f10a12db740 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6c32b20 0x5608e6c34f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f10a12db740 4 client.15612 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608e6b8ada0 con 0x5608e6c32b20 2024-09-11T00:03:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.497+0000 7f1097fff640 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6c32b20 0x5608e6c34f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.498+0000 7f1077fff640 10 client.15612 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.498+0000 7f1097fff640 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6c32b20 0x5608e6c34f10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=277b9575a7350043 server_cookie=905d5816ff119b46 in_seq=0 out_seq=0 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.498+0000 7f1077fff640 1 -- 172.21.15.19:0/637379085 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608e6b8ada0 con 0x5608e6c32b20 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.498+0000 7f1077fff640 10 client.15612 handle_command_reply: tid=0 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.498+0000 7f10a12db740 1 client.15612 shutdown 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.498+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 msgr2=0x5608e6c1e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.498+0000 7f10a12db740 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c1e6a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1088005890 tx=0x7f10880052b0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 shutdown_connections 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c1c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12da0 0x5608e6c1baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6c32b20 0x5608e6c34f10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f1077fff640 0 client.15612 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:57.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 --2- 172.21.15.19:0/637379085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c1e6a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 >> 172.21.15.19:0/637379085 conn(0x5608e6c102b0 msgr2=0x5608e6c15e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 shutdown_connections 2024-09-11T00:03:57.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 1 -- 172.21.15.19:0/637379085 wait complete. 2024-09-11T00:03:57.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.499+0000 7f10a12db740 20 client.15612 trim_cache size 0 max 16384 2024-09-11T00:03:57.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 Processor -- start 2024-09-11T00:03:57.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 -- start start 2024-09-11T00:03:57.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12da0 0x5608e6c2eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 0x5608e6c0b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10981aece0 con 0x5608e6c12480 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10981ac5b0 con 0x5608e6c1ed30 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f10a12db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10981aa400 con 0x5608e6c12da0 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c117b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41518/0 (socket says 172.21.15.19:41518) 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f109d4a3640 1 -- 172.21.15.19:0/2847020549 learned_addr learned my addr 172.21.15.19:0/2847020549 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.518+0000 7f1097fff640 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12da0 0x5608e6c2eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f109d4a3640 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 0x5608e6c0b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f109d4a3640 1 -- 172.21.15.19:0/2847020549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12da0 msgr2=0x5608e6c2eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f109d4a3640 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12da0 0x5608e6c2eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f109d4a3640 1 -- 172.21.15.19:0/2847020549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 msgr2=0x5608e6c0b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f109d4a3640 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 0x5608e6c0b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f109d4a3640 1 -- 172.21.15.19:0/2847020549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e6c19ff0 con 0x5608e6c12480 2024-09-11T00:03:57.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f1097fff640 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12da0 0x5608e6c2eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:57.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f109d4a3640 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c117b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1088000c00 tx=0x7f1088001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75966fe6f8c14ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f108e7fc640 1 -- 172.21.15.19:0/2847020549 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088024050 con 0x5608e6c12480 2024-09-11T00:03:57.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f108e7fc640 1 -- 172.21.15.19:0/2847020549 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1088022070 con 0x5608e6c12480 2024-09-11T00:03:57.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.519+0000 7f108e7fc640 1 -- 172.21.15.19:0/2847020549 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088010a20 con 0x5608e6c12480 2024-09-11T00:03:57.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 -- 172.21.15.19:0/2847020549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 msgr2=0x5608e6c117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c117b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1088000c00 tx=0x7f1088001e50 comp rx=0 tx=0).stop 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 -- 172.21.15.19:0/2847020549 shutdown_connections 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c1ed30 0x5608e6c0b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c12da0 0x5608e6c2eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 --2- 172.21.15.19:0/2847020549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12480 0x5608e6c117b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 -- 172.21.15.19:0/2847020549 >> 172.21.15.19:0/2847020549 conn(0x5608e6c102b0 msgr2=0x5608e6c0ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 -- 172.21.15.19:0/2847020549 shutdown_connections 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 -- 172.21.15.19:0/2847020549 wait complete. 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 -- start start 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.520+0000 7f10a12db740 1 Processor -- start 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f10a12db740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12480 0x5608e6c2b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f10a12db740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c2b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f10a12db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c26170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f10a12db740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10981aaa70 con 0x5608e6c12da0 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f10a12db740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10981abee0 con 0x5608e6c12480 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f10a12db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10981ab140 con 0x5608e6c1ed30 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f10a12db740 10 client.0 _ll_register_callbacks cb 0x7f1088014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f1097fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c2b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c26170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c26170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41206/0 (socket says 172.21.15.19:41206) 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 -- 172.21.15.19:0/3531646116 learned_addr learned my addr 172.21.15.19:0/3531646116 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12480 0x5608e6c2b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 -- 172.21.15.19:0/3531646116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12480 msgr2=0x5608e6c2b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12480 0x5608e6c2b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 -- 172.21.15.19:0/3531646116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 msgr2=0x5608e6c2b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c2b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f109d4a3640 1 -- 172.21.15.19:0/3531646116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e6c269a0 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.521+0000 7f1097fff640 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c2b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f109d4a3640 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c26170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1088005b70 tx=0x7f108800c590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51e53aadf94b5ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f1077fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f1077fff640 1 -- 172.21.15.19:0/3531646116 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088024070 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f1077fff640 1 -- 172.21.15.19:0/3531646116 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f1088010c30 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1088022070 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f1077fff640 1 -- 172.21.15.19:0/3531646116 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f108800c330 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f10a12db740 10 client.25240 fetch_fsmap learned FSMap version 27 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5608e6ca0400 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f1077fff640 1 -- 172.21.15.19:0/3531646116 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1088022070 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.522+0000 7f1077fff640 1 -- 172.21.15.19:0/3531646116 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f108802b450 con 0x5608e6c1ed30 2024-09-11T00:03:57.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f10a12db740 10 client.25240 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f10a12db740 10 client.25240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f10a12db740 20 client.25240 populate_metadata read hostname 'smithi019' 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f10a12db740 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6ca0a10 0x5608e6ca2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f10a12db740 4 client.25240 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608e6b86850 con 0x5608e6ca0a10 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f1097fff640 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6ca0a10 0x5608e6ca2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f1077fff640 10 client.25240 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f1097fff640 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6ca0a10 0x5608e6ca2e30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f166b1c554cea0e server_cookie=ee5826ea0168c442 in_seq=0 out_seq=0 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f1077fff640 1 -- 172.21.15.19:0/3531646116 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5608e6b86850 con 0x5608e6ca0a10 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f1077fff640 10 client.25240 handle_command_reply: tid=0 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.523+0000 7f10a12db740 1 client.25240 shutdown 2024-09-11T00:03:57.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 msgr2=0x5608e6c26170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c26170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1088005b70 tx=0x7f108800c590 comp rx=0 tx=0).stop 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 shutdown_connections 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608e6c1ed30 0x5608e6c26170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5608e6ca0a10 0x5608e6ca2e30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5608e6c12da0 0x5608e6c2b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 --2- 172.21.15.19:0/3531646116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5608e6c12480 0x5608e6c2b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f1077fff640 0 client.25240 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 >> 172.21.15.19:0/3531646116 conn(0x5608e6c102b0 msgr2=0x5608e6c1d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 shutdown_connections 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 1 -- 172.21.15.19:0/3531646116 wait complete. 2024-09-11T00:03:57.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.524+0000 7f10a12db740 20 client.25240 trim_cache size 0 max 16384 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:03:57.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:03:57.533 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10840b5450 msgr2=0x7f10840b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10840b5450 0x7f10840b7910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f10900e3ca0 tx=0x7f1090004a90 comp rx=0 tx=0).stop 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1098102dc0 msgr2=0x7f1098199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1098102dc0 0x7f1098199340 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f109000e9f0 tx=0x7f109000edf0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 shutdown_connections 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1098109150 0x7f109819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10981087d0 0x7f1098199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f10840b5450 0x7f10840b7910 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 --2- 172.21.15.19:0/580248752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1098102dc0 0x7f1098199340 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 >> 172.21.15.19:0/580248752 conn(0x7f10980fe830 msgr2=0x7f1098100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 shutdown_connections 2024-09-11T00:03:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:57.525+0000 7f109ef06640 1 -- 172.21.15.19:0/580248752 wait complete. 2024-09-11T00:03:57.759 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:57 smithi019 ceph-mon[30859]: pgmap v368: 97 pgs: 97 active+clean; 54 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-11T00:03:58.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:57 smithi131 ceph-mon[35491]: pgmap v368: 97 pgs: 97 active+clean; 54 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-11T00:03:58.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:57 smithi135 ceph-mon[35432]: pgmap v368: 97 pgs: 97 active+clean; 54 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-11T00:03:58.310 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:03:58.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:03:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:59.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 -- 172.21.15.19:0/2825143369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 msgr2=0x7fedb81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:59.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 --2- 172.21.15.19:0/2825143369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb81031c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009900 tx=0x7fedb002a410 comp rx=0 tx=0).stop 2024-09-11T00:03:59.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 -- 172.21.15.19:0/2825143369 shutdown_connections 2024-09-11T00:03:59.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 --2- 172.21.15.19:0/2825143369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb8109170 0x7fedb810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 --2- 172.21.15.19:0/2825143369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb81087f0 0x7fedb8108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 --2- 172.21.15.19:0/2825143369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb81031c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 -- 172.21.15.19:0/2825143369 >> 172.21.15.19:0/2825143369 conn(0x7fedb80fe870 msgr2=0x7fedb8100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 -- 172.21.15.19:0/2825143369 shutdown_connections 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.341+0000 7fedbd529640 1 -- 172.21.15.19:0/2825143369 wait complete. 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 Processor -- start 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 -- start start 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb81087f0 0x7fedb81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb8109170 0x7fedb819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8112e30 con 0x7fedb8102de0 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8112cb0 con 0x7fedb8109170 2024-09-11T00:03:59.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.342+0000 7fedbd529640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8112fb0 con 0x7fedb81087f0 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb81087f0 0x7fedb81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb8199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41540/0 (socket says 172.21.15.19:41540) 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 -- 172.21.15.19:0/1150115086 learned_addr learned my addr 172.21.15.19:0/1150115086 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb77fe640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb8109170 0x7fedb819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 -- 172.21.15.19:0/1150115086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb81087f0 msgr2=0x7fedb81998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb81087f0 0x7fedb81998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 -- 172.21.15.19:0/1150115086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb8109170 msgr2=0x7fedb819ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb8109170 0x7fedb819ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 -- 172.21.15.19:0/1150115086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb819f410 con 0x7fedb8102de0 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb67fc640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb81087f0 0x7fedb81998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:59.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedb6ffd640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb8199360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fedb0005940 tx=0x7fedb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedaffff640 1 -- 172.21.15.19:0/1150115086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb003f030 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb819f6a0 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedaffff640 1 -- 172.21.15.19:0/1150115086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedb0003cb0 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedaffff640 1 -- 172.21.15.19:0/1150115086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0035070 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.343+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb8075380 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.344+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb81031c0 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.347+0000 7fedaffff640 1 -- 172.21.15.19:0/1150115086 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fedb003bbf0 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.348+0000 7fedaffff640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feda40b54d0 0x7feda40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.349+0000 7fedb67fc640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feda40b54d0 0x7feda40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.349+0000 7fedaffff640 1 -- 172.21.15.19:0/1150115086 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fedb0106d10 con 0x7fedb8102de0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.349+0000 7fedb67fc640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feda40b54d0 0x7feda40b7990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fedb8102280 tx=0x7feda000f7a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.351+0000 7fedaffff640 1 -- 172.21.15.19:0/1150115086 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fedb00cd260 con 0x7fedb8102de0 2024-09-11T00:03:59.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.633+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedb810af80 con 0x7fedb8102de0 2024-09-11T00:03:59.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.634+0000 7fedaffff640 1 -- 172.21.15.19:0/1150115086 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7fedb00d1c90 con 0x7fedb8102de0 2024-09-11T00:03:59.636 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:03:59.636 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-11T00:03:50:682339+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:03:49.908799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:03:59.637 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-11T00:03:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.636+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feda40b54d0 msgr2=0x7feda40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.636+0000 7fedbd529640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feda40b54d0 0x7feda40b7990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fedb8102280 tx=0x7feda000f7a0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.636+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 msgr2=0x7fedb8199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.636+0000 7fedbd529640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb8199360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fedb0005940 tx=0x7fedb00042f0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.636+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 shutdown_connections 2024-09-11T00:03:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.637+0000 7fedbd529640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb8109170 0x7fedb819ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.637+0000 7fedbd529640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb81087f0 0x7fedb81998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.637+0000 7fedbd529640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7feda40b54d0 0x7feda40b7990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.637+0000 7fedbd529640 1 --2- 172.21.15.19:0/1150115086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb8102de0 0x7fedb8199360 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:59.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.637+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 >> 172.21.15.19:0/1150115086 conn(0x7fedb80fe870 msgr2=0x7fedb8100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:59.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.637+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 shutdown_connections 2024-09-11T00:03:59.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:03:59.637+0000 7fedbd529640 1 -- 172.21.15.19:0/1150115086 wait complete. 2024-09-11T00:04:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:59 smithi019 ceph-mon[30859]: pgmap v369: 97 pgs: 97 active+clean; 54 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-11T00:04:00.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:03:59 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1150115086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:59 smithi131 ceph-mon[35491]: pgmap v369: 97 pgs: 97 active+clean; 54 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-11T00:04:00.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:03:59 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1150115086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:59 smithi135 ceph-mon[35432]: pgmap v369: 97 pgs: 97 active+clean; 54 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-11T00:04:00.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:03:59 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1150115086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:00.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:04:00.729 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 -- 172.21.15.19:0/2784170851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 msgr2=0x7f7b94108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 --2- 172.21.15.19:0/2784170851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 0x7f7b94108c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009900 tx=0x7f7b7c02a410 comp rx=0 tx=0).stop 2024-09-11T00:04:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 -- 172.21.15.19:0/2784170851 shutdown_connections 2024-09-11T00:04:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 --2- 172.21.15.19:0/2784170851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 0x7f7b9410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 --2- 172.21.15.19:0/2784170851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 0x7f7b94108c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 --2- 172.21.15.19:0/2784170851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b94102dc0 0x7f7b941031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 -- 172.21.15.19:0/2784170851 >> 172.21.15.19:0/2784170851 conn(0x7f7b940fe870 msgr2=0x7f7b94100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 -- 172.21.15.19:0/2784170851 shutdown_connections 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.271+0000 7f7b9a436640 1 -- 172.21.15.19:0/2784170851 wait complete. 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 Processor -- start 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 -- start start 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b94102dc0 0x7f7b94199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 0x7f7b941997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 0x7f7b9419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b94112da0 con 0x7f7b94109150 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b94112c20 con 0x7f7b94102dc0 2024-09-11T00:04:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b9a436640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b94112f20 con 0x7f7b941087d0 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 0x7f7b9419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 0x7f7b9419eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41556/0 (socket says 172.21.15.19:41556) 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b8bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 0x7f7b941997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 -- 172.21.15.19:0/3445028294 learned_addr learned my addr 172.21.15.19:0/3445028294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b93fff640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b94102dc0 0x7f7b94199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 -- 172.21.15.19:0/3445028294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 msgr2=0x7f7b941997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 0x7f7b941997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 -- 172.21.15.19:0/3445028294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b94102dc0 msgr2=0x7f7b94199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b94102dc0 0x7f7b94199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b989d3640 1 -- 172.21.15.19:0/3445028294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9419f320 con 0x7f7b94109150 2024-09-11T00:04:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 0x7f7b941997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.272+0000 7f7b93fff640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b94102dc0 0x7f7b94199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.273+0000 7f7b989d3640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 0x7f7b9419eb50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00eb10 tx=0x7f7b8c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.273+0000 7f7b91ffb640 1 -- 172.21.15.19:0/3445028294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c004b20 con 0x7f7b94109150 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.273+0000 7f7b91ffb640 1 -- 172.21.15.19:0/3445028294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b8c004cc0 con 0x7f7b94109150 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.273+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9419f610 con 0x7f7b94109150 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.273+0000 7f7b91ffb640 1 -- 172.21.15.19:0/3445028294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c010670 con 0x7f7b94109150 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.273+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b941a5cd0 con 0x7f7b94109150 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.276+0000 7f7b91ffb640 1 -- 172.21.15.19:0/3445028294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f7b8c005020 con 0x7f7b94109150 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.276+0000 7f7b9c80b740 1 Processor -- start 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.276+0000 7f7b9c80b740 1 -- start start 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba94d0 0x562407ba98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba9df0 0x562407bb5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562407b1fea0 con 0x562407ba9df0 2024-09-11T00:04:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562407b0f2d0 con 0x562407bb5d80 2024-09-11T00:04:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562407b130e0 con 0x562407ba94d0 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba9df0 0x562407bb5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b8bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba94d0 0x562407ba98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba9df0 0x562407bb5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41558/0 (socket says 172.21.15.19:41558) 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b93fff640 1 -- 172.21.15.19:0/345129531 learned_addr learned my addr 172.21.15.19:0/345129531 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b8bfff640 1 -- 172.21.15.19:0/345129531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 msgr2=0x562407bb8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b8bfff640 1 -- 172.21.15.19:0/345129531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba9df0 msgr2=0x562407bb5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba9df0 0x562407bb5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b8bfff640 1 -- 172.21.15.19:0/345129531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56240786d650 con 0x562407ba94d0 2024-09-11T00:04:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.277+0000 7f7b93fff640 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba9df0 0x562407bb5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.278+0000 7f7b91ffb640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b800b5450 0x7f7b800b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.278+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba94d0 0x562407ba98b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009230 tx=0x7f7b7c005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb604b48f07c691 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.278+0000 7f7b91ffb640 1 -- 172.21.15.19:0/3445028294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f7b8c0e6600 con 0x7f7b94109150 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.278+0000 7f7b93fff640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b800b5450 0x7f7b800b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.278+0000 7f7b8a7fc640 1 -- 172.21.15.19:0/345129531 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c044020 con 0x562407ba94d0 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.278+0000 7f7b8a7fc640 1 -- 172.21.15.19:0/345129531 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b7c0054f0 con 0x562407ba94d0 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.278+0000 7f7b8a7fc640 1 -- 172.21.15.19:0/345129531 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c035040 con 0x562407ba94d0 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 -- 172.21.15.19:0/345129531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba94d0 msgr2=0x562407ba98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba94d0 0x562407ba98b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009230 tx=0x7f7b7c005bc0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b93fff640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b800b5450 0x7f7b800b7910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562407ba81e0 tx=0x7f7b84009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 -- 172.21.15.19:0/345129531 shutdown_connections 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba9df0 0x562407bb5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/345129531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba94d0 0x562407ba98b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 -- 172.21.15.19:0/345129531 >> 172.21.15.19:0/345129531 conn(0x562407ba7300 msgr2=0x562407ba84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 -- 172.21.15.19:0/345129531 shutdown_connections 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.279+0000 7f7b9c80b740 1 -- 172.21.15.19:0/345129531 wait complete. 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.280+0000 7f7b9c80b740 1 -- start start 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.280+0000 7f7b9c80b740 1 Processor -- start 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.280+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bb56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.280+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba9df0 0x562407bb2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.280+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562407970700 con 0x562407ba94d0 2024-09-11T00:04:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562407aaa160 con 0x562407bb5d80 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562407bb89a0 con 0x562407ba9df0 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b9c80b740 10 client.0 _ll_register_callbacks cb 0x562407ac39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba9df0 0x562407bb2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b989d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba9df0 0x562407bb2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41258/0 (socket says 172.21.15.19:41258) 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 -- 172.21.15.19:0/2011427197 learned_addr learned my addr 172.21.15.19:0/2011427197 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b989d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:55964/0 (socket says 172.21.15.19:55964) 2024-09-11T00:04:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 -- 172.21.15.19:0/2011427197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 msgr2=0x562407bb31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 -- 172.21.15.19:0/2011427197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 msgr2=0x562407bb56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bb56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.281+0000 7f7b8bfff640 1 -- 172.21.15.19:0/2011427197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562407ad7c90 con 0x562407ba9df0 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba9df0 0x562407bb2b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c03a6a0 tx=0x7f7b7c005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=907b9a3183a4468e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b737fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b737fe640 1 -- 172.21.15.19:0/2011427197 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c044030 con 0x562407ba9df0 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b737fe640 1 -- 172.21.15.19:0/2011427197 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f7b7c03ac10 con 0x562407ba9df0 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7c0054f0 con 0x562407ba9df0 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b737fe640 1 -- 172.21.15.19:0/2011427197 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7b7c035040 con 0x562407ba9df0 2024-09-11T00:04:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b9c80b740 10 client.25258 fetch_fsmap learned FSMap version 27 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.282+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562407bc8760 con 0x562407ba9df0 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b737fe640 1 -- 172.21.15.19:0/2011427197 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b7c03ae10 con 0x562407ba9df0 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b737fe640 1 -- 172.21.15.19:0/2011427197 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7b7c049ae0 con 0x562407ba9df0 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b9c80b740 10 client.25258 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b9c80b740 10 client.25258 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b9c80b740 20 client.25258 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407bc9ab0 0x562407bcbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b9c80b740 4 client.25258 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7b7c0054f0 con 0x562407bc9ab0 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.283+0000 7f7b93fff640 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407bc9ab0 0x562407bcbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.284+0000 7f7b93fff640 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407bc9ab0 0x562407bcbea0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=49dfb771d58b6dae server_cookie=75cf8e2b43c11c2a in_seq=0 out_seq=0 2024-09-11T00:04:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.284+0000 7f7b737fe640 10 client.25258 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b737fe640 1 -- 172.21.15.19:0/2011427197 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7b7c0054f0 con 0x562407bc9ab0 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b737fe640 10 client.25258 handle_command_reply: tid=0 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 client.25258 shutdown 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba9df0 msgr2=0x562407bb2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba9df0 0x562407bb2b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c03a6a0 tx=0x7f7b7c005b50 comp rx=0 tx=0).stop 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 shutdown_connections 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407bc9ab0 0x562407bcbea0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407bb5d80 0x562407bb31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407ba9df0 0x562407bb2b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b737fe640 0 client.25258 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2011427197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bb56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 >> 172.21.15.19:0/2011427197 conn(0x562407ba7300 msgr2=0x562407bacea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 shutdown_connections 2024-09-11T00:04:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2011427197 wait complete. 2024-09-11T00:04:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.288+0000 7f7b9c80b740 20 client.25258 trim_cache size 0 max 16384 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 Processor -- start 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 -- start start 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407ba83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407ba6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bb7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941aeb50 con 0x562407ba94d0 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941ac420 con 0x562407ba9df0 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.307+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941aa270 con 0x562407bb5d80 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407ba83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b989d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bb7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407ba83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41572/0 (socket says 172.21.15.19:41572) 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 -- 172.21.15.19:0/2086925293 learned_addr learned my addr 172.21.15.19:0/2086925293 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407ba6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 -- 172.21.15.19:0/2086925293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 msgr2=0x562407bb7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bb7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 -- 172.21.15.19:0/2086925293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 msgr2=0x562407ba6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407ba6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 -- 172.21.15.19:0/2086925293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562407bb3520 con 0x562407ba94d0 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b989d3640 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bb7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b93fff640 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407ba83c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7b84012010 tx=0x7f7b84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e1921914f9d008 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b89ffb640 1 -- 172.21.15.19:0/2086925293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b84012c70 con 0x562407ba94d0 2024-09-11T00:04:01.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b89ffb640 1 -- 172.21.15.19:0/2086925293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b84012e10 con 0x562407ba94d0 2024-09-11T00:04:01.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.308+0000 7f7b89ffb640 1 -- 172.21.15.19:0/2086925293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b84005020 con 0x562407ba94d0 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.309+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2086925293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 msgr2=0x562407ba83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.309+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407ba83c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7b84012010 tx=0x7f7b84014000 comp rx=0 tx=0).stop 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.309+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2086925293 shutdown_connections 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.309+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bb7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.309+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407ba6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.309+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/2086925293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407ba83c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.309+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2086925293 >> 172.21.15.19:0/2086925293 conn(0x562407ba7300 msgr2=0x562407bb13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.310+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2086925293 shutdown_connections 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.310+0000 7f7b9c80b740 1 -- 172.21.15.19:0/2086925293 wait complete. 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.310+0000 7f7b9c80b740 1 -- start start 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 1 Processor -- start 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bbe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407bbcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bbd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941aa8e0 con 0x562407ba94d0 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941abd50 con 0x562407ba9df0 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941aafb0 con 0x562407bb5d80 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b9c80b740 10 client.0 _ll_register_callbacks cb 0x7f7b84009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b989d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bbd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.311+0000 7f7b8bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407bbcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407bbcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:55988/0 (socket says 172.21.15.19:55988) 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 -- 172.21.15.19:0/1805149832 learned_addr learned my addr 172.21.15.19:0/1805149832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b93fff640 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bbe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 -- 172.21.15.19:0/1805149832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 msgr2=0x562407bbd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bbd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 -- 172.21.15.19:0/1805149832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 msgr2=0x562407bbe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bbe150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 -- 172.21.15.19:0/1805149832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562407bbd770 con 0x562407ba9df0 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b93fff640 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bbe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b8bfff640 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407bbcc70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c02a930 tx=0x7f7b7c005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac261de5447a084 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.312+0000 7f7b737fe640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b737fe640 1 -- 172.21.15.19:0/1805149832 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c044040 con 0x562407ba9df0 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b737fe640 1 -- 172.21.15.19:0/1805149832 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f7b7c004040 con 0x562407ba9df0 2024-09-11T00:04:01.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b84012e10 con 0x562407ba9df0 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b737fe640 1 -- 172.21.15.19:0/1805149832 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7b7c04d040 con 0x562407ba9df0 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 10 client.25121 fetch_fsmap learned FSMap version 27 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562407c37410 con 0x562407ba9df0 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b737fe640 1 -- 172.21.15.19:0/1805149832 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b7c03ae20 con 0x562407ba9df0 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b737fe640 1 -- 172.21.15.19:0/1805149832 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7b7c03d8e0 con 0x562407ba9df0 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 10 client.25121 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 10 client.25121 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 20 client.25121 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407c37bb0 0x562407c39fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 4 client.25121 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.313+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7b84012e10 con 0x562407c37bb0 2024-09-11T00:04:01.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.314+0000 7f7b93fff640 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407c37bb0 0x562407c39fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:01.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.314+0000 7f7b737fe640 10 client.25121 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:01.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.314+0000 7f7b93fff640 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407c37bb0 0x562407c39fd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0c60f93d33beef server_cookie=286e530da464972c in_seq=0 out_seq=0 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b737fe640 1 -- 172.21.15.19:0/1805149832 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7b84012e10 con 0x562407c37bb0 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b737fe640 10 client.25121 handle_command_reply: tid=0 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 client.25121 shutdown 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 msgr2=0x562407bbcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407bbcc70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c02a930 tx=0x7f7b7c005e20 comp rx=0 tx=0).stop 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 shutdown_connections 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x562407c37bb0 0x562407c39fd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562407bb5d80 0x562407bbd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562407ba9df0 0x562407bbcc70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b737fe640 0 client.25121 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 --2- 172.21.15.19:0/1805149832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562407ba94d0 0x562407bbe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 >> 172.21.15.19:0/1805149832 conn(0x562407ba7300 msgr2=0x562407bb4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 shutdown_connections 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 1 -- 172.21.15.19:0/1805149832 wait complete. 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.321+0000 7f7b9c80b740 20 client.25121 trim_cache size 0 max 16384 2024-09-11T00:04:01.326 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:04:01.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b800b5450 msgr2=0x7f7b800b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b800b5450 0x7f7b800b7910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562407ba81e0 tx=0x7f7b84009560 comp rx=0 tx=0).stop 2024-09-11T00:04:01.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 msgr2=0x7f7b9419eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 0x7f7b9419eb50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00eb10 tx=0x7f7b8c00c2d0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 shutdown_connections 2024-09-11T00:04:01.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b800b5450 0x7f7b800b7910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b94109150 0x7f7b9419eb50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b941087d0 0x7f7b941997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 --2- 172.21.15.19:0/3445028294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b94102dc0 0x7f7b94199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 >> 172.21.15.19:0/3445028294 conn(0x7f7b940fe870 msgr2=0x7f7b94100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:01.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 shutdown_connections 2024-09-11T00:04:01.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:01.322+0000 7f7b9a436640 1 -- 172.21.15.19:0/3445028294 wait complete. 2024-09-11T00:04:02.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:01 smithi019 ceph-mon[30859]: pgmap v370: 97 pgs: 97 active+clean; 58 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-09-11T00:04:02.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:01 smithi131 ceph-mon[35491]: pgmap v370: 97 pgs: 97 active+clean; 58 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-09-11T00:04:02.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:04:02.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:01 smithi135 ceph-mon[35432]: pgmap v370: 97 pgs: 97 active+clean; 58 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-09-11T00:04:02.479 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:03.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.074+0000 7f9f710c6640 1 -- 172.21.15.19:0/3914824054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c11c0a0 msgr2=0x7f9f6c11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:03.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.074+0000 7f9f710c6640 1 --2- 172.21.15.19:0/3914824054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c11c0a0 0x7f9f6c11e490 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009860 tx=0x7f9f6002a360 comp rx=0 tx=0).stop 2024-09-11T00:04:03.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.074+0000 7f9f710c6640 1 -- 172.21.15.19:0/3914824054 shutdown_connections 2024-09-11T00:04:03.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.074+0000 7f9f710c6640 1 --2- 172.21.15.19:0/3914824054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c11c0a0 0x7f9f6c11e490 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.074+0000 7f9f710c6640 1 --2- 172.21.15.19:0/3914824054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c10a530 0x7f9f6c10a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.074+0000 7f9f710c6640 1 --2- 172.21.15.19:0/3914824054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f6c10a150 0x7f9f6c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.074+0000 7f9f710c6640 1 -- 172.21.15.19:0/3914824054 >> 172.21.15.19:0/3914824054 conn(0x7f9f6c06cb30 msgr2=0x7f9f6c06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:03.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.078+0000 7f9f710c6640 1 -- 172.21.15.19:0/3914824054 shutdown_connections 2024-09-11T00:04:03.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.079+0000 7f9f710c6640 1 -- 172.21.15.19:0/3914824054 wait complete. 2024-09-11T00:04:03.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.080+0000 7f9f710c6640 1 Processor -- start 2024-09-11T00:04:03.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.084+0000 7f9f710c6640 1 -- start start 2024-09-11T00:04:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.084+0000 7f9f710c6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c10a150 0x7f9f6c11b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.084+0000 7f9f710c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c10a530 0x7f9f6c11baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.084+0000 7f9f710c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f6c11c0a0 0x7f9f6c115a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.084+0000 7f9f710c6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c112140 con 0x7f9f6c10a530 2024-09-11T00:04:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.084+0000 7f9f710c6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c111fc0 con 0x7f9f6c10a150 2024-09-11T00:04:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.084+0000 7f9f710c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1122c0 con 0x7f9f6c11c0a0 2024-09-11T00:04:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c10a530 0x7f9f6c11baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c10a530 0x7f9f6c11baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54804/0 (socket says 172.21.15.19:54804) 2024-09-11T00:04:03.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1223745719 learned_addr learned my addr 172.21.15.19:0/1223745719 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:03.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1223745719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f6c11c0a0 msgr2=0x7f9f6c115a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:04:03.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f6c11c0a0 0x7f9f6c115a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1223745719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c10a150 msgr2=0x7f9f6c11b5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:04:03.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c10a150 0x7f9f6c11b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.085+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1223745719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c116310 con 0x7f9f6c10a530 2024-09-11T00:04:03.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.086+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c10a530 0x7f9f6c11baf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00d750 tx=0x7f9f5c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.091+0000 7f9f697fa640 1 -- 172.21.15.19:0/1223745719 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c017070 con 0x7f9f6c10a530 2024-09-11T00:04:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.091+0000 7f9f697fa640 1 -- 172.21.15.19:0/1223745719 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f5c004020 con 0x7f9f6c10a530 2024-09-11T00:04:03.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.091+0000 7f9f697fa640 1 -- 172.21.15.19:0/1223745719 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c003bc0 con 0x7f9f6c10a530 2024-09-11T00:04:03.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.092+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6c116600 con 0x7f9f6c10a530 2024-09-11T00:04:03.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.092+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6c1bd1a0 con 0x7f9f6c10a530 2024-09-11T00:04:03.107 INFO:tasks.workunit.client.0.smithi019.stdout: 29 849186 744 540397 910 268636 1615 2024-09-11T00:04:03.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.101+0000 7f9f697fa640 1 -- 172.21.15.19:0/1223745719 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f9f5c009a30 con 0x7f9f6c10a530 2024-09-11T00:04:03.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.102+0000 7f9f697fa640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9f540b5720 0x7f9f540b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.103+0000 7f9f697fa640 1 -- 172.21.15.19:0/1223745719 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9f5c0e5760 con 0x7f9f6c10a530 2024-09-11T00:04:03.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.104+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9f540b5720 0x7f9f540b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.104+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9f540b5720 0x7f9f540b7be0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9f64005c40 tx=0x7f9f64005bd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:03.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.105+0000 7f9f746fd740 1 Processor -- start 2024-09-11T00:04:03.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.110+0000 7f9f746fd740 1 -- start start 2024-09-11T00:04:03.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.110+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc1486a0 0x5592bc148a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.110+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc148fc0 0x5592bc154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.110+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc157340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.110+0000 7f9f746fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5592bc0beea0 con 0x5592bc154f50 2024-09-11T00:04:03.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.110+0000 7f9f746fd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5592bc0ae2d0 con 0x5592bc1486a0 2024-09-11T00:04:03.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.110+0000 7f9f746fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592bc0b20e0 con 0x5592bc148fc0 2024-09-11T00:04:03.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.111+0000 7f9f6b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc148fc0 0x5592bc154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.111+0000 7f9f6b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc148fc0 0x5592bc154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56624/0 (socket says 172.21.15.19:56624) 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.111+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/2317033065 learned_addr learned my addr 172.21.15.19:0/2317033065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.112+0000 7f9f708c5640 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.112+0000 7f9f708c5640 1 -- 172.21.15.19:0/2317033065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc148fc0 msgr2=0x5592bc154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.114+0000 7f9f708c5640 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc148fc0 0x5592bc154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.114+0000 7f9f708c5640 1 -- 172.21.15.19:0/2317033065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc1486a0 msgr2=0x5592bc148a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.114+0000 7f9f708c5640 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc1486a0 0x5592bc148a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.114+0000 7f9f708c5640 1 -- 172.21.15.19:0/2317033065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bbe0c650 con 0x5592bc154f50 2024-09-11T00:04:03.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.114+0000 7f9f708c5640 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc157340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a8d0 tx=0x7f9f60005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abbfb42abebb082 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:03.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.115+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc148fc0 0x5592bc154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:03.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.118+0000 7f9f527fc640 1 -- 172.21.15.19:0/2317033065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60037040 con 0x5592bc154f50 2024-09-11T00:04:03.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.118+0000 7f9f527fc640 1 -- 172.21.15.19:0/2317033065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f60004040 con 0x5592bc154f50 2024-09-11T00:04:03.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.118+0000 7f9f527fc640 1 -- 172.21.15.19:0/2317033065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600035f0 con 0x5592bc154f50 2024-09-11T00:04:03.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.123+0000 7f9f746fd740 1 -- 172.21.15.19:0/2317033065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 msgr2=0x5592bc157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:03.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.123+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc157340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a8d0 tx=0x7f9f60005760 comp rx=0 tx=0).stop 2024-09-11T00:04:03.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.127+0000 7f9f746fd740 1 -- 172.21.15.19:0/2317033065 shutdown_connections 2024-09-11T00:04:03.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.127+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc157340 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.127+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc148fc0 0x5592bc154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.127+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2317033065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc1486a0 0x5592bc148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.127+0000 7f9f746fd740 1 -- 172.21.15.19:0/2317033065 >> 172.21.15.19:0/2317033065 conn(0x5592bc1464d0 msgr2=0x5592bc147670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:03.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.134+0000 7f9f746fd740 1 -- 172.21.15.19:0/2317033065 shutdown_connections 2024-09-11T00:04:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.139+0000 7f9f746fd740 1 -- 172.21.15.19:0/2317033065 wait complete. 2024-09-11T00:04:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.139+0000 7f9f746fd740 1 -- start start 2024-09-11T00:04:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.139+0000 7f9f746fd740 1 Processor -- start 2024-09-11T00:04:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.140+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.140+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc151d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.140+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc152470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.140+0000 7f9f746fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5592bbf0f700 con 0x5592bc154f50 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.140+0000 7f9f746fd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5592bc049160 con 0x5592bc148fc0 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.140+0000 7f9f746fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592bc157b70 con 0x5592bc1486a0 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.140+0000 7f9f746fd740 10 client.0 _ll_register_callbacks cb 0x5592bc0629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.141+0000 7f9f708c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.141+0000 7f9f708c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54816/0 (socket says 172.21.15.19:54816) 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.142+0000 7f9f708c5640 1 -- 172.21.15.19:0/2897072274 learned_addr learned my addr 172.21.15.19:0/2897072274 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.142+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.142+0000 7f9f708c5640 1 -- 172.21.15.19:0/2897072274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 msgr2=0x5592bc154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.142+0000 7f9f708c5640 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.142+0000 7f9f708c5640 1 -- 172.21.15.19:0/2897072274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 msgr2=0x5592bc151d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:04:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.142+0000 7f9f708c5640 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc151d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.142+0000 7f9f708c5640 1 -- 172.21.15.19:0/2897072274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bc076c90 con 0x5592bc154f50 2024-09-11T00:04:03.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.143+0000 7f9f708c5640 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc152470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9f60035040 tx=0x7f9f60030450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f562eda88e3ac0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.148+0000 7f9f4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.148+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/2897072274 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60049070 con 0x5592bc154f50 2024-09-11T00:04:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.148+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/2897072274 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9f60004400 con 0x5592bc154f50 2024-09-11T00:04:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.149+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f60004040 con 0x5592bc154f50 2024-09-11T00:04:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.154+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/2897072274 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9f60053050 con 0x5592bc154f50 2024-09-11T00:04:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.158+0000 7f9f746fd740 10 client.15648 fetch_fsmap learned FSMap version 27 2024-09-11T00:04:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.158+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5592bc163590 con 0x5592bc154f50 2024-09-11T00:04:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/2897072274 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f60004040 con 0x5592bc154f50 2024-09-11T00:04:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/2897072274 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9f6003a070 con 0x5592bc154f50 2024-09-11T00:04:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f746fd740 10 client.15648 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T00:04:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f746fd740 10 client.15648 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:04:03.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f746fd740 20 client.15648 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:03.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1648e0 0x5592bc166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f746fd740 4 client.15648 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:03.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.162+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592bc0c0df0 con 0x5592bc1648e0 2024-09-11T00:04:03.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.164+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1648e0 0x5592bc166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.183+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1648e0 0x5592bc166cd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b55524cb7c738c84 server_cookie=b22653641bc30ad5 in_seq=0 out_seq=0 2024-09-11T00:04:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.185+0000 7f9f4b7fe640 10 client.15648 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:03.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.185+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/2897072274 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592bc0c0df0 con 0x5592bc1648e0 2024-09-11T00:04:03.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.185+0000 7f9f4b7fe640 10 client.15648 handle_command_reply: tid=0 2024-09-11T00:04:03.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.185+0000 7f9f746fd740 1 client.15648 shutdown 2024-09-11T00:04:03.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.187+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 msgr2=0x5592bc152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:03.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.187+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc152470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9f60035040 tx=0x7f9f60030450 comp rx=0 tx=0).stop 2024-09-11T00:04:03.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.188+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 shutdown_connections 2024-09-11T00:04:03.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.188+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1648e0 0x5592bc166cd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.188+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc154f50 0x5592bc152470 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.188+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.188+0000 7f9f746fd740 1 --2- 172.21.15.19:0/2897072274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.188+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 >> 172.21.15.19:0/2897072274 conn(0x5592bc1464d0 msgr2=0x5592bc14c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:03.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.192+0000 7f9f4b7fe640 0 client.15648 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:03.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.192+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 shutdown_connections 2024-09-11T00:04:03.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.192+0000 7f9f746fd740 1 -- 172.21.15.19:0/2897072274 wait complete. 2024-09-11T00:04:03.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.192+0000 7f9f746fd740 20 client.15648 trim_cache size 0 max 16384 2024-09-11T00:04:03.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 Processor -- start 2024-09-11T00:04:03.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 -- start start 2024-09-11T00:04:03.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc148fc0 0x5592bc153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc154f50 0x5592bc14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1c8410 con 0x5592bc148fc0 2024-09-11T00:04:03.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1c5ce0 con 0x5592bc154f50 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f746fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1c3b50 con 0x5592bc1486a0 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc148fc0 0x5592bc153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc148fc0 0x5592bc153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54824/0 (socket says 172.21.15.19:54824) 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1308169979 learned_addr learned my addr 172.21.15.19:0/1308169979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1308169979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 msgr2=0x5592bc145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1308169979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc154f50 msgr2=0x5592bc14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc154f50 0x5592bc14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.217+0000 7f9f6b7fe640 1 -- 172.21.15.19:0/1308169979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bc147f10 con 0x5592bc148fc0 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.218+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc148fc0 0x5592bc153ac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0abb90 tx=0x7f9f5c0a7b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d06850c79f9a39a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.218+0000 7f9f51ffb640 1 -- 172.21.15.19:0/1308169979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c020040 con 0x5592bc148fc0 2024-09-11T00:04:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.218+0000 7f9f51ffb640 1 -- 172.21.15.19:0/1308169979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f5c0ac300 con 0x5592bc148fc0 2024-09-11T00:04:03.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.218+0000 7f9f51ffb640 1 -- 172.21.15.19:0/1308169979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0e3150 con 0x5592bc148fc0 2024-09-11T00:04:03.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 -- 172.21.15.19:0/1308169979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc148fc0 msgr2=0x5592bc153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:03.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc148fc0 0x5592bc153ac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0abb90 tx=0x7f9f5c0a7b90 comp rx=0 tx=0).stop 2024-09-11T00:04:03.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 -- 172.21.15.19:0/1308169979 shutdown_connections 2024-09-11T00:04:03.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc154f50 0x5592bc14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc148fc0 0x5592bc153ac0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 --2- 172.21.15.19:0/1308169979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc1486a0 0x5592bc145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 -- 172.21.15.19:0/1308169979 >> 172.21.15.19:0/1308169979 conn(0x5592bc1464d0 msgr2=0x5592bc1533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 -- 172.21.15.19:0/1308169979 shutdown_connections 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 -- 172.21.15.19:0/1308169979 wait complete. 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.219+0000 7f9f746fd740 1 -- start start 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 1 Processor -- start 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc1486a0 0x5592bc165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc166170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc154f50 0x5592bc1d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1c41a0 con 0x5592bc1486a0 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1c5610 con 0x5592bc148fc0 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1c4870 con 0x5592bc154f50 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f746fd740 10 client.0 _ll_register_callbacks cb 0x7f9f5c004550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.220+0000 7f9f6bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc1486a0 0x5592bc165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc1486a0 0x5592bc165c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54832/0 (socket says 172.21.15.19:54832) 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 -- 172.21.15.19:0/4058079106 learned_addr learned my addr 172.21.15.19:0/4058079106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f708c5640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc154f50 0x5592bc1d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 -- 172.21.15.19:0/4058079106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc154f50 msgr2=0x5592bc1d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc154f50 0x5592bc1d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 -- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 msgr2=0x5592bc166170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc166170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 -- 172.21.15.19:0/4058079106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bc1d0980 con 0x5592bc1486a0 2024-09-11T00:04:03.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc166170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:03.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f708c5640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc154f50 0x5592bc1d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:03.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f6bfff640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc1486a0 0x5592bc165c30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f64005fd0 tx=0x7f9f64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467cfe96d669e9e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.221+0000 7f9f4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/4058079106 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64005a10 con 0x5592bc1486a0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/4058079106 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f9f64011470 con 0x5592bc1486a0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f5c0ac300 con 0x5592bc1486a0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/4058079106 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9f64011670 con 0x5592bc1486a0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f746fd740 10 client.15654 fetch_fsmap learned FSMap version 27 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5592bc1d1ba0 con 0x5592bc1486a0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/4058079106 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f5c0ac300 con 0x5592bc1486a0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/4058079106 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9f6400f040 con 0x5592bc1486a0 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f746fd740 10 client.15654 fetch_fsmap finished waiting for FSMap version 27 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f746fd740 10 client.15654 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.222+0000 7f9f746fd740 20 client.15654 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.223+0000 7f9f746fd740 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1d2330 0x5592bc1d4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.223+0000 7f9f746fd740 4 client.15654 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.223+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592bc147d40 con 0x5592bc1d2330 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.223+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1d2330 0x5592bc1d4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.223+0000 7f9f4b7fe640 10 client.15654 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.223+0000 7f9f6b7fe640 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1d2330 0x5592bc1d4750 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f81e29a2280a011e server_cookie=92e7412ecd3646d1 in_seq=0 out_seq=0 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f4b7fe640 1 -- 172.21.15.19:0/4058079106 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592bc147d40 con 0x5592bc1d2330 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f4b7fe640 10 client.15654 handle_command_reply: tid=0 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 client.15654 shutdown 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc1486a0 msgr2=0x5592bc165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc1486a0 0x5592bc165c30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f64005fd0 tx=0x7f9f64004a40 comp rx=0 tx=0).stop 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 shutdown_connections 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5592bc1d2330 0x5592bc1d4750 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f4b7fe640 0 client.15654 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592bc154f50 0x5592bc1d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592bc148fc0 0x5592bc166170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 --2- 172.21.15.19:0/4058079106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592bc1486a0 0x5592bc165c30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 >> 172.21.15.19:0/4058079106 conn(0x5592bc1464d0 msgr2=0x5592bc153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:03.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 shutdown_connections 2024-09-11T00:04:03.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 1 -- 172.21.15.19:0/4058079106 wait complete. 2024-09-11T00:04:03.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.224+0000 7f9f746fd740 20 client.15654 trim_cache size 0 max 16384 2024-09-11T00:04:03.229 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9f540b5720 msgr2=0x7f9f540b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9f540b5720 0x7f9f540b7be0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9f64005c40 tx=0x7f9f64005bd0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c10a530 msgr2=0x7f9f6c11baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c10a530 0x7f9f6c11baf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00d750 tx=0x7f9f5c00dc10 comp rx=0 tx=0).stop 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 shutdown_connections 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f6c11c0a0 0x7f9f6c115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9f540b5720 0x7f9f540b7be0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f6c10a530 0x7f9f6c11baf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 --2- 172.21.15.19:0/1223745719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6c10a150 0x7f9f6c11b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:03.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 >> 172.21.15.19:0/1223745719 conn(0x7f9f6c06cb30 msgr2=0x7f9f6c0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:03.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 shutdown_connections 2024-09-11T00:04:03.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:03.225+0000 7f9f710c6640 1 -- 172.21.15.19:0/1223745719 wait complete. 2024-09-11T00:04:03.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:03 smithi019 ceph-mon[30859]: pgmap v371: 97 pgs: 97 active+clean; 61 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-09-11T00:04:03.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:04:04.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:03 smithi131 ceph-mon[35491]: pgmap v371: 97 pgs: 97 active+clean; 61 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-09-11T00:04:04.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:03 smithi135 ceph-mon[35432]: pgmap v371: 97 pgs: 97 active+clean; 61 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-09-11T00:04:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:04.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 -- 172.21.15.19:0/3732896860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 msgr2=0x7f89bc108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 --2- 172.21.15.19:0/3732896860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 0x7f89bc108c30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009900 tx=0x7f89ac02a410 comp rx=0 tx=0).stop 2024-09-11T00:04:04.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 -- 172.21.15.19:0/3732896860 shutdown_connections 2024-09-11T00:04:04.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 --2- 172.21.15.19:0/3732896860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc109170 0x7f89bc10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 --2- 172.21.15.19:0/3732896860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 0x7f89bc108c30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 --2- 172.21.15.19:0/3732896860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc102de0 0x7f89bc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 -- 172.21.15.19:0/3732896860 >> 172.21.15.19:0/3732896860 conn(0x7f89bc0fe870 msgr2=0x7f89bc100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:04.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 -- 172.21.15.19:0/3732896860 shutdown_connections 2024-09-11T00:04:04.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.892+0000 7f89c32bb640 1 -- 172.21.15.19:0/3732896860 wait complete. 2024-09-11T00:04:04.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.893+0000 7f89c32bb640 1 Processor -- start 2024-09-11T00:04:04.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.893+0000 7f89c32bb640 1 -- start start 2024-09-11T00:04:04.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c32bb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc102de0 0x7f89bc06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c32bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 0x7f89bc06df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c32bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc109170 0x7f89bc06e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c1057640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc102de0 0x7f89bc06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c1057640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc102de0 0x7f89bc06d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54122/0 (socket says 172.21.15.19:54122) 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c1057640 1 -- 172.21.15.19:0/2763914567 learned_addr learned my addr 172.21.15.19:0/2763914567 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc112df0 con 0x7f89bc1087f0 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc112c70 con 0x7f89bc102de0 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc112f70 con 0x7f89bc109170 2024-09-11T00:04:04.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.894+0000 7f89c1858640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc109170 0x7f89bc06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.895+0000 7f89c0856640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 0x7f89bc06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.895+0000 7f89c1858640 1 -- 172.21.15.19:0/2763914567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc102de0 msgr2=0x7f89bc06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.895+0000 7f89c1858640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc102de0 0x7f89bc06d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.895+0000 7f89c1858640 1 -- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 msgr2=0x7f89bc06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.895+0000 7f89c1858640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 0x7f89bc06df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.896+0000 7f89c1858640 1 -- 172.21.15.19:0/2763914567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc075db0 con 0x7f89bc109170 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.896+0000 7f89c1858640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc109170 0x7f89bc06e470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009fd0 tx=0x7f89b400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.896+0000 7f89b27fc640 1 -- 172.21.15.19:0/2763914567 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b400ce20 con 0x7f89bc109170 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.896+0000 7f89b27fc640 1 -- 172.21.15.19:0/2763914567 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b4005020 con 0x7f89bc109170 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.896+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89bc0760a0 con 0x7f89bc109170 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.897+0000 7f89b27fc640 1 -- 172.21.15.19:0/2763914567 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4010690 con 0x7f89bc109170 2024-09-11T00:04:04.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.897+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89bc0765b0 con 0x7f89bc109170 2024-09-11T00:04:04.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.900+0000 7f89b27fc640 1 -- 172.21.15.19:0/2763914567 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f89b4004b20 con 0x7f89bc109170 2024-09-11T00:04:04.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.901+0000 7f89c5690740 1 Processor -- start 2024-09-11T00:04:04.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c5690740 1 -- start start 2024-09-11T00:04:04.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c5690740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c5690740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c5690740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89b27fc640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89a80b55a0 0x7f89a80b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c0856640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c0856640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569d64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54136/0 (socket says 172.21.15.19:54136) 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c0856640 1 -- 172.21.15.19:0/108970099 learned_addr learned my addr 172.21.15.19:0/108970099 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c1057640 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561a5694cea0 con 0x561a569d6a10 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561a5693c2d0 con 0x561a569d60f0 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561a569400e0 con 0x561a569e29a0 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.902+0000 7f89c1858640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89a80b55a0 0x7f89a80b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c0856640 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c0856640 1 -- 172.21.15.19:0/108970099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 msgr2=0x561a569e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c0856640 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c0856640 1 -- 172.21.15.19:0/108970099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 msgr2=0x561a569e2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c0856640 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c0856640 1 -- 172.21.15.19:0/108970099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a5669a650 con 0x561a569d60f0 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c1057640 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c0856640 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569d64d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f89ac02a930 tx=0x7f89ac005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0c84108d32dce40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89c1858640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89a80b55a0 0x7f89a80b7a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89b40e3e70 tx=0x7f89b40ec260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.903+0000 7f89b27fc640 1 -- 172.21.15.19:0/2763914567 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f89b40e65f0 con 0x7f89bc109170 2024-09-11T00:04:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.904+0000 7f89a77fe640 1 -- 172.21.15.19:0/108970099 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac044020 con 0x561a569d60f0 2024-09-11T00:04:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.904+0000 7f89a77fe640 1 -- 172.21.15.19:0/108970099 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ac0316a0 con 0x561a569d60f0 2024-09-11T00:04:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.904+0000 7f89a77fe640 1 -- 172.21.15.19:0/108970099 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac035040 con 0x561a569d60f0 2024-09-11T00:04:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 msgr2=0x561a569d64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569d64d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f89ac02a930 tx=0x7f89ac005b50 comp rx=0 tx=0).stop 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 shutdown_connections 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 --2- 172.21.15.19:0/108970099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569d64d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 >> 172.21.15.19:0/108970099 conn(0x561a569d3f20 msgr2=0x561a569d50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 shutdown_connections 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.905+0000 7f89c5690740 1 -- 172.21.15.19:0/108970099 wait complete. 2024-09-11T00:04:04.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.906+0000 7f89c5690740 1 -- start start 2024-09-11T00:04:04.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.906+0000 7f89c5690740 1 Processor -- start 2024-09-11T00:04:04.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c5690740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c5690740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c5690740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c0856640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c0856640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569e22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54148/0 (socket says 172.21.15.19:54148) 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c0856640 1 -- 172.21.15.19:0/2070328372 learned_addr learned my addr 172.21.15.19:0/2070328372 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561a5679d700 con 0x561a569d6a10 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561a568d7160 con 0x561a569d60f0 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561a569e55c0 con 0x561a569e29a0 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c1057640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c0856640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c1057640 1 -- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 msgr2=0x561a569dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c1057640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c1057640 1 -- 172.21.15.19:0/2070328372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 msgr2=0x561a569e22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c1057640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569e22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c1057640 1 -- 172.21.15.19:0/2070328372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a56904c90 con 0x561a569d6a10 2024-09-11T00:04:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c0856640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.907+0000 7f89c5690740 10 client.0 _ll_register_callbacks cb 0x561a568f09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89ac0316a0 con 0x561a569d6a10 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c1057640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569df740 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f89b80126d0 tx=0x7f89b8012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cb5c8a0b27169c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89a4ff9640 10 client.15666 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89a4ff9640 1 -- 172.21.15.19:0/2070328372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8011c70 con 0x561a569d6a10 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89a4ff9640 1 -- 172.21.15.19:0/2070328372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f89b8011e10 con 0x561a569d6a10 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89a4ff9640 1 -- 172.21.15.19:0/2070328372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89b800f460 con 0x561a569d6a10 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c5690740 10 client.15666 fetch_fsmap learned FSMap version 28 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561a569f0e10 con 0x561a569d6a10 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89a4ff9640 1 -- 172.21.15.19:0/2070328372 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f89b800f600 con 0x561a569d6a10 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c5690740 10 client.15666 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c5690740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c5690740 20 client.15666 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.908+0000 7f89c5690740 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a569f4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.909+0000 7f89c5690740 4 client.15666 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.909+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a5694edf0 con 0x561a569f21b0 2024-09-11T00:04:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.909+0000 7f89c0856640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a569f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.909+0000 7f89c0856640 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a569f4670 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe3bb68c0bb49b7 server_cookie=6addae51d449cdeb in_seq=0 out_seq=0 2024-09-11T00:04:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.909+0000 7f89a4ff9640 10 client.15666 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89a4ff9640 1 -- 172.21.15.19:0/2070328372 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a5694edf0 con 0x561a569f21b0 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89a4ff9640 10 client.15666 handle_command_reply: tid=0 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 client.15666 shutdown 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 msgr2=0x561a569df740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569df740 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f89b80126d0 tx=0x7f89b8012b90 comp rx=0 tx=0).stop 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 shutdown_connections 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a569f4670 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569df740 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89a4ff9640 0 client.15666 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 --2- 172.21.15.19:0/2070328372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d60f0 0x561a569e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 >> 172.21.15.19:0/2070328372 conn(0x561a569d3f20 msgr2=0x561a569d9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 shutdown_connections 2024-09-11T00:04:04.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 1 -- 172.21.15.19:0/2070328372 wait complete. 2024-09-11T00:04:04.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.910+0000 7f89c5690740 20 client.15666 trim_cache size 0 max 16384 2024-09-11T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 Processor -- start 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 -- start start 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d60f0 0x561a569ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d6a10 0x561a569e1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1c82e0 con 0x561a569d60f0 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1b0b40 con 0x561a569d6a10 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c5690740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1ae990 con 0x561a569e29a0 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.930+0000 7f89c0856640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d60f0 0x561a569ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d60f0 0x561a569ee7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54894/0 (socket says 172.21.15.19:54894) 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 -- 172.21.15.19:0/516467189 learned_addr learned my addr 172.21.15.19:0/516467189 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c1057640 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d6a10 0x561a569e1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 -- 172.21.15.19:0/516467189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 msgr2=0x561a569e3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 -- 172.21.15.19:0/516467189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d6a10 msgr2=0x561a569e1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d6a10 0x561a569e1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 -- 172.21.15.19:0/516467189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a569d5600 con 0x561a569d60f0 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89c0856640 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d60f0 0x561a569ee7f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f89ac006010 tx=0x7f89ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf6c79307794c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89a6ffd640 1 -- 172.21.15.19:0/516467189 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac044040 con 0x561a569d60f0 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89a6ffd640 1 -- 172.21.15.19:0/516467189 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ac005570 con 0x561a569d60f0 2024-09-11T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.931+0000 7f89a6ffd640 1 -- 172.21.15.19:0/516467189 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac035040 con 0x561a569d60f0 2024-09-11T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 -- 172.21.15.19:0/516467189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d60f0 msgr2=0x561a569ee7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d60f0 0x561a569ee7f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f89ac006010 tx=0x7f89ac000bc0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 -- 172.21.15.19:0/516467189 shutdown_connections 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569e29a0 0x561a569e3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569d6a10 0x561a569e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 --2- 172.21.15.19:0/516467189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d60f0 0x561a569ee7f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 -- 172.21.15.19:0/516467189 >> 172.21.15.19:0/516467189 conn(0x561a569d3f20 msgr2=0x561a569e0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 -- 172.21.15.19:0/516467189 shutdown_connections 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.932+0000 7f89c5690740 1 -- 172.21.15.19:0/516467189 wait complete. 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 -- start start 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 Processor -- start 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569d60f0 0x561a569eb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569e29a0 0x561a569e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1af000 con 0x561a569d6a10 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1b0470 con 0x561a569e29a0 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1af6d0 con 0x561a569d60f0 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c1057640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c5690740 10 client.0 _ll_register_callbacks cb 0x7f89b8009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c1057640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54908/0 (socket says 172.21.15.19:54908) 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.933+0000 7f89c1057640 1 -- 172.21.15.19:0/3179762190 learned_addr learned my addr 172.21.15.19:0/3179762190 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c0856640 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569d60f0 0x561a569eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c0856640 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569e29a0 0x561a569e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c1057640 1 -- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569d60f0 msgr2=0x561a569eb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c1057640 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569d60f0 0x561a569eb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c1057640 1 -- 172.21.15.19:0/3179762190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569e29a0 msgr2=0x561a569e5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c1057640 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569e29a0 0x561a569e5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c1057640 1 -- 172.21.15.19:0/3179762190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a569d6840 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c1057640 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e5810 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f89b80126d0 tx=0x7f89b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1521c95165c93d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89a4ff9640 1 -- 172.21.15.19:0/3179762190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8035060 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89a4ff9640 1 -- 172.21.15.19:0/3179762190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f89b8026470 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89ac005570 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89a4ff9640 1 -- 172.21.15.19:0/3179762190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89b8011e70 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c5690740 10 client.15672 fetch_fsmap learned FSMap version 28 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.934+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561a56a601e0 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89a4ff9640 1 -- 172.21.15.19:0/3179762190 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ac005570 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89a4ff9640 1 -- 172.21.15.19:0/3179762190 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f89b803a5c0 con 0x561a569d6a10 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89c5690740 10 client.15672 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89c5690740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89c5690740 20 client.15672 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89c5690740 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a56a62a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89c5690740 4 client.15672 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a5694a8a0 con 0x561a569f21b0 2024-09-11T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.935+0000 7f89c0856640 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a56a62a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89a4ff9640 10 client.15672 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c0856640 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a56a62a60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3696b3ece8274 server_cookie=b5d4d12c76910411 in_seq=0 out_seq=0 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89a4ff9640 1 -- 172.21.15.19:0/3179762190 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a5694a8a0 con 0x561a569f21b0 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89a4ff9640 10 client.15672 handle_command_reply: tid=0 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 client.15672 shutdown 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 msgr2=0x561a569e5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e5810 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f89b80126d0 tx=0x7f89b80046c0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 shutdown_connections 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a569e29a0 0x561a569e5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561a569f21b0 0x561a56a62a60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89a4ff9640 0 client.15672 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561a569d6a10 0x561a569e5810 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 --2- 172.21.15.19:0/3179762190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a569d60f0 0x561a569eb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 >> 172.21.15.19:0/3179762190 conn(0x561a569d3f20 msgr2=0x561a569e1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 shutdown_connections 2024-09-11T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 1 -- 172.21.15.19:0/3179762190 wait complete. 2024-09-11T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.936+0000 7f89c5690740 20 client.15672 trim_cache size 0 max 16384 2024-09-11T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89a80b55a0 msgr2=0x7f89a80b7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89a80b55a0 0x7f89a80b7a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89b40e3e70 tx=0x7f89b40ec260 comp rx=0 tx=0).stop 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc109170 msgr2=0x7f89bc06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc109170 0x7f89bc06e470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009fd0 tx=0x7f89b400ef10 comp rx=0 tx=0).stop 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 shutdown_connections 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc109170 0x7f89bc06e470 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f89a80b55a0 0x7f89a80b7a60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89bc1087f0 0x7f89bc06df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 --2- 172.21.15.19:0/2763914567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc102de0 0x7f89bc06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 >> 172.21.15.19:0/2763914567 conn(0x7f89bc0fe870 msgr2=0x7f89bc100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 shutdown_connections 2024-09-11T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:04.937+0000 7f89c32bb640 1 -- 172.21.15.19:0/2763914567 wait complete. 2024-09-11T00:04:05.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:05 smithi019 ceph-mon[30859]: pgmap v372: 97 pgs: 97 active+clean; 69 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 97 op/s 2024-09-11T00:04:05.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:05 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:04:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:05 smithi131 ceph-mon[35491]: pgmap v372: 97 pgs: 97 active+clean; 69 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 97 op/s 2024-09-11T00:04:06.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:05 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:04:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:05 smithi135 ceph-mon[35432]: pgmap v372: 97 pgs: 97 active+clean; 69 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 97 op/s 2024-09-11T00:04:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:05 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:04:06.735 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:04:06.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:04:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 -- 172.21.15.19:0/2821929613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 msgr2=0x7f2b10107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 --2- 172.21.15.19:0/2821929613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b10107ae0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009900 tx=0x7f2b0402a410 comp rx=0 tx=0).stop 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 -- 172.21.15.19:0/2821929613 shutdown_connections 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 --2- 172.21.15.19:0/2821929613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b10108020 0x7f2b1010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 --2- 172.21.15.19:0/2821929613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b10107ae0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 --2- 172.21.15.19:0/2821929613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b10101c90 0x7f2b10102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 -- 172.21.15.19:0/2821929613 >> 172.21.15.19:0/2821929613 conn(0x7f2b100fd700 msgr2=0x7f2b100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 -- 172.21.15.19:0/2821929613 shutdown_connections 2024-09-11T00:04:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.618+0000 7f2b1541e640 1 -- 172.21.15.19:0/2821929613 wait complete. 2024-09-11T00:04:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 Processor -- start 2024-09-11T00:04:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 -- start start 2024-09-11T00:04:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b10101c90 0x7f2b10199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b101997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b10108020 0x7f2b1019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10111ce0 con 0x7f2b101076a0 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10111b60 con 0x7f2b10108020 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b1541e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10111e60 con 0x7f2b10101c90 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b101997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b10101c90 0x7f2b10199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b101997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54928/0 (socket says 172.21.15.19:54928) 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/232981786 learned_addr learned my addr 172.21.15.19:0/232981786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.619+0000 7f2b0f7fe640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b10108020 0x7f2b1019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/232981786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b10101c90 msgr2=0x7f2b10199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b10101c90 0x7f2b10199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/232981786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b10108020 msgr2=0x7f2b1019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b10108020 0x7f2b1019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/232981786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1019f320 con 0x7f2b101076a0 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0f7fe640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b10108020 0x7f2b1019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0effd640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b10101c90 0x7f2b10199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b101997b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005940 tx=0x7f2b04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2af7fff640 1 -- 172.21.15.19:0/232981786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0403f030 con 0x7f2b101076a0 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1019f5b0 con 0x7f2b101076a0 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2af7fff640 1 -- 172.21.15.19:0/232981786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b04003aa0 con 0x7f2b101076a0 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2af7fff640 1 -- 172.21.15.19:0/232981786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04035070 con 0x7f2b101076a0 2024-09-11T00:04:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.620+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b101a5cd0 con 0x7f2b101076a0 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 Processor -- start 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2af7fff640 1 -- 172.21.15.19:0/232981786 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f2b04003c50 con 0x7f2b101076a0 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 -- start start 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d965ee0 0x55d36d9662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d976660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d976ba0 0x55d36d978f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d36d8dce60 con 0x55d36d976ba0 2024-09-11T00:04:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d36d8cc290 con 0x55d36d965ee0 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.623+0000 7f2b177f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d36d8d00a0 con 0x55d36d966800 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d976ba0 0x55d36d978f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d976660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d976660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56734/0 (socket says 172.21.15.19:56734) 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 -- 172.21.15.19:0/1743316312 learned_addr learned my addr 172.21.15.19:0/1743316312 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0f7fe640 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d965ee0 0x55d36d9662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 -- 172.21.15.19:0/1743316312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d965ee0 msgr2=0x55d36d9662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d965ee0 0x55d36d9662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 -- 172.21.15.19:0/1743316312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d976ba0 msgr2=0x55d36d978f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d976ba0 0x55d36d978f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 -- 172.21.15.19:0/1743316312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36d62a930 con 0x55d36d966800 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2af7fff640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2af80b5450 0x7f2af80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0effd640 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d976660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b000115f0 tx=0x7f2b00011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55df0c8775e45459 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2b0f7fe640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2af80b5450 0x7f2af80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2af7fff640 1 -- 172.21.15.19:0/232981786 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2b041066d0 con 0x7f2b101076a0 2024-09-11T00:04:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2af57fa640 1 -- 172.21.15.19:0/1743316312 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0001e070 con 0x55d36d966800 2024-09-11T00:04:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2af57fa640 1 -- 172.21.15.19:0/1743316312 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0000faf0 con 0x55d36d966800 2024-09-11T00:04:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.624+0000 7f2af57fa640 1 -- 172.21.15.19:0/1743316312 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00019b40 con 0x55d36d966800 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 -- 172.21.15.19:0/1743316312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 msgr2=0x55d36d976660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b0f7fe640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2af80b5450 0x7f2af80b7910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b08005fd0 tx=0x7f2b08009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d976660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b000115f0 tx=0x7f2b00011ab0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 -- 172.21.15.19:0/1743316312 shutdown_connections 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d976ba0 0x55d36d978f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d976660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1743316312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d965ee0 0x55d36d9662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 -- 172.21.15.19:0/1743316312 >> 172.21.15.19:0/1743316312 conn(0x55d36d963d10 msgr2=0x55d36d964eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 -- 172.21.15.19:0/1743316312 shutdown_connections 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.625+0000 7f2b177f3740 1 -- 172.21.15.19:0/1743316312 wait complete. 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 -- start start 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 Processor -- start 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d965ee0 0x55d36d973b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d974070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d9745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d36d72d890 con 0x55d36d965ee0 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d36d866d40 con 0x55d36d976ba0 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d36d979850 con 0x55d36d966800 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d965ee0 0x55d36d973b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b177f3740 10 client.0 _ll_register_callbacks cb 0x55d36d8cac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d965ee0 0x55d36d973b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54952/0 (socket says 172.21.15.19:54952) 2024-09-11T00:04:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 -- 172.21.15.19:0/226358583 learned_addr learned my addr 172.21.15.19:0/226358583 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d974070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0f7fe640 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d9745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 -- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 msgr2=0x55d36d974070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d974070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 -- 172.21.15.19:0/226358583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 msgr2=0x55d36d9745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d9745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.626+0000 7f2b0effd640 1 -- 172.21.15.19:0/226358583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d36d982bb0 con 0x55d36d965ee0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2b0effd640 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d965ee0 0x55d36d973b30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2b00011fb0 tx=0x7f2b00019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc33bea4e1875f87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2af2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2af2ff5640 1 -- 172.21.15.19:0/226358583 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0001e040 con 0x55d36d965ee0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2af2ff5640 1 -- 172.21.15.19:0/226358583 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2b0000f780 con 0x55d36d965ee0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b0000faf0 con 0x55d36d965ee0 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2af2ff5640 1 -- 172.21.15.19:0/226358583 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b00019880 con 0x55d36d965ee0 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2b177f3740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d36d985560 con 0x55d36d965ee0 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2af2ff5640 1 -- 172.21.15.19:0/226358583 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0000faf0 con 0x55d36d965ee0 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.627+0000 7f2af2ff5640 1 -- 172.21.15.19:0/226358583 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f2b00021070 con 0x55d36d965ee0 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b177f3740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b177f3740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b177f3740 20 client.15684 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b177f3740 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d986d40 0x55d36d9891c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b177f3740 4 client.15684 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d36d8dedb0 con 0x55d36d986d40 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d986d40 0x55d36d9891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d986d40 0x55d36d9891c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe5fb55e817d9fe0 server_cookie=a101f0ca08c9aabc in_seq=0 out_seq=0 2024-09-11T00:04:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.628+0000 7f2af2ff5640 10 client.15684 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2af2ff5640 1 -- 172.21.15.19:0/226358583 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d36d8dedb0 con 0x55d36d986d40 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2af2ff5640 10 client.15684 handle_command_reply: tid=0 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 client.15684 shutdown 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d965ee0 msgr2=0x55d36d973b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d965ee0 0x55d36d973b30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2b00011fb0 tx=0x7f2b00019640 comp rx=0 tx=0).stop 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 shutdown_connections 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d9745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d966800 0x55d36d974070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d986d40 0x55d36d9891c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 --2- 172.21.15.19:0/226358583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d965ee0 0x55d36d973b30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2af2ff5640 0 client.15684 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 >> 172.21.15.19:0/226358583 conn(0x55d36d963d10 msgr2=0x55d36d962f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 shutdown_connections 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 1 -- 172.21.15.19:0/226358583 wait complete. 2024-09-11T00:04:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.629+0000 7f2b177f3740 20 client.15684 trim_cache size 0 max 16384 2024-09-11T00:04:07.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.647+0000 7f2b177f3740 1 Processor -- start 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.647+0000 7f2b177f3740 1 -- start start 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d974030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d974570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d98ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b177f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101aebb0 con 0x55d36d966800 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b177f3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101ac450 con 0x55d36d976ba0 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b177f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101aa2c0 con 0x55d36d965ee0 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d974570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d974570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54958/0 (socket says 172.21.15.19:54958) 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/1610803695 learned_addr learned my addr 172.21.15.19:0/1610803695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0effd640 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d974030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0f7fe640 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d98ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/1610803695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 msgr2=0x55d36d974030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d974030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/1610803695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 msgr2=0x55d36d98ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d98ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 -- 172.21.15.19:0/1610803695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36d96c040 con 0x55d36d966800 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d974570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2b04103f00 tx=0x7f2b0410c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3476d0c3f7664bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2af4ff9640 1 -- 172.21.15.19:0/1610803695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04049040 con 0x55d36d966800 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2af4ff9640 1 -- 172.21.15.19:0/1610803695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b040cc6e0 con 0x55d36d966800 2024-09-11T00:04:07.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.648+0000 7f2af4ff9640 1 -- 172.21.15.19:0/1610803695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b040c8340 con 0x55d36d966800 2024-09-11T00:04:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 -- 172.21.15.19:0/1610803695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 msgr2=0x55d36d974570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d974570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2b04103f00 tx=0x7f2b0410c550 comp rx=0 tx=0).stop 2024-09-11T00:04:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 -- 172.21.15.19:0/1610803695 shutdown_connections 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d98ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d974570 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 --2- 172.21.15.19:0/1610803695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d974030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 -- 172.21.15.19:0/1610803695 >> 172.21.15.19:0/1610803695 conn(0x55d36d963d10 msgr2=0x55d36d975930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 -- 172.21.15.19:0/1610803695 shutdown_connections 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.649+0000 7f2b177f3740 1 -- 172.21.15.19:0/1610803695 wait complete. 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 -- start start 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 Processor -- start 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d97eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d97f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d97bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101aa910 con 0x55d36d966800 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101abd80 con 0x55d36d976ba0 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101aafe0 con 0x55d36d965ee0 2024-09-11T00:04:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b177f3740 10 client.0 _ll_register_callbacks cb 0x7f2b0001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d97eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d97f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d97eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56772/0 (socket says 172.21.15.19:56772) 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d97f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54968/0 (socket says 172.21.15.19:54968) 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 -- 172.21.15.19:0/3477517352 learned_addr learned my addr 172.21.15.19:0/3477517352 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 -- 172.21.15.19:0/3477517352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 msgr2=0x55d36d97bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d97bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 -- 172.21.15.19:0/3477517352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 msgr2=0x55d36d97f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d97f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0effd640 1 -- 172.21.15.19:0/3477517352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d36d97f6c0 con 0x55d36d965ee0 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.650+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d97f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2b0effd640 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d97eae0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b00011fb0 tx=0x7f2b00009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fb59f933b2a1452 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2af2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:04:07.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2af2ff5640 1 -- 172.21.15.19:0/3477517352 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0001e040 con 0x55d36d965ee0 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b040cc6e0 con 0x55d36d965ee0 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2af2ff5640 1 -- 172.21.15.19:0/3477517352 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2b00019c20 con 0x55d36d965ee0 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2af2ff5640 1 -- 172.21.15.19:0/3477517352 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b00019e20 con 0x55d36d965ee0 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2b177f3740 10 client.25312 fetch_fsmap learned FSMap version 28 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d36d9f4180 con 0x55d36d965ee0 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2af2ff5640 1 -- 172.21.15.19:0/3477517352 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b040cc6e0 con 0x55d36d965ee0 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.651+0000 7f2af2ff5640 1 -- 172.21.15.19:0/3477517352 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f2b00033020 con 0x55d36d965ee0 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b177f3740 10 client.25312 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b177f3740 10 client.25312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b177f3740 20 client.25312 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b177f3740 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d9f4900 0x55d36d9f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b177f3740 4 client.25312 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d36d8da860 con 0x55d36d9f4900 2024-09-11T00:04:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d9f4900 0x55d36d9f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2b0e7fc640 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d9f4900 0x55d36d9f6d20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9055b6cd95545f7f server_cookie=255a056a5ccb7840 in_seq=0 out_seq=0 2024-09-11T00:04:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.652+0000 7f2af2ff5640 10 client.25312 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2af2ff5640 1 -- 172.21.15.19:0/3477517352 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d36d8da860 con 0x55d36d9f4900 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2af2ff5640 10 client.25312 handle_command_reply: tid=0 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 client.25312 shutdown 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 msgr2=0x55d36d97eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d97eae0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b00011fb0 tx=0x7f2b00009f60 comp rx=0 tx=0).stop 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 shutdown_connections 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d36d976ba0 0x55d36d97bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d36d9f4900 0x55d36d9f6d20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d36d966800 0x55d36d97f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 --2- 172.21.15.19:0/3477517352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d36d965ee0 0x55d36d97eae0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 >> 172.21.15.19:0/3477517352 conn(0x55d36d963d10 msgr2=0x55d36d981a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:07.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2af2ff5640 0 client.25312 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.654+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 shutdown_connections 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b177f3740 1 -- 172.21.15.19:0/3477517352 wait complete. 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b177f3740 20 client.25312 trim_cache size 0 max 16384 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "7676f127-f423-4df3-b15f-9c1b06a8392e", 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:04:07.659 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2af80b5450 msgr2=0x7f2af80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2af80b5450 0x7f2af80b7910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b08005fd0 tx=0x7f2b08009800 comp rx=0 tx=0).stop 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 msgr2=0x7f2b101997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b101997b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005940 tx=0x7f2b04004270 comp rx=0 tx=0).stop 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 shutdown_connections 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b10108020 0x7f2b1019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2af80b5450 0x7f2af80b7910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b101076a0 0x7f2b101997b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 --2- 172.21.15.19:0/232981786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b10101c90 0x7f2b10199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.655+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 >> 172.21.15.19:0/232981786 conn(0x7f2b100fd700 msgr2=0x7f2b1006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.656+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 shutdown_connections 2024-09-11T00:04:07.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:07.656+0000 7f2b1541e640 1 -- 172.21.15.19:0/232981786 wait complete. 2024-09-11T00:04:07.977 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:07 smithi135 ceph-mon[35432]: pgmap v373: 97 pgs: 97 active+clean; 73 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 95 op/s 2024-09-11T00:04:08.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:07 smithi019 ceph-mon[30859]: pgmap v373: 97 pgs: 97 active+clean; 73 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 95 op/s 2024-09-11T00:04:08.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:07 smithi131 ceph-mon[35491]: pgmap v373: 97 pgs: 97 active+clean; 73 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 95 op/s 2024-09-11T00:04:08.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:04:08.662 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:08.985 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:08 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:04:08.985 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:08 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:08.985 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:08 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:04:08.985 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:08 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:04:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:08 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:04:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:08 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:08 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:04:09.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:08 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:04:09.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:08 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:04:09.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:08 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:09.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:08 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:04:09.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:08 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:04:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.292+0000 7f8040a61640 1 -- 172.21.15.19:0/890426458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10a150 msgr2=0x7f803c10a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.292+0000 7f8040a61640 1 --2- 172.21.15.19:0/890426458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10a150 0x7f803c10a530 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8030009860 tx=0x7f803002a3d0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.292+0000 7f8040a61640 1 -- 172.21.15.19:0/890426458 shutdown_connections 2024-09-11T00:04:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.292+0000 7f8040a61640 1 --2- 172.21.15.19:0/890426458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f803c117e00 0x7f803c11a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.292+0000 7f8040a61640 1 --2- 172.21.15.19:0/890426458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f803c10aa70 0x7f803c1178c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.292+0000 7f8040a61640 1 --2- 172.21.15.19:0/890426458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10a150 0x7f803c10a530 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.292+0000 7f8040a61640 1 -- 172.21.15.19:0/890426458 >> 172.21.15.19:0/890426458 conn(0x7f803c06dfc0 msgr2=0x7f803c06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.293+0000 7f8040a61640 1 -- 172.21.15.19:0/890426458 shutdown_connections 2024-09-11T00:04:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.293+0000 7f8040a61640 1 -- 172.21.15.19:0/890426458 wait complete. 2024-09-11T00:04:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 Processor -- start 2024-09-11T00:04:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 -- start start 2024-09-11T00:04:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f803c10a150 0x7f803c116b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10aa70 0x7f803c1170b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f803c117e00 0x7f803c077390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10ee00 con 0x7f803c10aa70 2024-09-11T00:04:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10ec80 con 0x7f803c117e00 2024-09-11T00:04:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.294+0000 7f8040a61640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10ef80 con 0x7f803c10a150 2024-09-11T00:04:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.295+0000 7f8039d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10aa70 0x7f803c1170b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.295+0000 7f8039d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10aa70 0x7f803c1170b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54988/0 (socket says 172.21.15.19:54988) 2024-09-11T00:04:09.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.295+0000 7f8039d9b640 1 -- 172.21.15.19:0/2382842946 learned_addr learned my addr 172.21.15.19:0/2382842946 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:09.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.295+0000 7f803a59c640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f803c10a150 0x7f803c116b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.296+0000 7f803ad9d640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f803c117e00 0x7f803c077390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.297+0000 7f8039d9b640 1 -- 172.21.15.19:0/2382842946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f803c10a150 msgr2=0x7f803c116b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.297+0000 7f8039d9b640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f803c10a150 0x7f803c116b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.297+0000 7f8039d9b640 1 -- 172.21.15.19:0/2382842946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f803c117e00 msgr2=0x7f803c077390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.297+0000 7f8039d9b640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f803c117e00 0x7f803c077390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.297+0000 7f8039d9b640 1 -- 172.21.15.19:0/2382842946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803c077ac0 con 0x7f803c10aa70 2024-09-11T00:04:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.299+0000 7f8039d9b640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10aa70 0x7f803c1170b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f802c00d950 tx=0x7f802c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.299+0000 7f802b7fe640 1 -- 172.21.15.19:0/2382842946 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c017070 con 0x7f803c10aa70 2024-09-11T00:04:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.299+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803c077db0 con 0x7f803c10aa70 2024-09-11T00:04:09.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.299+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f803c0782f0 con 0x7f803c10aa70 2024-09-11T00:04:09.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.299+0000 7f802b7fe640 1 -- 172.21.15.19:0/2382842946 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f802c009c30 con 0x7f803c10aa70 2024-09-11T00:04:09.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.299+0000 7f802b7fe640 1 -- 172.21.15.19:0/2382842946 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c00f620 con 0x7f803c10aa70 2024-09-11T00:04:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.305+0000 7f802b7fe640 1 -- 172.21.15.19:0/2382842946 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f802c00f7c0 con 0x7f803c10aa70 2024-09-11T00:04:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.308+0000 7f802b7fe640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80240b5650 0x7f80240b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.308+0000 7f802b7fe640 1 -- 172.21.15.19:0/2382842946 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f802c0e59f0 con 0x7f803c10aa70 2024-09-11T00:04:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.309+0000 7f8042e36740 1 Processor -- start 2024-09-11T00:04:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.310+0000 7f803a59c640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80240b5650 0x7f80240b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.311+0000 7f803a59c640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80240b5650 0x7f80240b7b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f80300095f0 tx=0x7f8030005b20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.311+0000 7f8042e36740 1 -- start start 2024-09-11T00:04:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.311+0000 7f8042e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9ab480 0x55ddfa9ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.312+0000 7f8042e36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.312+0000 7f8042e36740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9ba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.312+0000 7f8042e36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ddfa921e50 con 0x55ddfa9abda0 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.312+0000 7f8042e36740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ddfa911280 con 0x55ddfa9b7d30 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.312+0000 7f8042e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ddfa915090 con 0x55ddfa9ab480 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9ba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9ab480 0x55ddfa9ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9ba120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54254/0 (socket says 172.21.15.19:54254) 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 -- 172.21.15.19:0/1959156776 learned_addr learned my addr 172.21.15.19:0/1959156776 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 -- 172.21.15.19:0/1959156776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9ab480 msgr2=0x55ddfa9ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 --2- 172.21.15.19:0/1959156776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9ab480 0x55ddfa9ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 -- 172.21.15.19:0/1959156776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 msgr2=0x55ddfa9b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 --2- 172.21.15.19:0/1959156776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.313+0000 7f803ad9d640 1 -- 172.21.15.19:0/1959156776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfa66f650 con 0x55ddfa9b7d30 2024-09-11T00:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.314+0000 7f803ad9d640 1 --2- 172.21.15.19:0/1959156776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9ba120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8034009fd0 tx=0x7f8034010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a021167d395ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.315+0000 7f8028ff9640 1 -- 172.21.15.19:0/1959156776 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034011700 con 0x55ddfa9b7d30 2024-09-11T00:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.315+0000 7f8028ff9640 1 -- 172.21.15.19:0/1959156776 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8034011d50 con 0x55ddfa9b7d30 2024-09-11T00:04:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.315+0000 7f8028ff9640 1 -- 172.21.15.19:0/1959156776 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803401a380 con 0x55ddfa9b7d30 2024-09-11T00:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.316+0000 7f8042e36740 1 -- 172.21.15.19:0/1959156776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 msgr2=0x55ddfa9ba120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.316+0000 7f8042e36740 1 --2- 172.21.15.19:0/1959156776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9ba120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8034009fd0 tx=0x7f8034010860 comp rx=0 tx=0).stop 2024-09-11T00:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.316+0000 7f8042e36740 1 -- 172.21.15.19:0/1959156776 shutdown_connections 2024-09-11T00:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.316+0000 7f8042e36740 1 --2- 172.21.15.19:0/1959156776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9ba120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.316+0000 7f8042e36740 1 --2- 172.21.15.19:0/1959156776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.316+0000 7f8042e36740 1 --2- 172.21.15.19:0/1959156776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9ab480 0x55ddfa9ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.317+0000 7f8042e36740 1 -- 172.21.15.19:0/1959156776 >> 172.21.15.19:0/1959156776 conn(0x55ddfa9a92b0 msgr2=0x55ddfa9aa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.319+0000 7f8042e36740 1 -- 172.21.15.19:0/1959156776 shutdown_connections 2024-09-11T00:04:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.319+0000 7f8042e36740 1 -- 172.21.15.19:0/1959156776 wait complete. 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.319+0000 7f8042e36740 1 -- start start 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.319+0000 7f8042e36740 1 Processor -- start 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.320+0000 7f8042e36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9ab480 0x55ddfa9b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.320+0000 7f8042e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.320+0000 7f8042e36740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.320+0000 7f8042e36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ddfa772700 con 0x55ddfa9ab480 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.320+0000 7f8042e36740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ddfa8ac110 con 0x55ddfa9b7d30 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.320+0000 7f8042e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ddfa9ba9b0 con 0x55ddfa9abda0 2024-09-11T00:04:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.320+0000 7f8042e36740 10 client.0 _ll_register_callbacks cb 0x55ddfa8c5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.321+0000 7f8039d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.321+0000 7f803ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.321+0000 7f803ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54260/0 (socket says 172.21.15.19:54260) 2024-09-11T00:04:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.321+0000 7f803ad9d640 1 -- 172.21.15.19:0/303477151 learned_addr learned my addr 172.21.15.19:0/303477151 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.321+0000 7f803a59c640 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9ab480 0x55ddfa9b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.322+0000 7f803ad9d640 1 -- 172.21.15.19:0/303477151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 msgr2=0x55ddfa9b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.322+0000 7f803ad9d640 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.322+0000 7f803ad9d640 1 -- 172.21.15.19:0/303477151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9ab480 msgr2=0x55ddfa9b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.322+0000 7f803ad9d640 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9ab480 0x55ddfa9b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.322+0000 7f803ad9d640 1 -- 172.21.15.19:0/303477151 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfa8d9c40 con 0x55ddfa9b7d30 2024-09-11T00:04:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.322+0000 7f803ad9d640 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f803401c8f0 tx=0x7f8034011f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34aa5e77e7977002 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.323+0000 7f8021ffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.323+0000 7f8021ffb640 1 -- 172.21.15.19:0/303477151 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034029020 con 0x55ddfa9b7d30 2024-09-11T00:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.323+0000 7f8021ffb640 1 -- 172.21.15.19:0/303477151 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8034004a40 con 0x55ddfa9b7d30 2024-09-11T00:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.323+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8034011d50 con 0x55ddfa9b7d30 2024-09-11T00:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.324+0000 7f8021ffb640 1 -- 172.21.15.19:0/303477151 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8034004c40 con 0x55ddfa9b7d30 2024-09-11T00:04:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.324+0000 7f8042e36740 10 client.25169 fetch_fsmap learned FSMap version 28 2024-09-11T00:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.324+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ddfa9c63a0 con 0x55ddfa9b7d30 2024-09-11T00:04:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.325+0000 7f8021ffb640 1 -- 172.21.15.19:0/303477151 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8034011d50 con 0x55ddfa9b7d30 2024-09-11T00:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f8021ffb640 1 -- 172.21.15.19:0/303477151 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f8034024070 con 0x55ddfa9b7d30 2024-09-11T00:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f8042e36740 10 client.25169 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f8042e36740 10 client.25169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f8042e36740 20 client.25169 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f8042e36740 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfa9c76f0 0x55ddfa9c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f8042e36740 4 client.25169 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddfa923da0 con 0x55ddfa9c76f0 2024-09-11T00:04:09.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.326+0000 7f803a59c640 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfa9c76f0 0x55ddfa9c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.329+0000 7f803a59c640 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfa9c76f0 0x55ddfa9c9ae0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdfb39a67921adb1 server_cookie=a898e776faaa19 in_seq=0 out_seq=0 2024-09-11T00:04:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.329+0000 7f8021ffb640 10 client.25169 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:09.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.330+0000 7f8021ffb640 1 -- 172.21.15.19:0/303477151 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ddfa923da0 con 0x55ddfa9c76f0 2024-09-11T00:04:09.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.331+0000 7f8021ffb640 10 client.25169 handle_command_reply: tid=0 2024-09-11T00:04:09.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.331+0000 7f8042e36740 1 client.25169 shutdown 2024-09-11T00:04:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.341+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 msgr2=0x55ddfa9b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.341+0000 7f8042e36740 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f803401c8f0 tx=0x7f8034011f70 comp rx=0 tx=0).stop 2024-09-11T00:04:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.345+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 shutdown_connections 2024-09-11T00:04:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.345+0000 7f8042e36740 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b50d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.345+0000 7f8042e36740 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.345+0000 7f8042e36740 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfa9c76f0 0x55ddfa9c9ae0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.345+0000 7f8042e36740 1 --2- 172.21.15.19:0/303477151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9ab480 0x55ddfa9b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.345+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 >> 172.21.15.19:0/303477151 conn(0x55ddfa9a92b0 msgr2=0x55ddfa9aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.345+0000 7f8021ffb640 0 client.25169 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.347+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 shutdown_connections 2024-09-11T00:04:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.347+0000 7f8042e36740 1 -- 172.21.15.19:0/303477151 wait complete. 2024-09-11T00:04:09.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.347+0000 7f8042e36740 20 client.25169 trim_cache size 0 max 16384 2024-09-11T00:04:09.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.387+0000 7f8042e36740 1 Processor -- start 2024-09-11T00:04:09.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8042e36740 1 -- start start 2024-09-11T00:04:09.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8042e36740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8042e36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8042e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8042e36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f801c010fe0 con 0x55ddfa9abda0 2024-09-11T00:04:09.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8042e36740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f801c00e880 con 0x55ddfa9ab480 2024-09-11T00:04:09.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8042e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f801c00c6d0 con 0x55ddfa9b7d30 2024-09-11T00:04:09.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8039d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8039d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55006/0 (socket says 172.21.15.19:55006) 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.388+0000 7f8039d9b640 1 -- 172.21.15.19:0/3633863474 learned_addr learned my addr 172.21.15.19:0/3633863474 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.389+0000 7f803a59c640 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.389+0000 7f803a59c640 1 -- 172.21.15.19:0/3633863474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9b7d30 msgr2=0x55ddfa9b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.389+0000 7f803a59c640 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.389+0000 7f803a59c640 1 -- 172.21.15.19:0/3633863474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 msgr2=0x55ddfa9a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.389+0000 7f803a59c640 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.389+0000 7f803a59c640 1 -- 172.21.15.19:0/3633863474 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfa9af540 con 0x55ddfa9ab480 2024-09-11T00:04:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.389+0000 7f803a59c640 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9aa9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f803002a9c0 tx=0x7f803003e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71c772b0f359771e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.392+0000 7f8023fff640 1 -- 172.21.15.19:0/3633863474 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030059070 con 0x55ddfa9ab480 2024-09-11T00:04:09.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.392+0000 7f8023fff640 1 -- 172.21.15.19:0/3633863474 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8030040070 con 0x55ddfa9ab480 2024-09-11T00:04:09.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.393+0000 7f8042e36740 1 -- 172.21.15.19:0/3633863474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 msgr2=0x55ddfa9aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.393+0000 7f8042e36740 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9aa9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f803002a9c0 tx=0x7f803003e000 comp rx=0 tx=0).stop 2024-09-11T00:04:09.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 -- 172.21.15.19:0/3633863474 shutdown_connections 2024-09-11T00:04:09.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9abda0 0x55ddfa9a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 --2- 172.21.15.19:0/3633863474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9aa9e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 -- 172.21.15.19:0/3633863474 >> 172.21.15.19:0/3633863474 conn(0x55ddfa9a92b0 msgr2=0x55ddfa9b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 -- 172.21.15.19:0/3633863474 shutdown_connections 2024-09-11T00:04:09.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 -- 172.21.15.19:0/3633863474 wait complete. 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.396+0000 7f8042e36740 1 -- start start 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 1 Processor -- start 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f801c00cd40 con 0x55ddfa9b7d30 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f801c00e1b0 con 0x55ddfa9ab480 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f801c00d410 con 0x55ddfa9abda0 2024-09-11T00:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8042e36740 10 client.0 _ll_register_callbacks cb 0x7f80340093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f803a59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f803a59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9c06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54286/0 (socket says 172.21.15.19:54286) 2024-09-11T00:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f803a59c640 1 -- 172.21.15.19:0/3855367728 learned_addr learned my addr 172.21.15.19:0/3855367728 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.397+0000 7f8039d9b640 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.398+0000 7f803a59c640 1 -- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 msgr2=0x55ddfa9cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.398+0000 7f803a59c640 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.398+0000 7f803a59c640 1 -- 172.21.15.19:0/3855367728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9b7d30 msgr2=0x55ddfa9cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:09.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.398+0000 7f803a59c640 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.398+0000 7f803a59c640 1 -- 172.21.15.19:0/3855367728 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfa9bc160 con 0x55ddfa9ab480 2024-09-11T00:04:09.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.399+0000 7f803a59c640 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9c06f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8030005d00 tx=0x7f8030030b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9f85f987ae24e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.400+0000 7f8021ffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.400+0000 7f8021ffb640 1 -- 172.21.15.19:0/3855367728 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030059070 con 0x55ddfa9ab480 2024-09-11T00:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.400+0000 7f8021ffb640 1 -- 172.21.15.19:0/3855367728 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f80300035f0 con 0x55ddfa9ab480 2024-09-11T00:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.402+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8030040070 con 0x55ddfa9ab480 2024-09-11T00:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.404+0000 7f8021ffb640 1 -- 172.21.15.19:0/3855367728 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80300044c0 con 0x55ddfa9ab480 2024-09-11T00:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.404+0000 7f8042e36740 10 client.25175 fetch_fsmap learned FSMap version 28 2024-09-11T00:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.404+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ddfaa34610 con 0x55ddfa9ab480 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8021ffb640 1 -- 172.21.15.19:0/3855367728 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8030040070 con 0x55ddfa9ab480 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8021ffb640 1 -- 172.21.15.19:0/3855367728 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f803005d400 con 0x55ddfa9ab480 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8042e36740 10 client.25175 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8042e36740 10 client.25175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8042e36740 20 client.25175 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8042e36740 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfaa34d80 0x55ddfaa371a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8042e36740 4 client.25175 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.407+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ddfa91f850 con 0x55ddfaa34d80 2024-09-11T00:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.409+0000 7f8039d9b640 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfaa34d80 0x55ddfaa371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.416+0000 7f8039d9b640 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfaa34d80 0x55ddfaa371a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f224d53557c3cc7b server_cookie=b3a10ad1d5195c26 in_seq=0 out_seq=0 2024-09-11T00:04:09.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.416+0000 7f8021ffb640 10 client.25175 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.417+0000 7f8021ffb640 1 -- 172.21.15.19:0/3855367728 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55ddfa91f850 con 0x55ddfaa34d80 2024-09-11T00:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.417+0000 7f8021ffb640 10 client.25175 handle_command_reply: tid=0 2024-09-11T00:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 client.25175 shutdown 2024-09-11T00:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 msgr2=0x55ddfa9c06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9c06f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8030005d00 tx=0x7f8030030b10 comp rx=0 tx=0).stop 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 shutdown_connections 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ddfaa34d80 0x55ddfaa371a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddfa9b7d30 0x55ddfa9cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddfa9abda0 0x55ddfa9cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 --2- 172.21.15.19:0/3855367728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddfa9ab480 0x55ddfa9c06f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 >> 172.21.15.19:0/3855367728 conn(0x55ddfa9a92b0 msgr2=0x55ddfa9ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.418+0000 7f8021ffb640 0 client.25175 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.420+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 shutdown_connections 2024-09-11T00:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.420+0000 7f8042e36740 1 -- 172.21.15.19:0/3855367728 wait complete. 2024-09-11T00:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.420+0000 7f8042e36740 20 client.25175 trim_cache size 0 max 16384 2024-09-11T00:04:09.421 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "7676f127-f423-4df3-b15f-9c1b06a8392e", 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:09.424 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80240b5650 msgr2=0x7f80240b7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80240b5650 0x7f80240b7b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f80300095f0 tx=0x7f8030005b20 comp rx=0 tx=0).stop 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10aa70 msgr2=0x7f803c1170b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10aa70 0x7f803c1170b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f802c00d950 tx=0x7f802c00de10 comp rx=0 tx=0).stop 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 shutdown_connections 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f803c117e00 0x7f803c077390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80240b5650 0x7f80240b7b10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f803c10aa70 0x7f803c1170b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 --2- 172.21.15.19:0/2382842946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f803c10a150 0x7f803c116b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 >> 172.21.15.19:0/2382842946 conn(0x7f803c06dfc0 msgr2=0x7f803c1182e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.421+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 shutdown_connections 2024-09-11T00:04:09.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:09.422+0000 7f8040a61640 1 -- 172.21.15.19:0/2382842946 wait complete. 2024-09-11T00:04:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:09 smithi019 ceph-mon[30859]: pgmap v374: 97 pgs: 97 active+clean; 76 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-09-11T00:04:10.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:09 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:09 smithi131 ceph-mon[35491]: pgmap v374: 97 pgs: 97 active+clean; 76 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-09-11T00:04:10.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:09 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:10.130 INFO:tasks.cephfs.filesystem:scrub status for tag:7676f127-f423-4df3-b15f-9c1b06a8392e - {'path': '/', 'tag': '7676f127-f423-4df3-b15f-9c1b06a8392e', 'options': 'recursive,force'} 2024-09-11T00:04:10.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:09 smithi135 ceph-mon[35432]: pgmap v374: 97 pgs: 97 active+clean; 76 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-09-11T00:04:10.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:09 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:12.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:11 smithi019 ceph-mon[30859]: pgmap v375: 97 pgs: 97 active+clean; 115 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 249 op/s 2024-09-11T00:04:12.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:11 smithi131 ceph-mon[35491]: pgmap v375: 97 pgs: 97 active+clean; 115 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 249 op/s 2024-09-11T00:04:12.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:11 smithi135 ceph-mon[35432]: pgmap v375: 97 pgs: 97 active+clean; 115 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 249 op/s 2024-09-11T00:04:13.104 INFO:tasks.workunit.client.0.smithi019.stdout: 36 305725 412 193635 234 142140 978 2024-09-11T00:04:14.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:13 smithi019 ceph-mon[30859]: pgmap v376: 97 pgs: 97 active+clean; 156 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.7 MiB/s wr, 483 op/s 2024-09-11T00:04:14.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:13 smithi131 ceph-mon[35491]: pgmap v376: 97 pgs: 97 active+clean; 156 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.7 MiB/s wr, 483 op/s 2024-09-11T00:04:14.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:13 smithi135 ceph-mon[35432]: pgmap v376: 97 pgs: 97 active+clean; 156 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.7 MiB/s wr, 483 op/s 2024-09-11T00:04:15.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:14 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:04:15.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:14 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:04:15.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:14 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:04:16.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:15 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:16.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:15 smithi019 ceph-mon[30859]: pgmap v377: 97 pgs: 97 active+clean; 174 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.8 MiB/s wr, 519 op/s 2024-09-11T00:04:16.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:15 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:16.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:15 smithi131 ceph-mon[35491]: pgmap v377: 97 pgs: 97 active+clean; 174 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.8 MiB/s wr, 519 op/s 2024-09-11T00:04:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:15 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:15 smithi135 ceph-mon[35432]: pgmap v377: 97 pgs: 97 active+clean; 174 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.8 MiB/s wr, 519 op/s 2024-09-11T00:04:18.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:17 smithi019 ceph-mon[30859]: pgmap v378: 97 pgs: 97 active+clean; 181 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 586 op/s 2024-09-11T00:04:18.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:17 smithi131 ceph-mon[35491]: pgmap v378: 97 pgs: 97 active+clean; 181 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 586 op/s 2024-09-11T00:04:18.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:17 smithi135 ceph-mon[35432]: pgmap v378: 97 pgs: 97 active+clean; 181 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 586 op/s 2024-09-11T00:04:20.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:19 smithi019 ceph-mon[30859]: pgmap v379: 97 pgs: 97 active+clean; 188 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 624 op/s 2024-09-11T00:04:20.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:19 smithi131 ceph-mon[35491]: pgmap v379: 97 pgs: 97 active+clean; 188 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 624 op/s 2024-09-11T00:04:20.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:19 smithi135 ceph-mon[35432]: pgmap v379: 97 pgs: 97 active+clean; 188 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 624 op/s 2024-09-11T00:04:21.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:20 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:21.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:20 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:21.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:20 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:22.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:21 smithi019 ceph-mon[30859]: pgmap v380: 97 pgs: 97 active+clean; 191 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 662 op/s 2024-09-11T00:04:22.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:21 smithi131 ceph-mon[35491]: pgmap v380: 97 pgs: 97 active+clean; 191 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 662 op/s 2024-09-11T00:04:22.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:21 smithi135 ceph-mon[35432]: pgmap v380: 97 pgs: 97 active+clean; 191 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 662 op/s 2024-09-11T00:04:23.105 INFO:tasks.workunit.client.0.smithi019.stdout: 36 5661 2 3533 11 4481 13 2024-09-11T00:04:24.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:23 smithi019 ceph-mon[30859]: pgmap v381: 97 pgs: 97 active+clean; 194 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-09-11T00:04:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:23 smithi131 ceph-mon[35491]: pgmap v381: 97 pgs: 97 active+clean; 194 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-09-11T00:04:24.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:23 smithi135 ceph-mon[35432]: pgmap v381: 97 pgs: 97 active+clean; 194 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-09-11T00:04:26.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:25 smithi019 ceph-mon[30859]: pgmap v382: 97 pgs: 97 active+clean; 196 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 342 op/s 2024-09-11T00:04:26.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:25 smithi131 ceph-mon[35491]: pgmap v382: 97 pgs: 97 active+clean; 196 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 342 op/s 2024-09-11T00:04:26.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:25 smithi135 ceph-mon[35432]: pgmap v382: 97 pgs: 97 active+clean; 196 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 342 op/s 2024-09-11T00:04:28.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:27 smithi019 ceph-mon[30859]: pgmap v383: 97 pgs: 97 active+clean; 200 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 283 op/s 2024-09-11T00:04:28.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:27 smithi131 ceph-mon[35491]: pgmap v383: 97 pgs: 97 active+clean; 200 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 283 op/s 2024-09-11T00:04:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:27 smithi135 ceph-mon[35432]: pgmap v383: 97 pgs: 97 active+clean; 200 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 283 op/s 2024-09-11T00:04:30.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:29 smithi019 ceph-mon[30859]: pgmap v384: 97 pgs: 97 active+clean; 200 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-09-11T00:04:30.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:29 smithi131 ceph-mon[35491]: pgmap v384: 97 pgs: 97 active+clean; 200 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-09-11T00:04:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:29 smithi135 ceph-mon[35432]: pgmap v384: 97 pgs: 97 active+clean; 200 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-09-11T00:04:31.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:30 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:04:31.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:30 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:04:31.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:30 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:04:31.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:30 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:04:31.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:30 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:04:31.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:30 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:04:32.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:31 smithi019 ceph-mon[30859]: pgmap v385: 97 pgs: 97 active+clean; 208 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2024-09-11T00:04:32.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:31 smithi131 ceph-mon[35491]: pgmap v385: 97 pgs: 97 active+clean; 208 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2024-09-11T00:04:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:31 smithi135 ceph-mon[35432]: pgmap v385: 97 pgs: 97 active+clean; 208 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2024-09-11T00:04:33.105 INFO:tasks.workunit.client.0.smithi019.stdout: 39 152868 183 96968 209 80278 439 2024-09-11T00:04:34.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:33 smithi019 ceph-mon[30859]: pgmap v386: 97 pgs: 97 active+clean; 208 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 234 op/s 2024-09-11T00:04:34.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:33 smithi131 ceph-mon[35491]: pgmap v386: 97 pgs: 97 active+clean; 208 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 234 op/s 2024-09-11T00:04:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:33 smithi135 ceph-mon[35432]: pgmap v386: 97 pgs: 97 active+clean; 208 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 234 op/s 2024-09-11T00:04:36.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:35 smithi131 ceph-mon[35491]: pgmap v387: 97 pgs: 97 active+clean; 208 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 166 op/s 2024-09-11T00:04:36.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:35 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:04:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:35 smithi135 ceph-mon[35432]: pgmap v387: 97 pgs: 97 active+clean; 208 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 166 op/s 2024-09-11T00:04:36.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:35 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:04:36.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:35 smithi019 ceph-mon[30859]: pgmap v387: 97 pgs: 97 active+clean; 208 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 166 op/s 2024-09-11T00:04:36.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:35 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:04:38.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:37 smithi131 ceph-mon[35491]: pgmap v388: 97 pgs: 97 active+clean; 221 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-11T00:04:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:37 smithi135 ceph-mon[35432]: pgmap v388: 97 pgs: 97 active+clean; 221 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-11T00:04:38.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:37 smithi019 ceph-mon[30859]: pgmap v388: 97 pgs: 97 active+clean; 221 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-11T00:04:40.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:39 smithi131 ceph-mon[35491]: pgmap v389: 97 pgs: 97 active+clean; 236 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-09-11T00:04:40.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:04:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:39 smithi135 ceph-mon[35432]: pgmap v389: 97 pgs: 97 active+clean; 236 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-09-11T00:04:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:39 smithi019 ceph-mon[30859]: pgmap v389: 97 pgs: 97 active+clean; 236 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-09-11T00:04:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 -- 172.21.15.19:0/4190262883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2841021f0 msgr2=0x7fd28410ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/4190262883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2841021f0 0x7fd28410ef40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd278009900 tx=0x7fd27802a480 comp rx=0 tx=0).stop 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 -- 172.21.15.19:0/4190262883 shutdown_connections 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/4190262883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd28410f480 0x7fd284111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/4190262883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2841021f0 0x7fd28410ef40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/4190262883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2841018d0 0x7fd284101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 -- 172.21.15.19:0/4190262883 >> 172.21.15.19:0/4190262883 conn(0x7fd2840fd780 msgr2=0x7fd2840ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:41.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 -- 172.21.15.19:0/4190262883 shutdown_connections 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.656+0000 7fd28a2b1640 1 -- 172.21.15.19:0/4190262883 wait complete. 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.657+0000 7fd28a2b1640 1 Processor -- start 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.657+0000 7fd28a2b1640 1 -- start start 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.657+0000 7fd28a2b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2841018d0 0x7fd28419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.657+0000 7fd28a2b1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2841021f0 0x7fd28419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.657+0000 7fd28a2b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd28410f480 0x7fd2841a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28a2b1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd284114ff0 con 0x7fd28410f480 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28a2b1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd284114e70 con 0x7fd2841021f0 2024-09-11T00:04:41.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28a2b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd284115170 con 0x7fd2841018d0 2024-09-11T00:04:41.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd283fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2841018d0 0x7fd28419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28884e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd28410f480 0x7fd2841a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd283fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2841018d0 0x7fd28419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42912/0 (socket says 172.21.15.19:42912) 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd283fff640 1 -- 172.21.15.19:0/3798216812 learned_addr learned my addr 172.21.15.19:0/3798216812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd2837fe640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2841021f0 0x7fd28419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28884e640 1 -- 172.21.15.19:0/3798216812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2841018d0 msgr2=0x7fd28419b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28884e640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2841018d0 0x7fd28419b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28884e640 1 -- 172.21.15.19:0/3798216812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2841021f0 msgr2=0x7fd28419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28884e640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2841021f0 0x7fd28419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.658+0000 7fd28884e640 1 -- 172.21.15.19:0/3798216812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2841a15d0 con 0x7fd28410f480 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.659+0000 7fd28884e640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd28410f480 0x7fd2841a0e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd27c005fd0 tx=0x7fd27c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.659+0000 7fd2817fa640 1 -- 172.21.15.19:0/3798216812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00cdf0 con 0x7fd28410f480 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.659+0000 7fd2817fa640 1 -- 172.21.15.19:0/3798216812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd27c005020 con 0x7fd28410f480 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.659+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2841a18c0 con 0x7fd28410f480 2024-09-11T00:04:41.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.659+0000 7fd2817fa640 1 -- 172.21.15.19:0/3798216812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c010690 con 0x7fd28410f480 2024-09-11T00:04:41.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.660+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2841a7f80 con 0x7fd28410f480 2024-09-11T00:04:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.665+0000 7fd2817fa640 1 -- 172.21.15.19:0/3798216812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fd27c005460 con 0x7fd28410f480 2024-09-11T00:04:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.666+0000 7fd28c686740 1 Processor -- start 2024-09-11T00:04:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.666+0000 7fd28c686740 1 -- start start 2024-09-11T00:04:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.666+0000 7fd28c686740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d5b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.666+0000 7fd28c686740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b9c0 0x561ac6d78420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.666+0000 7fd2817fa640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd26c0b5550 0x7fd26c0b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.666+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d5b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d5b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:59486/0 (socket says 172.21.15.19:59486) 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd283fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b9c0 0x561ac6d78420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd283fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b9c0 0x561ac6d78420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43916/0 (socket says 172.21.15.19:43916) 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd2837fe640 1 -- 172.21.15.19:0/342141699 learned_addr learned my addr 172.21.15.19:0/342141699 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd28c686740 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d78960 0x561ac6d7ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561ac6cd1e50 con 0x561ac6d5b9c0 2024-09-11T00:04:41.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561ac6cc1280 con 0x561ac6d5b0a0 2024-09-11T00:04:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ac6cc5090 con 0x561ac6d78960 2024-09-11T00:04:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd2817fa640 1 -- 172.21.15.19:0/3798216812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd27c0e6590 con 0x7fd28410f480 2024-09-11T00:04:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd2837fe640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd26c0b5550 0x7fd26c0b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.667+0000 7fd28884e640 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d78960 0x561ac6d7ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd283fff640 1 -- 172.21.15.19:0/342141699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d78960 msgr2=0x561ac6d7ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd283fff640 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d78960 0x561ac6d7ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd283fff640 1 -- 172.21.15.19:0/342141699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 msgr2=0x561ac6d5b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd283fff640 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d5b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd283fff640 1 -- 172.21.15.19:0/342141699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ac6a1f650 con 0x561ac6d5b9c0 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd2837fe640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd26c0b5550 0x7fd26c0b7a10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd278006010 tx=0x7fd278005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd283fff640 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b9c0 0x561ac6d78420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd27400bd10 tx=0x7fd2740107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a367a84f473e32c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd26a7fc640 1 -- 172.21.15.19:0/342141699 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274004030 con 0x561ac6d5b9c0 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd26a7fc640 1 -- 172.21.15.19:0/342141699 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2740041d0 con 0x561ac6d5b9c0 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.668+0000 7fd26a7fc640 1 -- 172.21.15.19:0/342141699 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274011680 con 0x561ac6d5b9c0 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.669+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b9c0 msgr2=0x561ac6d78420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.669+0000 7fd28c686740 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b9c0 0x561ac6d78420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd27400bd10 tx=0x7fd2740107a0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 shutdown_connections 2024-09-11T00:04:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d78960 0x561ac6d7ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b9c0 0x561ac6d78420 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 --2- 172.21.15.19:0/342141699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d5b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 >> 172.21.15.19:0/342141699 conn(0x561ac6d58ed0 msgr2=0x561ac6d5a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 shutdown_connections 2024-09-11T00:04:41.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 -- 172.21.15.19:0/342141699 wait complete. 2024-09-11T00:04:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.670+0000 7fd28c686740 1 -- start start 2024-09-11T00:04:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 1 Processor -- start 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d64f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6d6a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561ac6b22700 con 0x561ac6d5b0a0 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561ac6c5c110 con 0x561ac6d78960 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ac6d61750 con 0x561ac6d5b9c0 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.671+0000 7fd28c686740 10 client.0 _ll_register_callbacks cb 0x561ac6c75990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42932/0 (socket says 172.21.15.19:42932) 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 -- 172.21.15.19:0/389627051 learned_addr learned my addr 172.21.15.19:0/389627051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd28884e640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6d6a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd283fff640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d64f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 -- 172.21.15.19:0/389627051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 msgr2=0x561ac6d6a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6d6a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 -- 172.21.15.19:0/389627051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 msgr2=0x561ac6d64f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d64f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd2837fe640 1 -- 172.21.15.19:0/389627051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ac6c89c40 con 0x561ac6d5b9c0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.672+0000 7fd283fff640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d64f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd2837fe640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d654a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd27802a9a0 tx=0x7fd278046000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe26b7f8c7596fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd2637fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd2637fe640 1 -- 172.21.15.19:0/389627051 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278050070 con 0x561ac6d5b9c0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2740041d0 con 0x561ac6d5b9c0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd2637fe640 1 -- 172.21.15.19:0/389627051 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd278003800 con 0x561ac6d5b9c0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd2637fe640 1 -- 172.21.15.19:0/389627051 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd27805c050 con 0x561ac6d5b9c0 2024-09-11T00:04:41.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd28c686740 10 client.25339 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.673+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ac6d736b0 con 0x561ac6d5b9c0 2024-09-11T00:04:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd2637fe640 1 -- 172.21.15.19:0/389627051 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2740041d0 con 0x561ac6d5b9c0 2024-09-11T00:04:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd2637fe640 1 -- 172.21.15.19:0/389627051 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd278031850 con 0x561ac6d5b9c0 2024-09-11T00:04:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd28c686740 10 client.25339 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd28c686740 10 client.25339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd28c686740 20 client.25339 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd28c686740 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6d74b90 0x561ac6d77030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd28c686740 4 client.25339 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.674+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ac6cd3da0 con 0x561ac6d74b90 2024-09-11T00:04:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.675+0000 7fd283fff640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6d74b90 0x561ac6d77030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.676+0000 7fd283fff640 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6d74b90 0x561ac6d77030 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e9b39bb276ab848 server_cookie=bd7e82508343ac55 in_seq=0 out_seq=0 2024-09-11T00:04:41.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.676+0000 7fd2637fe640 10 client.25339 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd2637fe640 1 -- 172.21.15.19:0/389627051 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ac6cd3da0 con 0x561ac6d74b90 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd2637fe640 10 client.25339 handle_command_reply: tid=0 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 client.25339 shutdown 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 msgr2=0x561ac6d654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d654a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd27802a9a0 tx=0x7fd278046000 comp rx=0 tx=0).stop 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 shutdown_connections 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6d6a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d654a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6d74b90 0x561ac6d77030 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 --2- 172.21.15.19:0/389627051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d64f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 >> 172.21.15.19:0/389627051 conn(0x561ac6d58ed0 msgr2=0x561ac6d5ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd2637fe640 0 client.25339 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 shutdown_connections 2024-09-11T00:04:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.677+0000 7fd28c686740 1 -- 172.21.15.19:0/389627051 wait complete. 2024-09-11T00:04:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.678+0000 7fd28c686740 20 client.25339 trim_cache size 0 max 16384 2024-09-11T00:04:41.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 Processor -- start 2024-09-11T00:04:41.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 -- start start 2024-09-11T00:04:41.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d78960 0x561ac6d63b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2841aec50 con 0x561ac6d78960 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2841ac4c0 con 0x561ac6d5b0a0 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28c686740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2841aa370 con 0x561ac6d5b9c0 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d635c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42948/0 (socket says 172.21.15.19:42948) 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd2837fe640 1 -- 172.21.15.19:0/3556976558 learned_addr learned my addr 172.21.15.19:0/3556976558 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd28884e640 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d78960 0x561ac6d63b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd283fff640 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd2837fe640 1 -- 172.21.15.19:0/3556976558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 msgr2=0x561ac6d629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.696+0000 7fd2837fe640 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd2837fe640 1 -- 172.21.15.19:0/3556976558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d78960 msgr2=0x561ac6d63b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd2837fe640 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d78960 0x561ac6d63b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd2837fe640 1 -- 172.21.15.19:0/3556976558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ac6d5b7f0 con 0x561ac6d5b9c0 2024-09-11T00:04:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd283fff640 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd28884e640 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d78960 0x561ac6d63b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd2837fe640 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d635c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd278031e10 tx=0x7fd27804c5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=648b8c48792155d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd269ffb640 1 -- 172.21.15.19:0/3556976558 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278050040 con 0x561ac6d5b9c0 2024-09-11T00:04:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd269ffb640 1 -- 172.21.15.19:0/3556976558 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd278031950 con 0x561ac6d5b9c0 2024-09-11T00:04:41.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.697+0000 7fd269ffb640 1 -- 172.21.15.19:0/3556976558 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278035040 con 0x561ac6d5b9c0 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.698+0000 7fd28c686740 1 -- 172.21.15.19:0/3556976558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 msgr2=0x561ac6d635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.698+0000 7fd28c686740 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d635c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd278031e10 tx=0x7fd27804c5f0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 -- 172.21.15.19:0/3556976558 shutdown_connections 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d78960 0x561ac6d63b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d635c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 --2- 172.21.15.19:0/3556976558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d5b0a0 0x561ac6d629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 -- 172.21.15.19:0/3556976558 >> 172.21.15.19:0/3556976558 conn(0x561ac6d58ed0 msgr2=0x561ac6d797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 -- 172.21.15.19:0/3556976558 shutdown_connections 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 -- 172.21.15.19:0/3556976558 wait complete. 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.699+0000 7fd28c686740 1 -- start start 2024-09-11T00:04:41.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.700+0000 7fd28c686740 1 Processor -- start 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.700+0000 7fd28c686740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d70ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd283fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d70ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd283fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d70ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43936/0 (socket says 172.21.15.19:43936) 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd283fff640 1 -- 172.21.15.19:0/3943019966 learned_addr learned my addr 172.21.15.19:0/3943019966 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d71450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6da2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd2837fe640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d71450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2841aa9c0 con 0x561ac6d5b0a0 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2841abdf0 con 0x561ac6d78960 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2841ab050 con 0x561ac6d5b9c0 2024-09-11T00:04:41.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.701+0000 7fd28884e640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6da2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd28884e640 1 -- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 msgr2=0x561ac6d71450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd28884e640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d71450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd28884e640 1 -- 172.21.15.19:0/3943019966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 msgr2=0x561ac6d70ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd28884e640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d70ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd28884e640 1 -- 172.21.15.19:0/3943019966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ac6da2830 con 0x561ac6d78960 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd28c686740 10 client.0 _ll_register_callbacks cb 0x7fd278009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd278031950 con 0x561ac6d78960 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.702+0000 7fd283fff640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d70ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.703+0000 7fd28884e640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6da2000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0e3d00 tx=0x7fd27c0e42a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebbc2edff065f0b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.703+0000 7fd2637fe640 10 client.25190 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.703+0000 7fd2637fe640 1 -- 172.21.15.19:0/3943019966 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c095070 con 0x561ac6d78960 2024-09-11T00:04:41.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.703+0000 7fd2637fe640 1 -- 172.21.15.19:0/3943019966 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd27c0b5d30 con 0x561ac6d78960 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.703+0000 7fd2637fe640 1 -- 172.21.15.19:0/3943019966 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd27c0d3030 con 0x561ac6d78960 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.703+0000 7fd28c686740 10 client.25190 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.703+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561ac6d703b0 con 0x561ac6d78960 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd2637fe640 1 -- 172.21.15.19:0/3943019966 <== mon.2 v2:172.21.15.131:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd27c0e60b0 con 0x561ac6d78960 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd28c686740 10 client.25190 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd28c686740 10 client.25190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd28c686740 20 client.25190 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6e074d0 0x561ac6e098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd28c686740 4 client.25190 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561ac6ccf850 con 0x561ac6e074d0 2024-09-11T00:04:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.704+0000 7fd283fff640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6e074d0 0x561ac6e098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:41.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd2637fe640 10 client.25190 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:41.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd283fff640 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6e074d0 0x561ac6e098c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=301437ea3e759c41 server_cookie=89638c1e277c3324 in_seq=0 out_seq=0 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd2637fe640 1 -- 172.21.15.19:0/3943019966 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x561ac6ccf850 con 0x561ac6e074d0 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd2637fe640 10 client.25190 handle_command_reply: tid=0 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 client.25190 shutdown 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 msgr2=0x561ac6da2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6da2000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0e3d00 tx=0x7fd27c0e42a0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 shutdown_connections 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ac6d78960 0x561ac6da2000 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ac6d5b9c0 0x561ac6d71450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561ac6e074d0 0x561ac6e098c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd2637fe640 0 client.25190 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 --2- 172.21.15.19:0/3943019966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ac6d5b0a0 0x561ac6d70ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.705+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 >> 172.21.15.19:0/3943019966 conn(0x561ac6d58ed0 msgr2=0x561ac6d634f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.706+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 shutdown_connections 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.706+0000 7fd28c686740 1 -- 172.21.15.19:0/3943019966 wait complete. 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.706+0000 7fd28c686740 20 client.25190 trim_cache size 0 max 16384 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:41.710 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:41.711 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:41.712 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd26c0b5550 msgr2=0x7fd26c0b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd26c0b5550 0x7fd26c0b7a10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd278006010 tx=0x7fd278005b50 comp rx=0 tx=0).stop 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd28410f480 msgr2=0x7fd2841a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd28410f480 0x7fd2841a0e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd27c005fd0 tx=0x7fd27c00ef10 comp rx=0 tx=0).stop 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 shutdown_connections 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd26c0b5550 0x7fd26c0b7a10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd28410f480 0x7fd2841a0e00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2841021f0 0x7fd28419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 --2- 172.21.15.19:0/3798216812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2841018d0 0x7fd28419b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 >> 172.21.15.19:0/3798216812 conn(0x7fd2840fd780 msgr2=0x7fd284111710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 shutdown_connections 2024-09-11T00:04:41.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:41.707+0000 7fd28a2b1640 1 -- 172.21.15.19:0/3798216812 wait complete. 2024-09-11T00:04:42.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:41 smithi019 ceph-mon[30859]: pgmap v390: 97 pgs: 97 active+clean; 237 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 296 op/s 2024-09-11T00:04:42.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:41 smithi131 ceph-mon[35491]: pgmap v390: 97 pgs: 97 active+clean; 237 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 296 op/s 2024-09-11T00:04:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:41 smithi135 ceph-mon[35432]: pgmap v390: 97 pgs: 97 active+clean; 237 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 296 op/s 2024-09-11T00:04:42.692 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:04:42.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:04:42.996 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:43.106 INFO:tasks.workunit.client.0.smithi019.stdout: 52 914382 619 576655 592 466209 1549 2024-09-11T00:04:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 -- 172.21.15.19:0/3787016443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac103ca0 msgr2=0x7fceac104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 --2- 172.21.15.19:0/3787016443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac103ca0 0x7fceac104080 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009900 tx=0x7fce9c02a410 comp rx=0 tx=0).stop 2024-09-11T00:04:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 -- 172.21.15.19:0/3787016443 shutdown_connections 2024-09-11T00:04:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 --2- 172.21.15.19:0/3787016443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceac10d100 0x7fceac10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 --2- 172.21.15.19:0/3787016443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac1045c0 0x7fceac10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 --2- 172.21.15.19:0/3787016443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac103ca0 0x7fceac104080 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 -- 172.21.15.19:0/3787016443 >> 172.21.15.19:0/3787016443 conn(0x7fceac0fd700 msgr2=0x7fceac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 -- 172.21.15.19:0/3787016443 shutdown_connections 2024-09-11T00:04:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.818+0000 7fceb2621640 1 -- 172.21.15.19:0/3787016443 wait complete. 2024-09-11T00:04:43.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.819+0000 7fceb2621640 1 Processor -- start 2024-09-11T00:04:43.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.819+0000 7fceb2621640 1 -- start start 2024-09-11T00:04:43.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb2621640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac103ca0 0x7fceac199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:43.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb2621640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac1045c0 0x7fceac199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb2621640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceac10d100 0x7fceac19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb2621640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fceac112d70 con 0x7fceac1045c0 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb2621640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fceac112bf0 con 0x7fceac10d100 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb2621640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fceac112ef0 con 0x7fceac103ca0 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceab7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac1045c0 0x7fceac199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac103ca0 0x7fceac199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac103ca0 0x7fceac199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42970/0 (socket says 172.21.15.19:42970) 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 -- 172.21.15.19:0/604874053 learned_addr learned my addr 172.21.15.19:0/604874053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb0bbe640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceac10d100 0x7fceac19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 -- 172.21.15.19:0/604874053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceac10d100 msgr2=0x7fceac19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceac10d100 0x7fceac19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 -- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac1045c0 msgr2=0x7fceac199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac1045c0 0x7fceac199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 -- 172.21.15.19:0/604874053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac19f3f0 con 0x7fceac103ca0 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceb0bbe640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceac10d100 0x7fceac19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceab7fe640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac1045c0 0x7fceac199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.820+0000 7fceabfff640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac103ca0 0x7fceac199340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce9c005940 tx=0x7fce9c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.821+0000 7fcea97fa640 1 -- 172.21.15.19:0/604874053 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c03f030 con 0x7fceac103ca0 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.821+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac19f680 con 0x7fceac103ca0 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.821+0000 7fcea97fa640 1 -- 172.21.15.19:0/604874053 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce9c003aa0 con 0x7fceac103ca0 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.821+0000 7fcea97fa640 1 -- 172.21.15.19:0/604874053 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c035070 con 0x7fceac103ca0 2024-09-11T00:04:43.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.821+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac1a5da0 con 0x7fceac103ca0 2024-09-11T00:04:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.822+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceac104080 con 0x7fceac103ca0 2024-09-11T00:04:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.823+0000 7fcea97fa640 1 -- 172.21.15.19:0/604874053 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fce9c0035f0 con 0x7fceac103ca0 2024-09-11T00:04:43.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.824+0000 7fcea97fa640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fce940b5450 0x7fce940b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:43.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.824+0000 7fceab7fe640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fce940b5450 0x7fce940b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:43.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.824+0000 7fcea97fa640 1 -- 172.21.15.19:0/604874053 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fce9c106c20 con 0x7fceac103ca0 2024-09-11T00:04:43.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.825+0000 7fceab7fe640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fce940b5450 0x7fce940b7910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fceac10f820 tx=0x7fcea0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:43.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:43.827+0000 7fcea97fa640 1 -- 172.21.15.19:0/604874053 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fce9c0cd7c0 con 0x7fceac103ca0 2024-09-11T00:04:44.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:43 smithi019 ceph-mon[30859]: pgmap v391: 97 pgs: 97 active+clean; 237 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 208 op/s 2024-09-11T00:04:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:43 smithi131 ceph-mon[35491]: pgmap v391: 97 pgs: 97 active+clean; 237 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 208 op/s 2024-09-11T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.158+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fceac1081a0 con 0x7fceac103ca0 2024-09-11T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.161+0000 7fcea97fa640 1 -- 172.21.15.19:0/604874053 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7fce9c0cd0c0 con 0x7fceac103ca0 2024-09-11T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":29,"btime":"2024-09-11T00:04:34:770004+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:04:34.651361+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:04:44.166 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 29 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fce940b5450 msgr2=0x7fce940b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fce940b5450 0x7fce940b7910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fceac10f820 tx=0x7fcea0005f90 comp rx=0 tx=0).stop 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac103ca0 msgr2=0x7fceac199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac103ca0 0x7fceac199340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce9c005940 tx=0x7fce9c004270 comp rx=0 tx=0).stop 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 shutdown_connections 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fceac10d100 0x7fceac19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fce940b5450 0x7fce940b7910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fceac1045c0 0x7fceac199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 --2- 172.21.15.19:0/604874053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac103ca0 0x7fceac199340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 >> 172.21.15.19:0/604874053 conn(0x7fceac0fd700 msgr2=0x7fceac0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:44.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 shutdown_connections 2024-09-11T00:04:44.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:44.168+0000 7fceb2621640 1 -- 172.21.15.19:0/604874053 wait complete. 2024-09-11T00:04:44.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:43 smithi135 ceph-mon[35432]: pgmap v391: 97 pgs: 97 active+clean; 237 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 208 op/s 2024-09-11T00:04:45.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:44 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/604874053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:45.054 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:44 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/604874053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:45.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:04:45.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:44 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/604874053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:45.346 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 -- 172.21.15.19:0/3091925922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c10d100 msgr2=0x7fc50c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 --2- 172.21.15.19:0/3091925922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c10d100 0x7fc50c10f560 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc504009ca0 tx=0x7fc50402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 -- 172.21.15.19:0/3091925922 shutdown_connections 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 --2- 172.21.15.19:0/3091925922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c10d100 0x7fc50c10f560 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 --2- 172.21.15.19:0/3091925922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc50c1045c0 0x7fc50c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 --2- 172.21.15.19:0/3091925922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc50c103ca0 0x7fc50c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 -- 172.21.15.19:0/3091925922 >> 172.21.15.19:0/3091925922 conn(0x7fc50c0fd700 msgr2=0x7fc50c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 -- 172.21.15.19:0/3091925922 shutdown_connections 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.840+0000 7fc51316e640 1 -- 172.21.15.19:0/3091925922 wait complete. 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 Processor -- start 2024-09-11T00:04:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 -- start start 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c103ca0 0x7fc50c10bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc50c1045c0 0x7fc50c10c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc50c10d100 0x7fc50c1a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c112dc0 con 0x7fc50c103ca0 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c112c40 con 0x7fc50c10d100 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc51316e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c112f40 con 0x7fc50c1045c0 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c103ca0 0x7fc50c10bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c103ca0 0x7fc50c10bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43978/0 (socket says 172.21.15.19:43978) 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc510f0a640 1 -- 172.21.15.19:0/1016970706 learned_addr learned my addr 172.21.15.19:0/1016970706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.841+0000 7fc50bfff640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc50c1045c0 0x7fc50c10c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc51170b640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc50c10d100 0x7fc50c1a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc510f0a640 1 -- 172.21.15.19:0/1016970706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc50c1045c0 msgr2=0x7fc50c10c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc510f0a640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc50c1045c0 0x7fc50c10c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc510f0a640 1 -- 172.21.15.19:0/1016970706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc50c10d100 msgr2=0x7fc50c1a5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc510f0a640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc50c10d100 0x7fc50c1a5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc510f0a640 1 -- 172.21.15.19:0/1016970706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c1a5930 con 0x7fc50c103ca0 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc50bfff640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc50c1045c0 0x7fc50c10c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc510f0a640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c103ca0 0x7fc50c10bd70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc50000e9f0 tx=0x7fc50000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.842+0000 7fc509ffb640 1 -- 172.21.15.19:0/1016970706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50000cd80 con 0x7fc50c103ca0 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.843+0000 7fc509ffb640 1 -- 172.21.15.19:0/1016970706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5000054d0 con 0x7fc50c103ca0 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.843+0000 7fc509ffb640 1 -- 172.21.15.19:0/1016970706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500010690 con 0x7fc50c103ca0 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.843+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c1a5c20 con 0x7fc50c103ca0 2024-09-11T00:04:45.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.843+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c1ac2e0 con 0x7fc50c103ca0 2024-09-11T00:04:45.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.848+0000 7fc509ffb640 1 -- 172.21.15.19:0/1016970706 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fc500004e90 con 0x7fc50c103ca0 2024-09-11T00:04:45.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 Processor -- start 2024-09-11T00:04:45.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 -- start start 2024-09-11T00:04:45.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920cfd4d0 0x559920cfd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d09840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920d09d80 0x559920d0c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559920c73ea0 con 0x559920d09d80 2024-09-11T00:04:45.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559920c632d0 con 0x559920cfd4d0 2024-09-11T00:04:45.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.849+0000 7fc515543740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559920c670e0 con 0x559920cfddf0 2024-09-11T00:04:45.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.850+0000 7fc50bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920d09d80 0x559920d0c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.850+0000 7fc50bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920d09d80 0x559920d0c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43984/0 (socket says 172.21.15.19:43984) 2024-09-11T00:04:45.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.850+0000 7fc50bfff640 1 -- 172.21.15.19:0/74809011 learned_addr learned my addr 172.21.15.19:0/74809011 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:45.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.850+0000 7fc51170b640 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920cfd4d0 0x559920cfd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.850+0000 7fc510f0a640 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d09840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.850+0000 7fc509ffb640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4fc0b54d0 0x7fc4fc0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.851+0000 7fc50bfff640 1 -- 172.21.15.19:0/74809011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 msgr2=0x559920d09840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:45.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.851+0000 7fc50bfff640 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d09840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.851+0000 7fc50bfff640 1 -- 172.21.15.19:0/74809011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920cfd4d0 msgr2=0x559920cfd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:45.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.851+0000 7fc50bfff640 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920cfd4d0 0x559920cfd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.851+0000 7fc50bfff640 1 -- 172.21.15.19:0/74809011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599209c1650 con 0x559920d09d80 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.851+0000 7fc51170b640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4fc0b54d0 0x7fc4fc0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.851+0000 7fc50bfff640 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920d09d80 0x559920d0c170 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800bc10 tx=0x7fc4f800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14ef92b6a58b043 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.852+0000 7fc4f6ffd640 1 -- 172.21.15.19:0/74809011 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8004230 con 0x559920d09d80 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.852+0000 7fc4f6ffd640 1 -- 172.21.15.19:0/74809011 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4f80043d0 con 0x559920d09d80 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.852+0000 7fc4f6ffd640 1 -- 172.21.15.19:0/74809011 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8017890 con 0x559920d09d80 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.852+0000 7fc509ffb640 1 -- 172.21.15.19:0/1016970706 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc5000e64b0 con 0x7fc50c103ca0 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.853+0000 7fc515543740 1 -- 172.21.15.19:0/74809011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920d09d80 msgr2=0x559920d0c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.853+0000 7fc515543740 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920d09d80 0x559920d0c170 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800bc10 tx=0x7fc4f800d710 comp rx=0 tx=0).stop 2024-09-11T00:04:45.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.853+0000 7fc51170b640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4fc0b54d0 0x7fc4fc0b7990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc504005fe0 tx=0x7fc50402a8c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 -- 172.21.15.19:0/74809011 shutdown_connections 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920d09d80 0x559920d0c170 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d09840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 --2- 172.21.15.19:0/74809011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920cfd4d0 0x559920cfd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 -- 172.21.15.19:0/74809011 >> 172.21.15.19:0/74809011 conn(0x559920cfb300 msgr2=0x559920cfc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 -- 172.21.15.19:0/74809011 shutdown_connections 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 -- 172.21.15.19:0/74809011 wait complete. 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 -- start start 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.854+0000 7fc515543740 1 Processor -- start 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc515543740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d09640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc515543740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d06a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc515543740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d07070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc515543740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559920ac4700 con 0x559920cfd4d0 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc515543740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559920bfe160 con 0x559920d09d80 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc515543740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559920d0ca00 con 0x559920cfddf0 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc515543740 10 client.0 _ll_register_callbacks cb 0x559920c179e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d09640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d09640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43998/0 (socket says 172.21.15.19:43998) 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc510f0a640 1 -- 172.21.15.19:0/223642091 learned_addr learned my addr 172.21.15.19:0/223642091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.855+0000 7fc50bfff640 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d06a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc51170b640 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d07070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc50bfff640 1 -- 172.21.15.19:0/223642091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 msgr2=0x559920d07070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc50bfff640 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d07070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc50bfff640 1 -- 172.21.15.19:0/223642091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 msgr2=0x559920d09640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc50bfff640 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d09640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc50bfff640 1 -- 172.21.15.19:0/223642091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559920c2bc90 con 0x559920cfddf0 2024-09-11T00:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc50bfff640 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d06a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800bc10 tx=0x7fc4f800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18dd76db83d7091b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:45.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc4ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc4ebfff640 1 -- 172.21.15.19:0/223642091 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8003a00 con 0x559920cfddf0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4f80043d0 con 0x559920cfddf0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.856+0000 7fc4ebfff640 1 -- 172.21.15.19:0/223642091 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc4f8017510 con 0x559920cfddf0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc4ebfff640 1 -- 172.21.15.19:0/223642091 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc4f8003ba0 con 0x559920cfddf0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 10 client.25360 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559920d18300 con 0x559920cfddf0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc4ebfff640 1 -- 172.21.15.19:0/223642091 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4f80043d0 con 0x559920cfddf0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc4ebfff640 1 -- 172.21.15.19:0/223642091 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc4f802a8c0 con 0x559920cfddf0 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 10 client.25360 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 10 client.25360 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 20 client.25360 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:45.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d1ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 4 client.25360 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.857+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559920c75df0 con 0x559920d19650 2024-09-11T00:04:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.858+0000 7fc510f0a640 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d1ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.858+0000 7fc4ebfff640 10 client.25360 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:45.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.858+0000 7fc510f0a640 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d1ba40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0b9e02953731d07 server_cookie=d33c67e278a25823 in_seq=0 out_seq=0 2024-09-11T00:04:45.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.863+0000 7fc4ebfff640 1 -- 172.21.15.19:0/223642091 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559920c75df0 con 0x559920d19650 2024-09-11T00:04:45.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.863+0000 7fc4ebfff640 10 client.25360 handle_command_reply: tid=0 2024-09-11T00:04:45.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.863+0000 7fc515543740 1 client.25360 shutdown 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.863+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 msgr2=0x559920d06a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.863+0000 7fc515543740 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d06a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800bc10 tx=0x7fc4f800b960 comp rx=0 tx=0).stop 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 shutdown_connections 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d1ba40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc4ebfff640 0 client.25360 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d07070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d06a90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 --2- 172.21.15.19:0/223642091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d09640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 >> 172.21.15.19:0/223642091 conn(0x559920cfb300 msgr2=0x559920d00e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 shutdown_connections 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 1 -- 172.21.15.19:0/223642091 wait complete. 2024-09-11T00:04:45.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.864+0000 7fc515543740 20 client.25360 trim_cache size 0 max 16384 2024-09-11T00:04:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.893+0000 7fc515543740 1 Processor -- start 2024-09-11T00:04:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.893+0000 7fc515543740 1 -- start start 2024-09-11T00:04:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc515543740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfd4d0 0x559920cfac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc515543740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfddf0 0x559920d05310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc515543740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d05850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc515543740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c1bfd20 con 0x559920cfddf0 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc515543740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c1bd5e0 con 0x559920d09d80 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc515543740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c104080 con 0x559920cfd4d0 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfd4d0 0x559920cfac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfd4d0 0x559920cfac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43016/0 (socket says 172.21.15.19:43016) 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 -- 172.21.15.19:0/2060746737 learned_addr learned my addr 172.21.15.19:0/2060746737 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc51170b640 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d05850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 -- 172.21.15.19:0/2060746737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 msgr2=0x559920d05850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d05850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 -- 172.21.15.19:0/2060746737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfddf0 msgr2=0x559920d05310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:04:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfddf0 0x559920d05310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 -- 172.21.15.19:0/2060746737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559920cfdc20 con 0x559920cfd4d0 2024-09-11T00:04:45.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.894+0000 7fc510f0a640 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfd4d0 0x559920cfac10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc50000c6a0 tx=0x7fc500004a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d654b1a34b652e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.895+0000 7fc4f67fc640 1 -- 172.21.15.19:0/2060746737 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000a80c0 con 0x559920cfd4d0 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.895+0000 7fc4f67fc640 1 -- 172.21.15.19:0/2060746737 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5000ac460 con 0x559920cfd4d0 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.895+0000 7fc4f67fc640 1 -- 172.21.15.19:0/2060746737 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000b5ee0 con 0x559920cfd4d0 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 -- 172.21.15.19:0/2060746737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfd4d0 msgr2=0x559920cfac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfd4d0 0x559920cfac10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc50000c6a0 tx=0x7fc500004a90 comp rx=0 tx=0).stop 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 -- 172.21.15.19:0/2060746737 shutdown_connections 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d05850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfddf0 0x559920d05310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 --2- 172.21.15.19:0/2060746737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfd4d0 0x559920cfac10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 -- 172.21.15.19:0/2060746737 >> 172.21.15.19:0/2060746737 conn(0x559920cfb300 msgr2=0x559920d01cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 -- 172.21.15.19:0/2060746737 shutdown_connections 2024-09-11T00:04:45.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 -- 172.21.15.19:0/2060746737 wait complete. 2024-09-11T00:04:45.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 -- start start 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.896+0000 7fc515543740 1 Processor -- start 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc515543740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d0e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc515543740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d0e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc515543740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d852f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d0e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc515543740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c073820 con 0x559920cfd4d0 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc510f0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d0e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44012/0 (socket says 172.21.15.19:44012) 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc510f0a640 1 -- 172.21.15.19:0/3472900203 learned_addr learned my addr 172.21.15.19:0/3472900203 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c074c90 con 0x559920d09d80 2024-09-11T00:04:45.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c073ef0 con 0x559920cfddf0 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.897+0000 7fc50bfff640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d0e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc515543740 10 client.0 _ll_register_callbacks cb 0x7fc500005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc51170b640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d852f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc510f0a640 1 -- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 msgr2=0x559920d0e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc510f0a640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d0e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc510f0a640 1 -- 172.21.15.19:0/3472900203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 msgr2=0x559920d852f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc510f0a640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d852f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc510f0a640 1 -- 172.21.15.19:0/3472900203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559920d85860 con 0x559920cfd4d0 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc510f0a640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d0e2e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc50000cfd0 tx=0x7fc5000b1430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a51dbf95f75486 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.898+0000 7fc4ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:45.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.899+0000 7fc50bfff640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d0e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:45.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.899+0000 7fc4ebfff640 1 -- 172.21.15.19:0/3472900203 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000d3070 con 0x559920cfd4d0 2024-09-11T00:04:45.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.899+0000 7fc4ebfff640 1 -- 172.21.15.19:0/3472900203 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc5000051b0 con 0x559920cfd4d0 2024-09-11T00:04:45.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.899+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5000ac460 con 0x559920cfd4d0 2024-09-11T00:04:45.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.900+0000 7fc4ebfff640 1 -- 172.21.15.19:0/3472900203 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc5000ad050 con 0x559920cfd4d0 2024-09-11T00:04:45.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.900+0000 7fc515543740 10 client.15741 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:45.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.900+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559920d86b40 con 0x559920cfd4d0 2024-09-11T00:04:45.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.901+0000 7fc4ebfff640 1 -- 172.21.15.19:0/3472900203 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5000ac460 con 0x559920cfd4d0 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.901+0000 7fc4ebfff640 1 -- 172.21.15.19:0/3472900203 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc5000a8bc0 con 0x559920cfd4d0 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.902+0000 7fc515543740 10 client.15741 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.902+0000 7fc515543740 10 client.15741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.902+0000 7fc515543740 20 client.15741 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.902+0000 7fc515543740 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d89360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.902+0000 7fc515543740 4 client.15741 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.902+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559920c718a0 con 0x559920d19650 2024-09-11T00:04:45.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.902+0000 7fc50bfff640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d89360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:45.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.904+0000 7fc50bfff640 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d89360 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4096f4496aa540f3 server_cookie=4cce3393b80200d in_seq=0 out_seq=0 2024-09-11T00:04:45.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.904+0000 7fc4ebfff640 10 client.15741 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:45.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc4ebfff640 1 -- 172.21.15.19:0/3472900203 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559920c718a0 con 0x559920d19650 2024-09-11T00:04:45.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc4ebfff640 10 client.15741 handle_command_reply: tid=0 2024-09-11T00:04:45.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 client.15741 shutdown 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 msgr2=0x559920d0e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d0e2e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc50000cfd0 tx=0x7fc5000b1430 comp rx=0 tx=0).stop 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 shutdown_connections 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x559920d19650 0x559920d89360 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559920d09d80 0x559920d852f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559920cfddf0 0x559920d0e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc4ebfff640 0 client.15741 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 --2- 172.21.15.19:0/3472900203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559920cfd4d0 0x559920d0e2e0 secure :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc50000cfd0 tx=0x7fc5000b1430 comp rx=0 tx=0).stop 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.908+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 >> 172.21.15.19:0/3472900203 conn(0x559920cfb300 msgr2=0x559920cfc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:45.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.909+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 shutdown_connections 2024-09-11T00:04:45.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.909+0000 7fc515543740 1 -- 172.21.15.19:0/3472900203 wait complete. 2024-09-11T00:04:45.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.909+0000 7fc515543740 20 client.15741 trim_cache size 0 max 16384 2024-09-11T00:04:45.911 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:04:45.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4fc0b54d0 msgr2=0x7fc4fc0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4fc0b54d0 0x7fc4fc0b7990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc504005fe0 tx=0x7fc50402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c103ca0 msgr2=0x7fc50c10bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c103ca0 0x7fc50c10bd70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc50000e9f0 tx=0x7fc50000edf0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 shutdown_connections 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc50c10d100 0x7fc50c1a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc50c1045c0 0x7fc50c10c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc4fc0b54d0 0x7fc4fc0b7990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 --2- 172.21.15.19:0/1016970706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc50c103ca0 0x7fc50c10bd70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.910+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 >> 172.21.15.19:0/1016970706 conn(0x7fc50c0fd700 msgr2=0x7fc50c10f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.911+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 shutdown_connections 2024-09-11T00:04:45.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:45.911+0000 7fc51316e640 1 -- 172.21.15.19:0/1016970706 wait complete. 2024-09-11T00:04:46.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:45 smithi019 ceph-mon[30859]: pgmap v392: 97 pgs: 97 active+clean; 243 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-09-11T00:04:46.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:45 smithi131 ceph-mon[35491]: pgmap v392: 97 pgs: 97 active+clean; 243 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-09-11T00:04:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:45 smithi135 ceph-mon[35432]: pgmap v392: 97 pgs: 97 active+clean; 243 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-09-11T00:04:46.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:04:47.279 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:47 smithi019 ceph-mon[30859]: pgmap v393: 97 pgs: 97 active+clean; 247 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 215 op/s 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 -- 172.21.15.19:0/3337861622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 msgr2=0x7fc4101031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 --2- 172.21.15.19:0/3337861622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 0x7fc4101031a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009900 tx=0x7fc40c02a410 comp rx=0 tx=0).stop 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 -- 172.21.15.19:0/3337861622 shutdown_connections 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 --2- 172.21.15.19:0/3337861622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410109150 0x7fc41010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 --2- 172.21.15.19:0/3337861622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 0x7fc410108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 --2- 172.21.15.19:0/3337861622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 0x7fc4101031a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 -- 172.21.15.19:0/3337861622 >> 172.21.15.19:0/3337861622 conn(0x7fc4100fe830 msgr2=0x7fc410100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 -- 172.21.15.19:0/3337861622 shutdown_connections 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.803+0000 7fc417e57640 1 -- 172.21.15.19:0/3337861622 wait complete. 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 Processor -- start 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 -- start start 2024-09-11T00:04:47.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 0x7fc41019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 0x7fc41019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410109150 0x7fc4101a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112e20 con 0x7fc4101087d0 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112ca0 con 0x7fc410109150 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc417e57640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112fa0 con 0x7fc410102dc0 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 0x7fc41019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc415bf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 0x7fc41019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 0x7fc41019ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44022/0 (socket says 172.21.15.19:44022) 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 -- 172.21.15.19:0/143731609 learned_addr learned my addr 172.21.15.19:0/143731609 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4163f4640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410109150 0x7fc4101a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 -- 172.21.15.19:0/143731609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 msgr2=0x7fc41019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 0x7fc41019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 -- 172.21.15.19:0/143731609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410109150 msgr2=0x7fc4101a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410109150 0x7fc4101a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc4153f2640 1 -- 172.21.15.19:0/143731609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4101a1580 con 0x7fc4101087d0 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.804+0000 7fc415bf3640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 0x7fc41019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.805+0000 7fc4153f2640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 0x7fc41019ba10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e9f0 tx=0x7fc40000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.805+0000 7fc406ffd640 1 -- 172.21.15.19:0/143731609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40000cd80 con 0x7fc4101087d0 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.805+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4101a1870 con 0x7fc4101087d0 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.805+0000 7fc406ffd640 1 -- 172.21.15.19:0/143731609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4000108e0 con 0x7fc4101087d0 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.805+0000 7fc406ffd640 1 -- 172.21.15.19:0/143731609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400018980 con 0x7fc4101087d0 2024-09-11T00:04:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.805+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4101a7f30 con 0x7fc4101087d0 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.807+0000 7fc41a22c740 1 Processor -- start 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.807+0000 7fc406ffd640 1 -- 172.21.15.19:0/143731609 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fc400010430 con 0x7fc4101087d0 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc41a22c740 1 -- start start 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471780f0 0x5621471784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147184460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471849a0 0x562147186d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc41a22c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5621470eeea0 con 0x5621471849a0 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc41a22c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5621470de2d0 con 0x5621471780f0 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc41a22c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5621470e20e0 con 0x562147178a10 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471849a0 0x562147186d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc415bf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147184460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc415bf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147184460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43072/0 (socket says 172.21.15.19:43072) 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc4163f4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471780f0 0x5621471784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471849a0 0x562147186d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44038/0 (socket says 172.21.15.19:44038) 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.808+0000 7fc415bf3640 1 -- 172.21.15.19:0/1615754109 learned_addr learned my addr 172.21.15.19:0/1615754109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc415bf3640 1 -- 172.21.15.19:0/1615754109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471780f0 msgr2=0x5621471784d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1615754109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471780f0 0x5621471784d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc415bf3640 1 -- 172.21.15.19:0/1615754109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471849a0 msgr2=0x562147186d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1615754109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471849a0 0x562147186d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc415bf3640 1 -- 172.21.15.19:0/1615754109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562146e3c650 con 0x562147178a10 2024-09-11T00:04:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc406ffd640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b5450 0x7fc3fc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc4163f4640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b5450 0x7fc3fc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1615754109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147184460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009230 tx=0x7fc40c005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62e244145e7ce17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc406ffd640 1 -- 172.21.15.19:0/143731609 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc4000e6250 con 0x7fc4101087d0 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc3fbfff640 1 -- 172.21.15.19:0/1615754109 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c035040 con 0x562147178a10 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc3fbfff640 1 -- 172.21.15.19:0/1615754109 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40c004770 con 0x562147178a10 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.809+0000 7fc3fbfff640 1 -- 172.21.15.19:0/1615754109 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c003950 con 0x562147178a10 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 -- 172.21.15.19:0/1615754109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 msgr2=0x562147184460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc4163f4640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b5450 0x7fc3fc0b7910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc408005fd0 tx=0x7fc408009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1615754109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147184460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009230 tx=0x7fc40c005c00 comp rx=0 tx=0).stop 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 -- 172.21.15.19:0/1615754109 shutdown_connections 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1615754109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471849a0 0x562147186d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1615754109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147184460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1615754109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471780f0 0x5621471784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 -- 172.21.15.19:0/1615754109 >> 172.21.15.19:0/1615754109 conn(0x562147175f20 msgr2=0x5621471770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 -- 172.21.15.19:0/1615754109 shutdown_connections 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 -- 172.21.15.19:0/1615754109 wait complete. 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.810+0000 7fc41a22c740 1 -- start start 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 1 Processor -- start 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471780f0 0x562147184210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147181660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147181be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562146f3f700 con 0x5621471780f0 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562147079160 con 0x5621471849a0 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5621471875c0 con 0x562147178a10 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc41a22c740 10 client.0 _ll_register_callbacks cb 0x5621470929e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471780f0 0x562147184210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471780f0 0x562147184210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44042/0 (socket says 172.21.15.19:44042) 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 -- 172.21.15.19:0/1139346649 learned_addr learned my addr 172.21.15.19:0/1139346649 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc4153f2640 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147181660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc4163f4640 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147181be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 -- 172.21.15.19:0/1139346649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 msgr2=0x562147181660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147181660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 -- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 msgr2=0x562147181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147181be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.811+0000 7fc415bf3640 1 -- 172.21.15.19:0/1139346649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621470a6c90 con 0x5621471780f0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471780f0 0x562147184210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc40c02a930 tx=0x7fc40c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72821455aa035eea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc3f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1139346649 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c035040 con 0x5621471780f0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40c004770 con 0x5621471780f0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1139346649 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc40c005300 con 0x5621471780f0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1139346649 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc40c009520 con 0x5621471780f0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc41a22c740 10 client.15753 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562147192e70 con 0x5621471780f0 2024-09-11T00:04:47.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1139346649 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40c004770 con 0x5621471780f0 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.812+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1139346649 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc40c04c070 con 0x5621471780f0 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc41a22c740 10 client.15753 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc41a22c740 10 client.15753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc41a22c740 20 client.15753 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621471941c0 0x5621471965b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc41a22c740 4 client.15753 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621470f0df0 con 0x5621471941c0 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc4153f2640 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621471941c0 0x5621471965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc4153f2640 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621471941c0 0x5621471965b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63320bfec89c610f server_cookie=dfedefad7c7086d6 in_seq=0 out_seq=0 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.813+0000 7fc3f97fa640 10 client.15753 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1139346649 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5621470f0df0 con 0x5621471941c0 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc3f97fa640 10 client.15753 handle_command_reply: tid=0 2024-09-11T00:04:47.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 client.15753 shutdown 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471780f0 msgr2=0x562147184210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471780f0 0x562147184210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc40c02a930 tx=0x7fc40c004b50 comp rx=0 tx=0).stop 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 shutdown_connections 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621471941c0 0x5621471965b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147181be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562147178a10 0x562147181660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc3f97fa640 0 client.15753 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1139346649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5621471780f0 0x562147184210 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 >> 172.21.15.19:0/1139346649 conn(0x562147175f20 msgr2=0x56214717ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 shutdown_connections 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 1 -- 172.21.15.19:0/1139346649 wait complete. 2024-09-11T00:04:47.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.814+0000 7fc41a22c740 20 client.15753 trim_cache size 0 max 16384 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 Processor -- start 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 -- start start 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x562147170e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147177500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147174e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4101b30e0 con 0x562147178a10 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc4101b0950 con 0x5621471849a0 2024-09-11T00:04:47.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.828+0000 7fc41a22c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4101ae7c0 con 0x5621471780f0 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147177500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc415bf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x562147170e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147177500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44050/0 (socket says 172.21.15.19:44050) 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc415bf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x562147170e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43090/0 (socket says 172.21.15.19:43090) 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 -- 172.21.15.19:0/496072862 learned_addr learned my addr 172.21.15.19:0/496072862 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4163f4640 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147174e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 -- 172.21.15.19:0/496072862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 msgr2=0x562147170e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x562147170e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 -- 172.21.15.19:0/496072862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 msgr2=0x562147174e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147174e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 -- 172.21.15.19:0/496072862 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621471769a0 con 0x562147178a10 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc415bf3640 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x562147170e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:47.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4163f4640 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147174e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc4153f2640 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147177500 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c6a0 tx=0x7fc4000e8760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7107d469ae2b6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.829+0000 7fc3fb7fe640 1 -- 172.21.15.19:0/496072862 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4000e5040 con 0x562147178a10 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc3fb7fe640 1 -- 172.21.15.19:0/496072862 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4000ac310 con 0x562147178a10 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc3fb7fe640 1 -- 172.21.15.19:0/496072862 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4000b5ce0 con 0x562147178a10 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 -- 172.21.15.19:0/496072862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 msgr2=0x562147177500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147177500 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c6a0 tx=0x7fc4000e8760 comp rx=0 tx=0).stop 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 -- 172.21.15.19:0/496072862 shutdown_connections 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x562147174e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147177500 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 --2- 172.21.15.19:0/496072862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x562147170e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 -- 172.21.15.19:0/496072862 >> 172.21.15.19:0/496072862 conn(0x562147175f20 msgr2=0x562147174750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 -- 172.21.15.19:0/496072862 shutdown_connections 2024-09-11T00:04:47.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.830+0000 7fc41a22c740 1 -- 172.21.15.19:0/496072862 wait complete. 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 -- start start 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 Processor -- start 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x5621471960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147196660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x5621471f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4101aee10 con 0x562147178a10 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc4101b0280 con 0x5621471849a0 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4101af4e0 con 0x5621471780f0 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc41a22c740 10 client.0 _ll_register_callbacks cb 0x7fc4000e9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc4153f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44060/0 (socket says 172.21.15.19:44060) 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc4153f2640 1 -- 172.21.15.19:0/1683942727 learned_addr learned my addr 172.21.15.19:0/1683942727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:47.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.831+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x5621471960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4163f4640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x5621471f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4153f2640 1 -- 172.21.15.19:0/1683942727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 msgr2=0x5621471960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4153f2640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x5621471960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4153f2640 1 -- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 msgr2=0x5621471f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4153f2640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x5621471f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4153f2640 1 -- 172.21.15.19:0/1683942727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621471fa5a0 con 0x562147178a10 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4163f4640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x5621471f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc4153f2640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147196660 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e9c0 tx=0x7fc400005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4d60dd72f224d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc3f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1683942727 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4000e5070 con 0x562147178a10 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1683942727 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc4000a8a70 con 0x562147178a10 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4000ac310 con 0x562147178a10 2024-09-11T00:04:47.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1683942727 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc4000ac150 con 0x562147178a10 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc41a22c740 10 client.15759 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.832+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562147201a20 con 0x562147178a10 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1683942727 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4000ac310 con 0x562147178a10 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1683942727 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc400018b20 con 0x562147178a10 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc41a22c740 10 client.15759 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc41a22c740 10 client.15759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc41a22c740 20 client.15759 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621472020f0 0x562147204510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc41a22c740 4 client.15759 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621470ec8a0 con 0x5621472020f0 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.833+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621472020f0 0x562147204510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc3f97fa640 10 client.15759 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:47.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc415bf3640 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621472020f0 0x562147204510 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7186ded8d509815 server_cookie=9f8964a0ec37e8ba in_seq=0 out_seq=0 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc3f97fa640 1 -- 172.21.15.19:0/1683942727 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621470ec8a0 con 0x5621472020f0 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc3f97fa640 10 client.15759 handle_command_reply: tid=0 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 client.15759 shutdown 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 msgr2=0x562147196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147196660 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e9c0 tx=0x7fc400005c70 comp rx=0 tx=0).stop 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 shutdown_connections 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5621472020f0 0x562147204510 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621471849a0 0x5621471f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc3f97fa640 0 client.15759 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562147178a10 0x562147196660 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 --2- 172.21.15.19:0/1683942727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621471780f0 0x5621471960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 >> 172.21.15.19:0/1683942727 conn(0x562147175f20 msgr2=0x562147174f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 shutdown_connections 2024-09-11T00:04:47.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 1 -- 172.21.15.19:0/1683942727 wait complete. 2024-09-11T00:04:47.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.834+0000 7fc41a22c740 20 client.15759 trim_cache size 0 max 16384 2024-09-11T00:04:47.847 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:04:47.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b5450 msgr2=0x7fc3fc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b5450 0x7fc3fc0b7910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc408005fd0 tx=0x7fc408009500 comp rx=0 tx=0).stop 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 msgr2=0x7fc41019ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 0x7fc41019ba10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e9f0 tx=0x7fc40000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 shutdown_connections 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410109150 0x7fc4101a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc3fc0b5450 0x7fc3fc0b7910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4101087d0 0x7fc41019ba10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 --2- 172.21.15.19:0/143731609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc410102dc0 0x7fc41019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 >> 172.21.15.19:0/143731609 conn(0x7fc4100fe830 msgr2=0x7fc410104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 shutdown_connections 2024-09-11T00:04:47.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:47.835+0000 7fc417e57640 1 -- 172.21.15.19:0/143731609 wait complete. 2024-09-11T00:04:48.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:47 smithi135 ceph-mon[35432]: pgmap v393: 97 pgs: 97 active+clean; 247 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 215 op/s 2024-09-11T00:04:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:47 smithi131 ceph-mon[35491]: pgmap v393: 97 pgs: 97 active+clean; 247 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 215 op/s 2024-09-11T00:04:48.585 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:49.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.600+0000 7fc91b6a9640 1 -- 172.21.15.19:0/220940725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc91410a150 msgr2=0x7fc9141111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:49.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.600+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/220940725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc91410a150 0x7fc9141111b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc904009ca0 tx=0x7fc90402a940 comp rx=0 tx=0).stop 2024-09-11T00:04:49.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.606+0000 7fc91b6a9640 1 -- 172.21.15.19:0/220940725 shutdown_connections 2024-09-11T00:04:49.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.606+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/220940725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91411c0a0 0x7fc91411e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.606+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/220940725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91410a530 0x7fc91410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.606+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/220940725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc91410a150 0x7fc9141111b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.606+0000 7fc91b6a9640 1 -- 172.21.15.19:0/220940725 >> 172.21.15.19:0/220940725 conn(0x7fc91406dfc0 msgr2=0x7fc91406e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:49.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.614+0000 7fc91b6a9640 1 -- 172.21.15.19:0/220940725 shutdown_connections 2024-09-11T00:04:49.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.615+0000 7fc91b6a9640 1 -- 172.21.15.19:0/220940725 wait complete. 2024-09-11T00:04:49.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 Processor -- start 2024-09-11T00:04:49.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 -- start start 2024-09-11T00:04:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc91410a150 0x7fc91411b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91410a530 0x7fc91411ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91411c0a0 0x7fc914115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc914112140 con 0x7fc91411c0a0 2024-09-11T00:04:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc914111fc0 con 0x7fc91410a530 2024-09-11T00:04:49.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.616+0000 7fc91b6a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9141122c0 con 0x7fc91410a150 2024-09-11T00:04:49.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.617+0000 7fc919c46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91411c0a0 0x7fc914115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.617+0000 7fc919c46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91411c0a0 0x7fc914115800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44080/0 (socket says 172.21.15.19:44080) 2024-09-11T00:04:49.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.617+0000 7fc919c46640 1 -- 172.21.15.19:0/2407661437 learned_addr learned my addr 172.21.15.19:0/2407661437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.620+0000 7fc919c46640 1 -- 172.21.15.19:0/2407661437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc91410a150 msgr2=0x7fc91411b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.620+0000 7fc919c46640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc91410a150 0x7fc91411b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.620+0000 7fc919c46640 1 -- 172.21.15.19:0/2407661437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91410a530 msgr2=0x7fc91411ba00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.620+0000 7fc919c46640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91410a530 0x7fc91411ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.620+0000 7fc919c46640 1 -- 172.21.15.19:0/2407661437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9141160c0 con 0x7fc91411c0a0 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.620+0000 7fc919c46640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91411c0a0 0x7fc914115800 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00d950 tx=0x7fc90c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.621+0000 7fc9127fc640 1 -- 172.21.15.19:0/2407661437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c017070 con 0x7fc91411c0a0 2024-09-11T00:04:49.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.621+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9141163b0 con 0x7fc91411c0a0 2024-09-11T00:04:49.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.621+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9141bd260 con 0x7fc91411c0a0 2024-09-11T00:04:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.629+0000 7fc91da7e740 1 Processor -- start 2024-09-11T00:04:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.631+0000 7fc91da7e740 1 -- start start 2024-09-11T00:04:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.631+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22134d0 0x55e0c22138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc918c44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22134d0 0x55e0c22138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc918c44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22134d0 0x55e0c22138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44084/0 (socket says 172.21.15.19:44084) 2024-09-11T00:04:49.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc918c44640 1 -- 172.21.15.19:0/4247661851 learned_addr learned my addr 172.21.15.19:0/4247661851 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:49.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc91da7e740 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c221f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc91da7e740 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2222170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e0c2189ea0 con 0x55e0c22134d0 2024-09-11T00:04:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e0c21792d0 con 0x55e0c221fd80 2024-09-11T00:04:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e0c217d0e0 con 0x55e0c2213df0 2024-09-11T00:04:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc9127fc640 1 -- 172.21.15.19:0/2407661437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc90c005020 con 0x7fc91411c0a0 2024-09-11T00:04:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc9127fc640 1 -- 172.21.15.19:0/2407661437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c004c60 con 0x7fc91411c0a0 2024-09-11T00:04:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.635+0000 7fc9127fc640 1 -- 172.21.15.19:0/2407661437 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fc90c010460 con 0x7fc91411c0a0 2024-09-11T00:04:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.637+0000 7fc9127fc640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8fc0b5650 0x7fc8fc0b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.637+0000 7fc9127fc640 1 -- 172.21.15.19:0/2407661437 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc90c0e6930 con 0x7fc91411c0a0 2024-09-11T00:04:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.638+0000 7fc919c46640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8fc0b5650 0x7fc8fc0b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.638+0000 7fc919445640 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c221f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.639+0000 7fc919445640 1 -- 172.21.15.19:0/4247661851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 msgr2=0x55e0c2222170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.639+0000 7fc919445640 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2222170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.639+0000 7fc919445640 1 -- 172.21.15.19:0/4247661851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22134d0 msgr2=0x55e0c22138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.639+0000 7fc919445640 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22134d0 0x55e0c22138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.639+0000 7fc919445640 1 -- 172.21.15.19:0/4247661851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0c1ed7650 con 0x55e0c2213df0 2024-09-11T00:04:49.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.639+0000 7fc919c46640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8fc0b5650 0x7fc8fc0b7b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009610 tx=0x7fc90c0a94a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.643+0000 7fc919445640 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c221f840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc904005e30 tx=0x7fc9040098b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb842320d22fdeab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.643+0000 7fc8fb7fe640 1 -- 172.21.15.19:0/4247661851 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc904034040 con 0x55e0c2213df0 2024-09-11T00:04:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.643+0000 7fc8fb7fe640 1 -- 172.21.15.19:0/4247661851 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc90403e070 con 0x55e0c2213df0 2024-09-11T00:04:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.643+0000 7fc8fb7fe640 1 -- 172.21.15.19:0/4247661851 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90402fe20 con 0x55e0c2213df0 2024-09-11T00:04:49.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.647+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 msgr2=0x55e0c221f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:49.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.647+0000 7fc91da7e740 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c221f840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc904005e30 tx=0x7fc9040098b0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.651+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 shutdown_connections 2024-09-11T00:04:49.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.651+0000 7fc91da7e740 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2222170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.651+0000 7fc91da7e740 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c221f840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.651+0000 7fc91da7e740 1 --2- 172.21.15.19:0/4247661851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22134d0 0x55e0c22138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.651+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 >> 172.21.15.19:0/4247661851 conn(0x55e0c2211300 msgr2=0x55e0c22124a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:49.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.653+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 shutdown_connections 2024-09-11T00:04:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.656+0000 7fc91da7e740 1 -- 172.21.15.19:0/4247661851 wait complete. 2024-09-11T00:04:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.656+0000 7fc91da7e740 1 -- start start 2024-09-11T00:04:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.657+0000 7fc91da7e740 1 Processor -- start 2024-09-11T00:04:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.658+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc919445640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc918c44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc918c44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43138/0 (socket says 172.21.15.19:43138) 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc919445640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44096/0 (socket says 172.21.15.19:44096) 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc918c44640 1 -- 172.21.15.19:0/2552816199 learned_addr learned my addr 172.21.15.19:0/2552816199 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c221d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e0c1fda700 con 0x55e0c2213df0 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e0c2114160 con 0x55e0c221fd80 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.659+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e0c22229a0 con 0x55e0c22134d0 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.660+0000 7fc919445640 1 -- 172.21.15.19:0/2552816199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 msgr2=0x55e0c221f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.660+0000 7fc919445640 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.660+0000 7fc919445640 1 -- 172.21.15.19:0/2552816199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 msgr2=0x55e0c221d1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.660+0000 7fc919445640 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c221d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.660+0000 7fc919445640 1 -- 172.21.15.19:0/2552816199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0c2141c90 con 0x55e0c2213df0 2024-09-11T00:04:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.660+0000 7fc919445640 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221cb40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc904000f80 tx=0x7fc90402fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5239ed63696c690 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:49.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.661+0000 7fc91da7e740 10 client.0 _ll_register_callbacks cb 0x55e0c212d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:49.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.661+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc90403e070 con 0x55e0c2213df0 2024-09-11T00:04:49.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.661+0000 7fc8f8ff9640 10 client.15771 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:49.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.661+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/2552816199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc904051060 con 0x55e0c2213df0 2024-09-11T00:04:49.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.661+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/2552816199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc904003b70 con 0x55e0c2213df0 2024-09-11T00:04:49.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.661+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/2552816199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc904003d70 con 0x55e0c2213df0 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.664+0000 7fc91da7e740 10 client.15771 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.664+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e0c222ddf0 con 0x55e0c2213df0 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.665+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/2552816199 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc90402f070 con 0x55e0c2213df0 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.665+0000 7fc91da7e740 10 client.15771 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.665+0000 7fc91da7e740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.665+0000 7fc91da7e740 20 client.15771 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.665+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c222f6d0 0x55e0c2231b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.665+0000 7fc91da7e740 4 client.15771 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.665+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc90403e070 con 0x55e0c222f6d0 2024-09-11T00:04:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.666+0000 7fc918c44640 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c222f6d0 0x55e0c2231b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.672+0000 7fc918c44640 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c222f6d0 0x55e0c2231b90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa954178cfa9ab26 server_cookie=fb4a9950d0089850 in_seq=0 out_seq=0 2024-09-11T00:04:49.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.673+0000 7fc8f8ff9640 10 client.15771 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:49.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.674+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/2552816199 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc90403e070 con 0x55e0c222f6d0 2024-09-11T00:04:49.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.674+0000 7fc8f8ff9640 10 client.15771 handle_command_reply: tid=0 2024-09-11T00:04:49.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.674+0000 7fc91da7e740 1 client.15771 shutdown 2024-09-11T00:04:49.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.688+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 msgr2=0x55e0c221cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.688+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221cb40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc904000f80 tx=0x7fc90402fdd0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.689+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 shutdown_connections 2024-09-11T00:04:49.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.689+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c221d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.689+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c222f6d0 0x55e0c2231b90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.689+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221cb40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.689+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2552816199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.689+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 >> 172.21.15.19:0/2552816199 conn(0x55e0c2211300 msgr2=0x55e0c2216e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:49.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.689+0000 7fc8f8ff9640 0 client.15771 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:49.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.692+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 shutdown_connections 2024-09-11T00:04:49.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.692+0000 7fc91da7e740 1 -- 172.21.15.19:0/2552816199 wait complete. 2024-09-11T00:04:49.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.693+0000 7fc91da7e740 20 client.15771 trim_cache size 0 max 16384 2024-09-11T00:04:49.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.732+0000 7fc91da7e740 1 Processor -- start 2024-09-11T00:04:49.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.732+0000 7fc91da7e740 1 -- start start 2024-09-11T00:04:49.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.733+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.733+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.733+0000 7fc918c44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.733+0000 7fc918c44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43154/0 (socket says 172.21.15.19:43154) 2024-09-11T00:04:49.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.733+0000 7fc918c44640 1 -- 172.21.15.19:0/2755820882 learned_addr learned my addr 172.21.15.19:0/2755820882 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:49.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.733+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c221cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.733+0000 7fc919445640 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.734+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc900011000 con 0x55e0c2213df0 2024-09-11T00:04:49.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.734+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc90000e870 con 0x55e0c221fd80 2024-09-11T00:04:49.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.734+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc90000c6c0 con 0x55e0c22134d0 2024-09-11T00:04:49.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.734+0000 7fc918c44640 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c221cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.734+0000 7fc918c44640 1 -- 172.21.15.19:0/2755820882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 msgr2=0x55e0c221cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:49.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.735+0000 7fc918c44640 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c221cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.735+0000 7fc918c44640 1 -- 172.21.15.19:0/2755820882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 msgr2=0x55e0c221b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:49.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.735+0000 7fc918c44640 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.735+0000 7fc918c44640 1 -- 172.21.15.19:0/2755820882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0c221da90 con 0x55e0c22134d0 2024-09-11T00:04:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.742+0000 7fc918c44640 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221b3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc908000c00 tx=0x7fc908005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b435f56f3433c6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:49.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.745+0000 7fc8faffd640 1 -- 172.21.15.19:0/2755820882 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908003e50 con 0x55e0c22134d0 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.745+0000 7fc8faffd640 1 -- 172.21.15.19:0/2755820882 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9080118f0 con 0x55e0c22134d0 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.748+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 msgr2=0x55e0c221b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.748+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221b3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc908000c00 tx=0x7fc908005c50 comp rx=0 tx=0).stop 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.748+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 shutdown_connections 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.748+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c221cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.749+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c2213df0 0x55e0c221b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.749+0000 7fc91da7e740 1 --2- 172.21.15.19:0/2755820882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c22134d0 0x55e0c221b3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.749+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 >> 172.21.15.19:0/2755820882 conn(0x55e0c2211300 msgr2=0x55e0c2217d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.749+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 shutdown_connections 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.749+0000 7fc91da7e740 1 -- 172.21.15.19:0/2755820882 wait complete. 2024-09-11T00:04:49.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.750+0000 7fc91da7e740 1 -- start start 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.750+0000 7fc91da7e740 1 Processor -- start 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.751+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c22285b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.751+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2237110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.751+0000 7fc91da7e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22376f0 0x55e0c2237b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.751+0000 7fc918c44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c22285b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.751+0000 7fc918c44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c22285b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43158/0 (socket says 172.21.15.19:43158) 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.751+0000 7fc919445640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2237110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.751+0000 7fc919445640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2237110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:59680/0 (socket says 172.21.15.19:59680) 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.752+0000 7fc918c44640 1 -- 172.21.15.19:0/245670026 learned_addr learned my addr 172.21.15.19:0/245670026 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.752+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc90000cd30 con 0x55e0c22376f0 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.752+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc90000e1a0 con 0x55e0c221fd80 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.752+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc90000d400 con 0x55e0c2213df0 2024-09-11T00:04:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.752+0000 7fc91da7e740 10 client.0 _ll_register_callbacks cb 0x7fc90800b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.753+0000 7fc918c44640 1 -- 172.21.15.19:0/245670026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 msgr2=0x55e0c2237110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.753+0000 7fc918c44640 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2237110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.753+0000 7fc918c44640 1 -- 172.21.15.19:0/245670026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22376f0 msgr2=0x55e0c2237b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.753+0000 7fc918c44640 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22376f0 0x55e0c2237b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.753+0000 7fc918c44640 1 -- 172.21.15.19:0/245670026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0c220c990 con 0x55e0c2213df0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.754+0000 7fc918c44640 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c22285b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc908004250 tx=0x7fc90800b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87569175eb77c47a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.754+0000 7fc8f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.754+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/245670026 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908010c10 con 0x55e0c2213df0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.754+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0c218bdf0 con 0x55e0c2213df0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.754+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/245670026 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fc908010db0 con 0x55e0c2213df0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.755+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/245670026 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc908029470 con 0x55e0c2213df0 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.755+0000 7fc91da7e740 10 client.25399 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.755+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0c2211d80 con 0x55e0c2213df0 2024-09-11T00:04:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.758+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/245670026 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e0c218bdf0 con 0x55e0c2213df0 2024-09-11T00:04:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.758+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/245670026 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc9080116a0 con 0x55e0c2213df0 2024-09-11T00:04:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.759+0000 7fc91da7e740 10 client.25399 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.759+0000 7fc91da7e740 10 client.25399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.759+0000 7fc91da7e740 20 client.25399 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.759+0000 7fc91da7e740 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c229ce50 0x55e0c229f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.759+0000 7fc91da7e740 4 client.25399 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:04:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.759+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0c21878a0 con 0x55e0c229ce50 2024-09-11T00:04:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.760+0000 7fc919445640 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c229ce50 0x55e0c229f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.775+0000 7fc919445640 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c229ce50 0x55e0c229f270 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ba9001f59ec8268 server_cookie=ebf8234b2fcd58dc in_seq=0 out_seq=0 2024-09-11T00:04:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.777+0000 7fc8f8ff9640 10 client.25399 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.884+0000 7fc8f8ff9640 1 -- 172.21.15.19:0/245670026 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0c21878a0 con 0x55e0c229ce50 2024-09-11T00:04:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.884+0000 7fc8f8ff9640 10 client.25399 handle_command_reply: tid=0 2024-09-11T00:04:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.884+0000 7fc91da7e740 1 client.25399 shutdown 2024-09-11T00:04:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.884+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 msgr2=0x55e0c22285b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.884+0000 7fc91da7e740 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c22285b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc908004250 tx=0x7fc90800b650 comp rx=0 tx=0).stop 2024-09-11T00:04:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 shutdown_connections 2024-09-11T00:04:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e0c229ce50 0x55e0c229f270 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0c22376f0 0x55e0c2237b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0c221fd80 0x55e0c2237110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.889 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:04:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 --2- 172.21.15.19:0/245670026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0c2213df0 0x55e0c22285b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 >> 172.21.15.19:0/245670026 conn(0x55e0c2211300 msgr2=0x55e0c2217d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc8f8ff9640 0 client.25399 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 shutdown_connections 2024-09-11T00:04:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 1 -- 172.21.15.19:0/245670026 wait complete. 2024-09-11T00:04:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.885+0000 7fc91da7e740 20 client.25399 trim_cache size 0 max 16384 2024-09-11T00:04:49.890 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:49 smithi019 ceph-mon[30859]: pgmap v394: 97 pgs: 97 active+clean; 254 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 151 op/s 2024-09-11T00:04:49.890 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8fc0b5650 msgr2=0x7fc8fc0b7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8fc0b5650 0x7fc8fc0b7b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009610 tx=0x7fc90c0a94a0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91411c0a0 msgr2=0x7fc914115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91411c0a0 0x7fc914115800 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00d950 tx=0x7fc90c00de10 comp rx=0 tx=0).stop 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 shutdown_connections 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc8fc0b5650 0x7fc8fc0b7b10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91411c0a0 0x7fc914115800 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91410a530 0x7fc91411ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 --2- 172.21.15.19:0/2407661437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc91410a150 0x7fc91411b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:49.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 >> 172.21.15.19:0/2407661437 conn(0x7fc91406dfc0 msgr2=0x7fc914071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:49.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 shutdown_connections 2024-09-11T00:04:49.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:49.888+0000 7fc91b6a9640 1 -- 172.21.15.19:0/2407661437 wait complete. 2024-09-11T00:04:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:49 smithi135 ceph-mon[35432]: pgmap v394: 97 pgs: 97 active+clean; 254 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 151 op/s 2024-09-11T00:04:50.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:04:50.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:49 smithi131 ceph-mon[35491]: pgmap v394: 97 pgs: 97 active+clean; 254 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 151 op/s 2024-09-11T00:04:50.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:04:51.823 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:04:51.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:51 smithi135 ceph-mon[35432]: pgmap v395: 97 pgs: 97 active+clean; 265 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 168 op/s 2024-09-11T00:04:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:51 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:04:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:51 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:04:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:51 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:04:52.205 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:51 smithi019 ceph-mon[30859]: pgmap v395: 97 pgs: 97 active+clean; 265 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 168 op/s 2024-09-11T00:04:52.205 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:51 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:04:52.205 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:51 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:04:52.206 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:51 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:04:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:51 smithi131 ceph-mon[35491]: pgmap v395: 97 pgs: 97 active+clean; 265 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 168 op/s 2024-09-11T00:04:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:51 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:04:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:51 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:04:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:51 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:04:52.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 -- 172.21.15.19:0/2429653601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6001077c0 msgr2=0x7fb60010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 --2- 172.21.15.19:0/2429653601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6001077c0 0x7fb60010dfc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009ca0 tx=0x7fb5f802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 -- 172.21.15.19:0/2429653601 shutdown_connections 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 --2- 172.21.15.19:0/2429653601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6001077c0 0x7fb60010dfc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 --2- 172.21.15.19:0/2429653601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600106e40 0x7fb600107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 --2- 172.21.15.19:0/2429653601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb600101810 0x7fb600101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 -- 172.21.15.19:0/2429653601 >> 172.21.15.19:0/2429653601 conn(0x7fb600076f50 msgr2=0x7fb600077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 -- 172.21.15.19:0/2429653601 shutdown_connections 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 -- 172.21.15.19:0/2429653601 wait complete. 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.604+0000 7fb605c37640 1 Processor -- start 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb605c37640 1 -- start start 2024-09-11T00:04:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb605c37640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600101810 0x7fb600197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb605c37640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb600106e40 0x7fb6001975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb605c37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6001077c0 0x7fb60019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb605c37640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110bd0 con 0x7fb600106e40 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb605c37640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110a50 con 0x7fb6001077c0 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb605c37640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110d50 con 0x7fb600101810 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600101810 0x7fb600197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5feffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb600106e40 0x7fb6001975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600101810 0x7fb600197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48626/0 (socket says 172.21.15.19:48626) 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 -- 172.21.15.19:0/27615057 learned_addr learned my addr 172.21.15.19:0/27615057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5fffff640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6001077c0 0x7fb60019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 -- 172.21.15.19:0/27615057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6001077c0 msgr2=0x7fb60019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6001077c0 0x7fb60019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 -- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb600106e40 msgr2=0x7fb6001975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb600106e40 0x7fb6001975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5ff7fe640 1 -- 172.21.15.19:0/27615057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60019d110 con 0x7fb600101810 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5feffd640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb600106e40 0x7fb6001975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.605+0000 7fb5fffff640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6001077c0 0x7fb60019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.606+0000 7fb5ff7fe640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600101810 0x7fb600197060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c920 tx=0x7fb5f000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.606+0000 7fb5fcff9640 1 -- 172.21.15.19:0/27615057 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007c70 con 0x7fb600101810 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.606+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60019d400 con 0x7fb600101810 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.606+0000 7fb5fcff9640 1 -- 172.21.15.19:0/27615057 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f0007e10 con 0x7fb600101810 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.606+0000 7fb5fcff9640 1 -- 172.21.15.19:0/27615057 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0018820 con 0x7fb600101810 2024-09-11T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.606+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6001a3c90 con 0x7fb600101810 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 Processor -- start 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 -- start start 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adebc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d6ade24e60 con 0x55d6adeae800 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d6ade14290 con 0x55d6adeadee0 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb60800c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d6ade180a0 con 0x55d6adebc9a0 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:47786/0 (socket says 172.21.15.19:47786) 2024-09-11T00:04:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb5fffff640 1 -- 172.21.15.19:0/830107420 learned_addr learned my addr 172.21.15.19:0/830107420 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.609+0000 7fb5feffd640 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5fffff640 1 -- 172.21.15.19:0/830107420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 msgr2=0x55d6adebed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5fffff640 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5fffff640 1 -- 172.21.15.19:0/830107420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 msgr2=0x55d6adebc460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5fffff640 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adebc460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5fffff640 1 -- 172.21.15.19:0/830107420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6adb72930 con 0x55d6adeadee0 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5fcff9640 1 -- 172.21.15.19:0/27615057 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fb5f000f450 con 0x7fb600101810 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5fffff640 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeae2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5f802f4a0 tx=0x7fb5f8009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1efd46b293fcc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5e5ffb640 1 -- 172.21.15.19:0/830107420 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8031450 con 0x55d6adeadee0 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5e5ffb640 1 -- 172.21.15.19:0/830107420 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8036040 con 0x55d6adeadee0 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.610+0000 7fb5e5ffb640 1 -- 172.21.15.19:0/830107420 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8004440 con 0x55d6adeadee0 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb5fcff9640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb5e80b5450 0x7fb5e80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb5ff7fe640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb5e80b5450 0x7fb5e80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb5fcff9640 1 -- 172.21.15.19:0/27615057 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb5f00e60c0 con 0x7fb600101810 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 -- 172.21.15.19:0/830107420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 msgr2=0x55d6adeae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeae2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5f802f4a0 tx=0x7fb5f8009a20 comp rx=0 tx=0).stop 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb5ff7fe640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb5e80b5450 0x7fb5e80b7910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00e3960 tx=0x7fb5f00cf040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 -- 172.21.15.19:0/830107420 shutdown_connections 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adebc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 --2- 172.21.15.19:0/830107420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeae2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 -- 172.21.15.19:0/830107420 >> 172.21.15.19:0/830107420 conn(0x55d6adeabd10 msgr2=0x55d6adeaceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 -- 172.21.15.19:0/830107420 shutdown_connections 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.611+0000 7fb60800c740 1 -- 172.21.15.19:0/830107420 wait complete. 2024-09-11T00:04:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 -- start start 2024-09-11T00:04:52.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 Processor -- start 2024-09-11T00:04:52.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeb9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adeb9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adeba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d6adc75890 con 0x55d6adeae800 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d6addaed40 con 0x55d6adeadee0 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d6adebf5f0 con 0x55d6adebc9a0 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb60800c740 10 client.0 _ll_register_callbacks cb 0x55d6ade12c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb5feffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adeb9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeb9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeb9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:47800/0 (socket says 172.21.15.19:47800) 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb5fffff640 1 -- 172.21.15.19:0/385199754 learned_addr learned my addr 172.21.15.19:0/385199754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.612+0000 7fb5fffff640 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adeba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5feffd640 1 -- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 msgr2=0x55d6adeba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5feffd640 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adeba380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5feffd640 1 -- 172.21.15.19:0/385199754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 msgr2=0x55d6adeb9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5feffd640 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeb9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5feffd640 1 -- 172.21.15.19:0/385199754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6adec89d0 con 0x55d6adeae800 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5feffd640 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adeb9e40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400ecf0 tx=0x7fb5f400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2367e26ee4e6a70e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5deffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5deffd640 1 -- 172.21.15.19:0/385199754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4004050 con 0x55d6adeae800 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5deffd640 1 -- 172.21.15.19:0/385199754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb5f40041f0 con 0x55d6adeae800 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f8036040 con 0x55d6adeae800 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5deffd640 1 -- 172.21.15.19:0/385199754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb5f40043f0 con 0x55d6adeae800 2024-09-11T00:04:52.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb60800c740 10 client.15783 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d6adecb3c0 con 0x55d6adeae800 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.613+0000 7fb5deffd640 1 -- 172.21.15.19:0/385199754 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8036040 con 0x55d6adeae800 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb5deffd640 1 -- 172.21.15.19:0/385199754 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb5f4017070 con 0x55d6adeae800 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb60800c740 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb60800c740 10 client.15783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb60800c740 20 client.15783 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb60800c740 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adecc920 0x55d6adeced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb60800c740 4 client.15783 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6ade26db0 con 0x55d6adecc920 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb5fffff640 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adecc920 0x55d6adeced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb5fffff640 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adecc920 0x55d6adeced90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d59a5eca3d2471a1 server_cookie=1de83b217b639c83 in_seq=0 out_seq=0 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.614+0000 7fb5deffd640 10 client.15783 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:52.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.615+0000 7fb5deffd640 1 -- 172.21.15.19:0/385199754 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6ade26db0 con 0x55d6adecc920 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.615+0000 7fb5deffd640 10 client.15783 handle_command_reply: tid=0 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.615+0000 7fb60800c740 1 client.15783 shutdown 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.615+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 msgr2=0x55d6adeb9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.615+0000 7fb60800c740 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adeb9e40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400ecf0 tx=0x7fb5f400c7a0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 shutdown_connections 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adeba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adecc920 0x55d6adeced90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeae800 0x55d6adeb9e40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 --2- 172.21.15.19:0/385199754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeadee0 0x55d6adeb9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 >> 172.21.15.19:0/385199754 conn(0x55d6adeabd10 msgr2=0x55d6adeaaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb5deffd640 0 client.15783 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 shutdown_connections 2024-09-11T00:04:52.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 1 -- 172.21.15.19:0/385199754 wait complete. 2024-09-11T00:04:52.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.616+0000 7fb60800c740 20 client.15783 trim_cache size 0 max 16384 2024-09-11T00:04:52.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.633+0000 7fb60800c740 1 Processor -- start 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.633+0000 7fb60800c740 1 -- start start 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb60800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adeadee0 0x55d6adeac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb60800c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adeacf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb60800c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adebc9a0 0x55d6aded46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb60800c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001aec70 con 0x55d6adebc9a0 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb60800c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ac4e0 con 0x55d6adeae800 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb60800c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001aa330 con 0x55d6adeadee0 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adebc9a0 0x55d6aded46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adebc9a0 0x55d6aded46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54594/0 (socket says 172.21.15.19:54594) 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 -- 172.21.15.19:0/1925300077 learned_addr learned my addr 172.21.15.19:0/1925300077 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adeadee0 0x55d6adeac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5feffd640 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adeacf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 -- 172.21.15.19:0/1925300077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adeadee0 msgr2=0x55d6adeac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adeadee0 0x55d6adeac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 -- 172.21.15.19:0/1925300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 msgr2=0x55d6adeacf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adeacf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 -- 172.21.15.19:0/1925300077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6adebf180 con 0x55d6adebc9a0 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5fffff640 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adebc9a0 0x55d6aded46a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000f80 tx=0x7fb5f8005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3def26b34822d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5e57fa640 1 -- 172.21.15.19:0/1925300077 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8003a90 con 0x55d6adebc9a0 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5e57fa640 1 -- 172.21.15.19:0/1925300077 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8036040 con 0x55d6adebc9a0 2024-09-11T00:04:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.634+0000 7fb5e57fa640 1 -- 172.21.15.19:0/1925300077 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f802f660 con 0x55d6adebc9a0 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 -- 172.21.15.19:0/1925300077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adebc9a0 msgr2=0x55d6aded46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adebc9a0 0x55d6aded46a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000f80 tx=0x7fb5f8005c30 comp rx=0 tx=0).stop 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 -- 172.21.15.19:0/1925300077 shutdown_connections 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adebc9a0 0x55d6aded46a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adeacf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 --2- 172.21.15.19:0/1925300077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adeadee0 0x55d6adeac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 -- 172.21.15.19:0/1925300077 >> 172.21.15.19:0/1925300077 conn(0x55d6adeabd10 msgr2=0x55d6adeb8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 -- 172.21.15.19:0/1925300077 shutdown_connections 2024-09-11T00:04:52.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 -- 172.21.15.19:0/1925300077 wait complete. 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.635+0000 7fb60800c740 1 -- start start 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 1 Processor -- start 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeadee0 0x55d6adec48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adec4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001aa9a0 con 0x55d6adeadee0 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001abe10 con 0x55d6adeae800 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ab070 con 0x55d6adebc9a0 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb60800c740 10 client.0 _ll_register_callbacks cb 0x7fb5f400ad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeadee0 0x55d6adec48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb5fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeadee0 0x55d6adec48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54596/0 (socket says 172.21.15.19:54596) 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb5fffff640 1 -- 172.21.15.19:0/3766654887 learned_addr learned my addr 172.21.15.19:0/3766654887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb5fffff640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.636+0000 7fb5feffd640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adec4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5fffff640 1 -- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 msgr2=0x55d6adebf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5fffff640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5fffff640 1 -- 172.21.15.19:0/3766654887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 msgr2=0x55d6adec4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5fffff640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adec4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5fffff640 1 -- 172.21.15.19:0/3766654887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6adebfde0 con 0x55d6adeadee0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5feffd640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adec4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5fffff640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeadee0 0x55d6adec48f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80041e0 tx=0x7fb5f8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2409c03f6b1f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5deffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5deffd640 1 -- 172.21.15.19:0/3766654887 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f804a040 con 0x55d6adeadee0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5deffd640 1 -- 172.21.15.19:0/3766654887 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb5f8004530 con 0x55d6adeadee0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f8036040 con 0x55d6adeadee0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5deffd640 1 -- 172.21.15.19:0/3766654887 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb5f8004730 con 0x55d6adeadee0 2024-09-11T00:04:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb60800c740 10 client.15789 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d6adf39f60 con 0x55d6adeadee0 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.637+0000 7fb5deffd640 1 -- 172.21.15.19:0/3766654887 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8036040 con 0x55d6adeadee0 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb5deffd640 1 -- 172.21.15.19:0/3766654887 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb5f802fc30 con 0x55d6adeadee0 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb60800c740 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb60800c740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb60800c740 20 client.15789 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb60800c740 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adf3a1e0 0x55d6adf3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb60800c740 4 client.15789 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d6ade22860 con 0x55d6adf3a1e0 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb5feffd640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adf3a1e0 0x55d6adf3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb5deffd640 10 client.15789 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.638+0000 7fb5feffd640 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adf3a1e0 0x55d6adf3c600 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a712a7d4d9c3aa server_cookie=7d7c0e8f41516cf1 in_seq=0 out_seq=0 2024-09-11T00:04:52.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.640+0000 7fb5deffd640 1 -- 172.21.15.19:0/3766654887 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d6ade22860 con 0x55d6adf3a1e0 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.640+0000 7fb5deffd640 10 client.15789 handle_command_reply: tid=0 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.640+0000 7fb60800c740 1 client.15789 shutdown 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.640+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeadee0 msgr2=0x55d6adec48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.640+0000 7fb60800c740 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeadee0 0x55d6adec48f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80041e0 tx=0x7fb5f8009a20 comp rx=0 tx=0).stop 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.640+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 shutdown_connections 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.640+0000 7fb60800c740 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6adebc9a0 0x55d6adebf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb60800c740 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6adeae800 0x55d6adec4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb60800c740 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d6adf3a1e0 0x55d6adf3c600 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb60800c740 1 --2- 172.21.15.19:0/3766654887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6adeadee0 0x55d6adec48f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb5deffd640 0 client.15789 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 >> 172.21.15.19:0/3766654887 conn(0x55d6adeabd10 msgr2=0x55d6adeaa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 shutdown_connections 2024-09-11T00:04:52.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb60800c740 1 -- 172.21.15.19:0/3766654887 wait complete. 2024-09-11T00:04:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb60800c740 20 client.15789 trim_cache size 0 max 16384 2024-09-11T00:04:52.646 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:04:52.646 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:04:52.646 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "0e0bc6ee-daea-46fa-b5f6-9dd10e128072", 2024-09-11T00:04:52.646 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:04:52.646 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb5e80b5450 msgr2=0x7fb5e80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb5e80b5450 0x7fb5e80b7910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00e3960 tx=0x7fb5f00cf040 comp rx=0 tx=0).stop 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600101810 msgr2=0x7fb600197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600101810 0x7fb600197060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c920 tx=0x7fb5f000cde0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 shutdown_connections 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6001077c0 0x7fb60019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb5e80b5450 0x7fb5e80b7910 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb600106e40 0x7fb6001975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 --2- 172.21.15.19:0/27615057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb600101810 0x7fb600197060 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.641+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 >> 172.21.15.19:0/27615057 conn(0x7fb600076f50 msgr2=0x7fb600104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.642+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 shutdown_connections 2024-09-11T00:04:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:52.642+0000 7fb605c37640 1 -- 172.21.15.19:0/27615057 wait complete. 2024-09-11T00:04:53.106 INFO:tasks.workunit.client.0.smithi019.stdout: 59 941782 387 581435 319 523845 1225 2024-09-11T00:04:53.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:04:53.702 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:53 smithi135 ceph-mon[35432]: pgmap v396: 97 pgs: 97 active+clean; 300 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 349 op/s 2024-09-11T00:04:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:53 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:04:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:53 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:53 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:04:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:53 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:04:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:53 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:04:54.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:53 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:53 smithi019 ceph-mon[30859]: pgmap v396: 97 pgs: 97 active+clean; 300 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 349 op/s 2024-09-11T00:04:54.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:53 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:04:54.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:53 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:53 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:04:54.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:53 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:04:54.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:53 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:04:54.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:53 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:53 smithi131 ceph-mon[35491]: pgmap v396: 97 pgs: 97 active+clean; 300 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 349 op/s 2024-09-11T00:04:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:53 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:04:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:53 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:53 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:04:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:53 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:04:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:53 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:04:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:53 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:54 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:54 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:04:54.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:54 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 -- 172.21.15.19:0/396000765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb404102dc0 msgr2=0x7fb4041031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 --2- 172.21.15.19:0/396000765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb404102dc0 0x7fb4041031a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb400009900 tx=0x7fb40002a410 comp rx=0 tx=0).stop 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 -- 172.21.15.19:0/396000765 shutdown_connections 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 --2- 172.21.15.19:0/396000765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb404109150 0x7fb40410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 --2- 172.21.15.19:0/396000765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4041087d0 0x7fb404108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 --2- 172.21.15.19:0/396000765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb404102dc0 0x7fb4041031a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 -- 172.21.15.19:0/396000765 >> 172.21.15.19:0/396000765 conn(0x7fb4040fe830 msgr2=0x7fb404100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 -- 172.21.15.19:0/396000765 shutdown_connections 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 -- 172.21.15.19:0/396000765 wait complete. 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 Processor -- start 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.808+0000 7fb40c731640 1 -- start start 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40c731640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb404102dc0 0x7fb404199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40c731640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4041087d0 0x7fb4041998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40c731640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb404109150 0x7fb40419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40c731640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb404112e10 con 0x7fb4041087d0 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40c731640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb404112c90 con 0x7fb404109150 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40c731640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb404112f90 con 0x7fb404102dc0 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4041087d0 0x7fb4041998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4041087d0 0x7fb4041998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54614/0 (socket says 172.21.15.19:54614) 2024-09-11T00:04:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 -- 172.21.15.19:0/3874995621 learned_addr learned my addr 172.21.15.19:0/3874995621 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb404102dc0 0x7fb404199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40acce640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb404109150 0x7fb40419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 -- 172.21.15.19:0/3874995621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb404102dc0 msgr2=0x7fb404199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb404102dc0 0x7fb404199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 -- 172.21.15.19:0/3874995621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb404109150 msgr2=0x7fb40419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb404109150 0x7fb40419ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 -- 172.21.15.19:0/3874995621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40419f410 con 0x7fb4041087d0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb404102dc0 0x7fb404199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.809+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4041087d0 0x7fb4041998a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400d950 tx=0x7fb3f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.810+0000 7fb3fb7fe640 1 -- 172.21.15.19:0/3874995621 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4017070 con 0x7fb4041087d0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.810+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40419f700 con 0x7fb4041087d0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.810+0000 7fb3fb7fe640 1 -- 172.21.15.19:0/3874995621 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3f4009c30 con 0x7fb4041087d0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.810+0000 7fb3fb7fe640 1 -- 172.21.15.19:0/3874995621 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400f620 con 0x7fb4041087d0 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.810+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4041a5f90 con 0x7fb4041087d0 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.812+0000 7fb3fb7fe640 1 -- 172.21.15.19:0/3874995621 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fb3f4010460 con 0x7fb4041087d0 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.812+0000 7fb40eb06740 1 Processor -- start 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.812+0000 7fb40eb06740 1 -- start start 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694c480 0x558ff694c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff69587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff695b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40eb06740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558ff68c2e50 con 0x558ff694cda0 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40eb06740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558ff68b2280 con 0x558ff694c480 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40eb06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558ff68b6090 con 0x558ff6958d30 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40a4cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff69587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40acce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694c480 0x558ff694c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb409ccc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff695b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40a4cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff69587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54628/0 (socket says 172.21.15.19:54628) 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40a4cd640 1 -- 172.21.15.19:0/1841734995 learned_addr learned my addr 172.21.15.19:0/1841734995 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40acce640 1 -- 172.21.15.19:0/1841734995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 msgr2=0x558ff695b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40acce640 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff695b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40acce640 1 -- 172.21.15.19:0/1841734995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 msgr2=0x558ff69587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40acce640 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff69587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40acce640 1 -- 172.21.15.19:0/1841734995 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff6610650 con 0x558ff694c480 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff69587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.813+0000 7fb3fb7fe640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3f00b5450 0x7fb3f00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.814+0000 7fb40acce640 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694c480 0x558ff694c860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc005bd0 tx=0x7fb3fc005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd18089df567623 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.814+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3f00b5450 0x7fb3f00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.814+0000 7fb3fb7fe640 1 -- 172.21.15.19:0/3874995621 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb3f40e5b50 con 0x7fb4041087d0 2024-09-11T00:04:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.814+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3f00b5450 0x7fb3f00b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb400005c40 tx=0x7fb400005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.817+0000 7fb3f8ff9640 1 -- 172.21.15.19:0/1841734995 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc004d20 con 0x558ff694c480 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.817+0000 7fb3f8ff9640 1 -- 172.21.15.19:0/1841734995 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3fc01e070 con 0x558ff694c480 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.817+0000 7fb3f8ff9640 1 -- 172.21.15.19:0/1841734995 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0042b0 con 0x558ff694c480 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.817+0000 7fb40eb06740 1 -- 172.21.15.19:0/1841734995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694c480 msgr2=0x558ff694c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.817+0000 7fb40eb06740 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694c480 0x558ff694c860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc005bd0 tx=0x7fb3fc005c00 comp rx=0 tx=0).stop 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- 172.21.15.19:0/1841734995 shutdown_connections 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff695b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff69587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 --2- 172.21.15.19:0/1841734995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694c480 0x558ff694c860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- 172.21.15.19:0/1841734995 >> 172.21.15.19:0/1841734995 conn(0x558ff694a2b0 msgr2=0x558ff694b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- 172.21.15.19:0/1841734995 shutdown_connections 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- 172.21.15.19:0/1841734995 wait complete. 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- start start 2024-09-11T00:04:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 Processor -- start 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694c480 0x558ff6958640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694cda0 0x558ff6955a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff69560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558ff6713700 con 0x558ff694c480 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558ff684d110 con 0x558ff694cda0 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.818+0000 7fb40eb06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558ff695b9b0 con 0x558ff6958d30 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb40eb06740 10 client.0 _ll_register_callbacks cb 0x558ff6866990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb40a4cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694c480 0x558ff6958640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb40a4cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694c480 0x558ff6958640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54630/0 (socket says 172.21.15.19:54630) 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb40a4cd640 1 -- 172.21.15.19:0/3782171783 learned_addr learned my addr 172.21.15.19:0/3782171783 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694cda0 0x558ff6955a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb40acce640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff69560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb409ccc640 1 -- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 msgr2=0x558ff69560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff69560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb409ccc640 1 -- 172.21.15.19:0/3782171783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694c480 msgr2=0x558ff6958640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694c480 0x558ff6958640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb409ccc640 1 -- 172.21.15.19:0/3782171783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff687ac40 con 0x558ff694cda0 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694c480 0x558ff6958640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694cda0 0x558ff6955a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40e3320 tx=0x7fb3f40e9290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d37917e01843a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.819+0000 7fb3edffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.820+0000 7fb3edffb640 1 -- 172.21.15.19:0/3782171783 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4020070 con 0x558ff694cda0 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.820+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3fc01e070 con 0x558ff694cda0 2024-09-11T00:04:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.820+0000 7fb3edffb640 1 -- 172.21.15.19:0/3782171783 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb3f4010780 con 0x558ff694cda0 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.838+0000 7fb3edffb640 1 -- 172.21.15.19:0/3782171783 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb3f40a7fa0 con 0x558ff694cda0 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.838+0000 7fb40eb06740 10 client.25259 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.838+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ff6967420 con 0x558ff694cda0 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb3edffb640 1 -- 172.21.15.19:0/3782171783 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3fc01e070 con 0x558ff694cda0 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb3edffb640 1 -- 172.21.15.19:0/3782171783 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb3f40aadd0 con 0x558ff694cda0 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40eb06740 10 client.25259 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40eb06740 10 client.25259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40eb06740 20 client.25259 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff6968830 0x558ff696ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40eb06740 4 client.25259 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ff68c4da0 con 0x558ff6968830 2024-09-11T00:04:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff6968830 0x558ff696ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff6968830 0x558ff696ac40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a61652e76ef6e3f server_cookie=81218d7bff1ba9d8 in_seq=0 out_seq=0 2024-09-11T00:04:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.839+0000 7fb3edffb640 10 client.25259 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:54.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.840+0000 7fb3edffb640 1 -- 172.21.15.19:0/3782171783 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ff68c4da0 con 0x558ff6968830 2024-09-11T00:04:54.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.840+0000 7fb3edffb640 10 client.25259 handle_command_reply: tid=0 2024-09-11T00:04:54.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.840+0000 7fb40eb06740 1 client.25259 shutdown 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694cda0 msgr2=0x558ff6955a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694cda0 0x558ff6955a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40e3320 tx=0x7fb3f40e9290 comp rx=0 tx=0).stop 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 shutdown_connections 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff6958d30 0x558ff69560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff694cda0 0x558ff6955a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff6968830 0x558ff696ac40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3782171783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694c480 0x558ff6958640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb3edffb640 0 client.25259 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 >> 172.21.15.19:0/3782171783 conn(0x558ff694a2b0 msgr2=0x558ff694fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 shutdown_connections 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 1 -- 172.21.15.19:0/3782171783 wait complete. 2024-09-11T00:04:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.841+0000 7fb40eb06740 20 client.25259 trim_cache size 0 max 16384 2024-09-11T00:04:54.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 Processor -- start 2024-09-11T00:04:54.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 -- start start 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff694ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff6964c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff6954f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041aed10 con 0x558ff694cda0 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041ac580 con 0x558ff6958d30 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40eb06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041aa3f0 con 0x558ff694c480 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb409ccc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff6964c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb409ccc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff6964c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54640/0 (socket says 172.21.15.19:54640) 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb40a4cd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff694ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.859+0000 7fb409ccc640 1 -- 172.21.15.19:0/3486255948 learned_addr learned my addr 172.21.15.19:0/3486255948 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb40acce640 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff6954f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb409ccc640 1 -- 172.21.15.19:0/3486255948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 msgr2=0x558ff694ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff694ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb409ccc640 1 -- 172.21.15.19:0/3486255948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 msgr2=0x558ff6954f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff6954f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb409ccc640 1 -- 172.21.15.19:0/3486255948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff69549f0 con 0x558ff694cda0 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb40acce640 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff6954f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff6964c40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4000c00 tx=0x7fb3f40e5ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525237e4de5fb23c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb3effff640 1 -- 172.21.15.19:0/3486255948 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4020050 con 0x558ff694cda0 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb3effff640 1 -- 172.21.15.19:0/3486255948 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3f4009de0 con 0x558ff694cda0 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.860+0000 7fb3effff640 1 -- 172.21.15.19:0/3486255948 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40ab870 con 0x558ff694cda0 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 -- 172.21.15.19:0/3486255948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 msgr2=0x558ff6964c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff6964c40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4000c00 tx=0x7fb3f40e5ee0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 -- 172.21.15.19:0/3486255948 shutdown_connections 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff6954f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff6964c40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3486255948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff694ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 -- 172.21.15.19:0/3486255948 >> 172.21.15.19:0/3486255948 conn(0x558ff694a2b0 msgr2=0x558ff694b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 -- 172.21.15.19:0/3486255948 shutdown_connections 2024-09-11T00:04:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 -- 172.21.15.19:0/3486255948 wait complete. 2024-09-11T00:04:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 -- start start 2024-09-11T00:04:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.861+0000 7fb40eb06740 1 Processor -- start 2024-09-11T00:04:54.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff6961220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff695ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40eb06740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff695f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40eb06740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041aaa40 con 0x558ff694cda0 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40eb06740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041abeb0 con 0x558ff6958d30 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40eb06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041ab110 con 0x558ff694c480 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb409ccc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff695ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb409ccc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff695ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54656/0 (socket says 172.21.15.19:54656) 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40eb06740 10 client.0 _ll_register_callbacks cb 0x7fb3f400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb409ccc640 1 -- 172.21.15.19:0/3288296670 learned_addr learned my addr 172.21.15.19:0/3288296670 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff6961220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40acce640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff695f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40a4cd640 1 -- 172.21.15.19:0/3288296670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 msgr2=0x558ff695f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff695f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40a4cd640 1 -- 172.21.15.19:0/3288296670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 msgr2=0x558ff695ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff695ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40a4cd640 1 -- 172.21.15.19:0/3288296670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff695f870 con 0x558ff694c480 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff695ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb40a4cd640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff6961220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb400031440 tx=0x7fb400009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db3d1dfe26075871 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.862+0000 7fb3edffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb3edffb640 1 -- 172.21.15.19:0/3288296670 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40005f060 con 0x558ff694c480 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb3edffb640 1 -- 172.21.15.19:0/3288296670 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb4000052d0 con 0x558ff694c480 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f4009de0 con 0x558ff694c480 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb3edffb640 1 -- 172.21.15.19:0/3288296670 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb400035040 con 0x558ff694c480 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 10 client.25435 fetch_fsmap learned FSMap version 29 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ff69d64d0 con 0x558ff694c480 2024-09-11T00:04:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb3edffb640 1 -- 172.21.15.19:0/3288296670 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3f4009de0 con 0x558ff694c480 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb3edffb640 1 -- 172.21.15.19:0/3288296670 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb400003710 con 0x558ff694c480 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 10 client.25435 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 10 client.25435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 20 client.25435 populate_metadata read hostname 'smithi019' 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff69d6cb0 0x558ff69d90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 4 client.25435 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.863+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ff68c0850 con 0x558ff69d6cb0 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff69d6cb0 0x558ff69d90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb409ccc640 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff69d6cb0 0x558ff69d90d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7946c73e466c5836 server_cookie=c7637a5e0a62d62f in_seq=0 out_seq=0 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb3edffb640 10 client.25435 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb3edffb640 1 -- 172.21.15.19:0/3288296670 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x558ff68c0850 con 0x558ff69d6cb0 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb3edffb640 10 client.25435 handle_command_reply: tid=0 2024-09-11T00:04:54.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 client.25435 shutdown 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 msgr2=0x558ff6961220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff6961220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb400031440 tx=0x7fb400009260 comp rx=0 tx=0).stop 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 shutdown_connections 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ff6958d30 0x558ff695f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x558ff69d6cb0 0x558ff69d90d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ff694cda0 0x558ff695ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb3edffb640 0 client.25435 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 --2- 172.21.15.19:0/3288296670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ff694c480 0x558ff6961220 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 >> 172.21.15.19:0/3288296670 conn(0x558ff694a2b0 msgr2=0x558ff6948bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 shutdown_connections 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.864+0000 7fb40eb06740 1 -- 172.21.15.19:0/3288296670 wait complete. 2024-09-11T00:04:54.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40eb06740 20 client.25435 trim_cache size 0 max 16384 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "0e0bc6ee-daea-46fa-b5f6-9dd10e128072", 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:04:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:04:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:04:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:04:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:04:54.875 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:04:54.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3f00b5450 msgr2=0x7fb3f00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3f00b5450 0x7fb3f00b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb400005c40 tx=0x7fb400005b50 comp rx=0 tx=0).stop 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4041087d0 msgr2=0x7fb4041998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4041087d0 0x7fb4041998a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400d950 tx=0x7fb3f400de10 comp rx=0 tx=0).stop 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 shutdown_connections 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb404109150 0x7fb40419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb3f00b5450 0x7fb3f00b7910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4041087d0 0x7fb4041998a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 --2- 172.21.15.19:0/3874995621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb404102dc0 0x7fb404199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 >> 172.21.15.19:0/3874995621 conn(0x7fb4040fe830 msgr2=0x7fb404100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 shutdown_connections 2024-09-11T00:04:54.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:04:54.865+0000 7fb40c731640 1 -- 172.21.15.19:0/3874995621 wait complete. 2024-09-11T00:04:55.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:54 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:55.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:54 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:04:55.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:54 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:55.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:54 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:55.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:54 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:04:55.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:54 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:04:55.761 INFO:tasks.cephfs.filesystem:scrub status for tag:0e0bc6ee-daea-46fa-b5f6-9dd10e128072 - {'path': '/', 'tag': '0e0bc6ee-daea-46fa-b5f6-9dd10e128072', 'options': 'recursive,force'} 2024-09-11T00:04:56.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:55 smithi135 ceph-mon[35432]: pgmap v397: 97 pgs: 97 active+clean; 320 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.4 MiB/s wr, 392 op/s 2024-09-11T00:04:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:55 smithi019 ceph-mon[30859]: pgmap v397: 97 pgs: 97 active+clean; 320 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.4 MiB/s wr, 392 op/s 2024-09-11T00:04:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:55 smithi131 ceph-mon[35491]: pgmap v397: 97 pgs: 97 active+clean; 320 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.4 MiB/s wr, 392 op/s 2024-09-11T00:04:58.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:57 smithi019 ceph-mon[30859]: pgmap v398: 97 pgs: 97 active+clean; 326 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.7 MiB/s wr, 478 op/s 2024-09-11T00:04:58.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:57 smithi135 ceph-mon[35432]: pgmap v398: 97 pgs: 97 active+clean; 326 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.7 MiB/s wr, 478 op/s 2024-09-11T00:04:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:57 smithi131 ceph-mon[35491]: pgmap v398: 97 pgs: 97 active+clean; 326 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.7 MiB/s wr, 478 op/s 2024-09-11T00:05:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:04:59 smithi135 ceph-mon[35432]: pgmap v399: 97 pgs: 97 active+clean; 328 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 545 op/s 2024-09-11T00:05:00.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:04:59 smithi019 ceph-mon[30859]: pgmap v399: 97 pgs: 97 active+clean; 328 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 545 op/s 2024-09-11T00:05:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:04:59 smithi131 ceph-mon[35491]: pgmap v399: 97 pgs: 97 active+clean; 328 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 545 op/s 2024-09-11T00:05:01.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:00 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:01.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:00 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:01.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:00 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:02.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:01 smithi135 ceph-mon[35432]: pgmap v400: 97 pgs: 97 active+clean; 328 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 533 op/s 2024-09-11T00:05:02.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:01 smithi019 ceph-mon[30859]: pgmap v400: 97 pgs: 97 active+clean; 328 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 533 op/s 2024-09-11T00:05:02.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:01 smithi131 ceph-mon[35491]: pgmap v400: 97 pgs: 97 active+clean; 328 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 533 op/s 2024-09-11T00:05:03.106 INFO:tasks.workunit.client.0.smithi019.stdout: 59 25022 2 16189 6 14117 10 2024-09-11T00:05:04.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:03 smithi135 ceph-mon[35432]: pgmap v401: 97 pgs: 97 active+clean; 331 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.2 MiB/s wr, 486 op/s 2024-09-11T00:05:04.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:03 smithi019 ceph-mon[30859]: pgmap v401: 97 pgs: 97 active+clean; 331 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.2 MiB/s wr, 486 op/s 2024-09-11T00:05:04.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:03 smithi131 ceph-mon[35491]: pgmap v401: 97 pgs: 97 active+clean; 331 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.2 MiB/s wr, 486 op/s 2024-09-11T00:05:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:05 smithi135 ceph-mon[35432]: pgmap v402: 97 pgs: 97 active+clean; 332 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 295 op/s 2024-09-11T00:05:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:05 smithi019 ceph-mon[30859]: pgmap v402: 97 pgs: 97 active+clean; 332 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 295 op/s 2024-09-11T00:05:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:05 smithi131 ceph-mon[35491]: pgmap v402: 97 pgs: 97 active+clean; 332 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 295 op/s 2024-09-11T00:05:08.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:07 smithi135 ceph-mon[35432]: pgmap v403: 97 pgs: 97 active+clean; 336 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.9 MiB/s wr, 270 op/s 2024-09-11T00:05:08.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:07 smithi019 ceph-mon[30859]: pgmap v403: 97 pgs: 97 active+clean; 336 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.9 MiB/s wr, 270 op/s 2024-09-11T00:05:08.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:07 smithi131 ceph-mon[35491]: pgmap v403: 97 pgs: 97 active+clean; 336 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.9 MiB/s wr, 270 op/s 2024-09-11T00:05:10.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:09 smithi135 ceph-mon[35432]: pgmap v404: 97 pgs: 97 active+clean; 347 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-09-11T00:05:10.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:09 smithi019 ceph-mon[30859]: pgmap v404: 97 pgs: 97 active+clean; 347 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-09-11T00:05:10.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:09 smithi131 ceph-mon[35491]: pgmap v404: 97 pgs: 97 active+clean; 347 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-09-11T00:05:12.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:11 smithi135 ceph-mon[35432]: pgmap v405: 97 pgs: 97 active+clean; 347 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 177 op/s 2024-09-11T00:05:12.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:11 smithi019 ceph-mon[30859]: pgmap v405: 97 pgs: 97 active+clean; 347 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 177 op/s 2024-09-11T00:05:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:11 smithi131 ceph-mon[35491]: pgmap v405: 97 pgs: 97 active+clean; 347 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 177 op/s 2024-09-11T00:05:13.106 INFO:tasks.workunit.client.0.smithi019.stdout: 63 98288 95 67107 143 56801 309 2024-09-11T00:05:14.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:13 smithi135 ceph-mon[35432]: pgmap v406: 97 pgs: 97 active+clean; 348 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-09-11T00:05:14.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:13 smithi019 ceph-mon[30859]: pgmap v406: 97 pgs: 97 active+clean; 348 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-09-11T00:05:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:13 smithi131 ceph-mon[35491]: pgmap v406: 97 pgs: 97 active+clean; 348 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-09-11T00:05:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:15 smithi135 ceph-mon[35432]: pgmap v407: 97 pgs: 97 active+clean; 351 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-09-11T00:05:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:15 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:05:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:15 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:05:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:15 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:05:16.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:15 smithi019 ceph-mon[30859]: pgmap v407: 97 pgs: 97 active+clean; 351 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-09-11T00:05:16.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:15 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:05:16.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:15 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:05:16.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:15 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:05:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:15 smithi131 ceph-mon[35491]: pgmap v407: 97 pgs: 97 active+clean; 351 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-09-11T00:05:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:15 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:05:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:15 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:05:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:15 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:05:18.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:17 smithi135 ceph-mon[35432]: pgmap v408: 97 pgs: 97 active+clean; 360 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 218 op/s 2024-09-11T00:05:18.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:17 smithi019 ceph-mon[30859]: pgmap v408: 97 pgs: 97 active+clean; 360 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 218 op/s 2024-09-11T00:05:18.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:17 smithi131 ceph-mon[35491]: pgmap v408: 97 pgs: 97 active+clean; 360 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 218 op/s 2024-09-11T00:05:19.994 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:19 smithi019 ceph-mon[30859]: pgmap v409: 97 pgs: 97 active+clean; 373 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 232 op/s 2024-09-11T00:05:20.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:19 smithi135 ceph-mon[35432]: pgmap v409: 97 pgs: 97 active+clean; 373 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 232 op/s 2024-09-11T00:05:20.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:19 smithi131 ceph-mon[35491]: pgmap v409: 97 pgs: 97 active+clean; 373 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 232 op/s 2024-09-11T00:05:22.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:21 smithi135 ceph-mon[35432]: pgmap v410: 97 pgs: 97 active+clean; 380 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 188 op/s 2024-09-11T00:05:22.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:21 smithi019 ceph-mon[30859]: pgmap v410: 97 pgs: 97 active+clean; 380 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 188 op/s 2024-09-11T00:05:22.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:21 smithi131 ceph-mon[35491]: pgmap v410: 97 pgs: 97 active+clean; 380 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 188 op/s 2024-09-11T00:05:23.107 INFO:tasks.workunit.client.0.smithi019.stdout: 71 1150985 401 742325 488 660445 1743 2024-09-11T00:05:24.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:23 smithi135 ceph-mon[35432]: pgmap v411: 97 pgs: 97 active+clean; 384 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 216 op/s 2024-09-11T00:05:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:23 smithi019 ceph-mon[30859]: pgmap v411: 97 pgs: 97 active+clean; 384 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 216 op/s 2024-09-11T00:05:24.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:23 smithi131 ceph-mon[35491]: pgmap v411: 97 pgs: 97 active+clean; 384 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 216 op/s 2024-09-11T00:05:25.763 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:05:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:26.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:25 smithi135 ceph-mon[35432]: pgmap v412: 97 pgs: 97 active+clean; 388 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 211 op/s 2024-09-11T00:05:26.177 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:25 smithi019 ceph-mon[30859]: pgmap v412: 97 pgs: 97 active+clean; 388 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 211 op/s 2024-09-11T00:05:26.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:25 smithi131 ceph-mon[35491]: pgmap v412: 97 pgs: 97 active+clean; 388 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 211 op/s 2024-09-11T00:05:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.900+0000 7f86067fc640 1 -- 172.21.15.19:0/1476357242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600031dd0 con 0x7f860810a150 2024-09-11T00:05:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.901+0000 7f860dc75640 1 -- 172.21.15.19:0/1476357242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860810a150 msgr2=0x7f86081111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.901+0000 7f860dc75640 1 --2- 172.21.15.19:0/1476357242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860810a150 0x7f86081111b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8600009cd0 tx=0x7f860002a930 comp rx=0 tx=0).stop 2024-09-11T00:05:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.902+0000 7f860dc75640 1 -- 172.21.15.19:0/1476357242 shutdown_connections 2024-09-11T00:05:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.902+0000 7f860dc75640 1 --2- 172.21.15.19:0/1476357242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f860811c0a0 0x7f860811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.902+0000 7f860dc75640 1 --2- 172.21.15.19:0/1476357242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f860810a530 0x7f860810a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.902+0000 7f860dc75640 1 --2- 172.21.15.19:0/1476357242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860810a150 0x7f86081111b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.902+0000 7f860dc75640 1 -- 172.21.15.19:0/1476357242 >> 172.21.15.19:0/1476357242 conn(0x7f860806cb40 msgr2=0x7f860806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.903+0000 7f860dc75640 1 -- 172.21.15.19:0/1476357242 shutdown_connections 2024-09-11T00:05:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.903+0000 7f860dc75640 1 -- 172.21.15.19:0/1476357242 wait complete. 2024-09-11T00:05:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.904+0000 7f860dc75640 1 Processor -- start 2024-09-11T00:05:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.904+0000 7f860dc75640 1 -- start start 2024-09-11T00:05:26.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.905+0000 7f860dc75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f860810a150 0x7f86081a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.905+0000 7f860dc75640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f860810a530 0x7f86081a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.905+0000 7f860dc75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860811c0a0 0x7f86081ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.905+0000 7f86077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f860810a150 0x7f86081a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.905+0000 7f86077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f860810a150 0x7f86081a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54828/0 (socket says 172.21.15.19:54828) 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8606ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f860810a530 0x7f86081a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8607fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860811c0a0 0x7f86081ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8606ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f860810a530 0x7f86081a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:35100/0 (socket says 172.21.15.19:35100) 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8607fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860811c0a0 0x7f86081ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46644/0 (socket says 172.21.15.19:46644) 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f860dc75640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8608121a80 con 0x7f860811c0a0 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f86077fe640 1 -- 172.21.15.19:0/439637369 learned_addr learned my addr 172.21.15.19:0/439637369 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8608121900 con 0x7f860810a530 2024-09-11T00:05:26.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8608121c00 con 0x7f860810a150 2024-09-11T00:05:26.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8607fff640 1 -- 172.21.15.19:0/439637369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f860810a150 msgr2=0x7f86081a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8607fff640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f860810a150 0x7f86081a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8607fff640 1 -- 172.21.15.19:0/439637369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f860810a530 msgr2=0x7f86081a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8607fff640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f860810a530 0x7f86081a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.906+0000 7f8607fff640 1 -- 172.21.15.19:0/439637369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86081adfa0 con 0x7f860811c0a0 2024-09-11T00:05:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.907+0000 7f8607fff640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860811c0a0 0x7f86081ad7d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f85f800b410 tx=0x7f85f800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.907+0000 7f8604ff9640 1 -- 172.21.15.19:0/439637369 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8015020 con 0x7f860811c0a0 2024-09-11T00:05:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.907+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86081ae290 con 0x7f860811c0a0 2024-09-11T00:05:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.907+0000 7f8604ff9640 1 -- 172.21.15.19:0/439637369 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85f8011ce0 con 0x7f860811c0a0 2024-09-11T00:05:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.907+0000 7f8604ff9640 1 -- 172.21.15.19:0/439637369 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8010da0 con 0x7f860811c0a0 2024-09-11T00:05:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.908+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86081b49d0 con 0x7f860811c0a0 2024-09-11T00:05:26.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f8604ff9640 1 -- 172.21.15.19:0/439637369 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f85f8011830 con 0x7f860811c0a0 2024-09-11T00:05:26.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 Processor -- start 2024-09-11T00:05:26.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 -- start start 2024-09-11T00:05:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcc0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbccc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcccb30 0x55fcdbccef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fcdbc36e50 con 0x55fcdbcc0280 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55fcdbc26280 con 0x55fcdbcccb30 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.911+0000 7f861004a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fcdbc2a090 con 0x55fcdbcc0ba0 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcc0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcc0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46660/0 (socket says 172.21.15.19:46660) 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 -- 172.21.15.19:0/2710365790 learned_addr learned my addr 172.21.15.19:0/2710365790 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f86077fe640 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbccc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 -- 172.21.15.19:0/2710365790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0ba0 msgr2=0x55fcdbccc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbccc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 -- 172.21.15.19:0/2710365790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcccb30 msgr2=0x55fcdbccef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcccb30 0x55fcdbccef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 -- 172.21.15.19:0/2710365790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcdb984650 con 0x55fcdbcc0280 2024-09-11T00:05:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8606ffd640 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcc0660 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00bda0 tx=0x7f85fc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7c285b0e8be371 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.912+0000 7f8604ff9640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85f00b55d0 0x7f85f00b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.913+0000 7f86077fe640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85f00b55d0 0x7f85f00b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.913+0000 7f8604ff9640 1 -- 172.21.15.19:0/439637369 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f85f80e5760 con 0x7f860811c0a0 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.913+0000 7f85edffb640 1 -- 172.21.15.19:0/2710365790 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc004230 con 0x55fcdbcc0280 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.913+0000 7f85edffb640 1 -- 172.21.15.19:0/2710365790 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85fc00be90 con 0x55fcdbcc0280 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.913+0000 7f85edffb640 1 -- 172.21.15.19:0/2710365790 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc011750 con 0x55fcdbcc0280 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 -- 172.21.15.19:0/2710365790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 msgr2=0x55fcdbcc0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcc0660 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00bda0 tx=0x7f85fc0107a0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f86077fe640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85f00b55d0 0x7f85f00b7a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55fcdbcbef90 tx=0x7f86000097e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 -- 172.21.15.19:0/2710365790 shutdown_connections 2024-09-11T00:05:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcccb30 0x55fcdbccef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbccc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 --2- 172.21.15.19:0/2710365790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcc0660 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 -- 172.21.15.19:0/2710365790 >> 172.21.15.19:0/2710365790 conn(0x55fcdbcbe0b0 msgr2=0x55fcdbcbf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 -- 172.21.15.19:0/2710365790 shutdown_connections 2024-09-11T00:05:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 -- 172.21.15.19:0/2710365790 wait complete. 2024-09-11T00:05:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.914+0000 7f861004a740 1 -- start start 2024-09-11T00:05:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 1 Processor -- start 2024-09-11T00:05:26.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0280 0x55fcdbccc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcc9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbcc9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fcdba87700 con 0x55fcdbcc0ba0 2024-09-11T00:05:26.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55fcdbbc1110 con 0x55fcdbcc0280 2024-09-11T00:05:26.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fcdbccf7b0 con 0x55fcdbcccb30 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f861004a740 10 client.0 _ll_register_callbacks cb 0x55fcdbbda990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbcc9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8606ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcc9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbcc9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54858/0 (socket says 172.21.15.19:54858) 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 -- 172.21.15.19:0/3667230392 learned_addr learned my addr 172.21.15.19:0/3667230392 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 -- 172.21.15.19:0/3667230392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0280 msgr2=0x55fcdbccc4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0280 0x55fcdbccc4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 -- 172.21.15.19:0/3667230392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0ba0 msgr2=0x55fcdbcc9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcc9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.915+0000 7f8607fff640 1 -- 172.21.15.19:0/3667230392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcdbbeec40 con 0x55fcdbcccb30 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f8607fff640 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbcc9fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f85f80abb90 tx=0x7f85f80abb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2546d2f607402c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f85e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3667230392 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f80b0070 con 0x55fcdbcccb30 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85fc00be90 con 0x55fcdbcccb30 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3667230392 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f85f80b0210 con 0x55fcdbcccb30 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3667230392 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f85f80e3350 con 0x55fcdbcccb30 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f861004a740 10 client.25444 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.916+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fcdbcdb200 con 0x55fcdbcccb30 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.917+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3667230392 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85f80ab710 con 0x55fcdbcccb30 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.917+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3667230392 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f85f80a7550 con 0x55fcdbcccb30 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.917+0000 7f861004a740 10 client.25444 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.917+0000 7f861004a740 10 client.25444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.917+0000 7f861004a740 20 client.25444 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.918+0000 7f861004a740 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbcdc660 0x55fcdbcdeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.918+0000 7f861004a740 4 client.25444 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:26.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.918+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f85fc00be90 con 0x55fcdbcdc660 2024-09-11T00:05:26.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.918+0000 7f86077fe640 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbcdc660 0x55fcdbcdeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.918+0000 7f86077fe640 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbcdc660 0x55fcdbcdeaa0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdc3f14abf204296 server_cookie=4cfafb2caf15b5ec in_seq=0 out_seq=0 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.918+0000 7f85e6ffd640 10 client.25444 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.919+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3667230392 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f85fc00be90 con 0x55fcdbcdc660 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.919+0000 7f85e6ffd640 10 client.25444 handle_command_reply: tid=0 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 client.25444 shutdown 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 msgr2=0x55fcdbcc9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbcc9fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f85f80abb90 tx=0x7f85f80abb00 comp rx=0 tx=0).stop 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 shutdown_connections 2024-09-11T00:05:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbcc9fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbcdc660 0x55fcdbcdeaa0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcc9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 --2- 172.21.15.19:0/3667230392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0280 0x55fcdbccc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f85e6ffd640 0 client.25444 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 >> 172.21.15.19:0/3667230392 conn(0x55fcdbcbe0b0 msgr2=0x55fcdbcc3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 shutdown_connections 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.920+0000 7f861004a740 1 -- 172.21.15.19:0/3667230392 wait complete. 2024-09-11T00:05:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.921+0000 7f861004a740 20 client.25444 trim_cache size 0 max 16384 2024-09-11T00:05:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.952+0000 7f861004a740 1 Processor -- start 2024-09-11T00:05:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.952+0000 7f861004a740 1 -- start start 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f861004a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcbf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f861004a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f861004a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbccdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f861004a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f86081bfb20 con 0x55fcdbcc0280 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f861004a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f86081bd390 con 0x55fcdbcc0ba0 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f861004a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86081bb1e0 con 0x55fcdbcccb30 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcbf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcbf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46686/0 (socket says 172.21.15.19:46686) 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 -- 172.21.15.19:0/2217120528 learned_addr learned my addr 172.21.15.19:0/2217120528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f8607fff640 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbccdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f8606ffd640 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 -- 172.21.15.19:0/2217120528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 msgr2=0x55fcdbccdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbccdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 -- 172.21.15.19:0/2217120528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 msgr2=0x55fcdbcd8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.953+0000 7f86077fe640 1 -- 172.21.15.19:0/2217120528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcdbcb9740 con 0x55fcdbcc0280 2024-09-11T00:05:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.954+0000 7f86077fe640 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcbf880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f860002aef0 tx=0x7f8600040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237d1ac746de3a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.954+0000 7f85ed7fa640 1 -- 172.21.15.19:0/2217120528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600003970 con 0x55fcdbcc0280 2024-09-11T00:05:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.954+0000 7f85ed7fa640 1 -- 172.21.15.19:0/2217120528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8600036040 con 0x55fcdbcc0280 2024-09-11T00:05:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.954+0000 7f85ed7fa640 1 -- 172.21.15.19:0/2217120528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600004700 con 0x55fcdbcc0280 2024-09-11T00:05:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 -- 172.21.15.19:0/2217120528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 msgr2=0x55fcdbcbf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcbf880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f860002aef0 tx=0x7f8600040000 comp rx=0 tx=0).stop 2024-09-11T00:05:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 -- 172.21.15.19:0/2217120528 shutdown_connections 2024-09-11T00:05:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcccb30 0x55fcdbccdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 --2- 172.21.15.19:0/2217120528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcc0280 0x55fcdbcbf880 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 -- 172.21.15.19:0/2217120528 >> 172.21.15.19:0/2217120528 conn(0x55fcdbcbe0b0 msgr2=0x55fcdbcbf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 -- 172.21.15.19:0/2217120528 shutdown_connections 2024-09-11T00:05:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 -- 172.21.15.19:0/2217120528 wait complete. 2024-09-11T00:05:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.955+0000 7f861004a740 1 -- start start 2024-09-11T00:05:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.956+0000 7f861004a740 1 Processor -- start 2024-09-11T00:05:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.956+0000 7f861004a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0280 0x55fcdbcd4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.956+0000 7f861004a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.956+0000 7f861004a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcccb30 0x55fcdbccfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.956+0000 7f861004a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f86081bb850 con 0x55fcdbcccb30 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.956+0000 7f861004a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f86081bccc0 con 0x55fcdbcc0ba0 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.956+0000 7f861004a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86081bbf20 con 0x55fcdbcc0280 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0280 0x55fcdbcd4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f861004a740 10 client.0 _ll_register_callbacks cb 0x7f85f80091f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0280 0x55fcdbcd4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54886/0 (socket says 172.21.15.19:54886) 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 -- 172.21.15.19:0/3517247983 learned_addr learned my addr 172.21.15.19:0/3517247983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f8606ffd640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f8607fff640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcccb30 0x55fcdbccfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 -- 172.21.15.19:0/3517247983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 msgr2=0x55fcdbcd4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 -- 172.21.15.19:0/3517247983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcccb30 msgr2=0x55fcdbccfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcccb30 0x55fcdbccfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 -- 172.21.15.19:0/3517247983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcdbcd5700 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f8607fff640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcccb30 0x55fcdbccfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f86077fe640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0280 0x55fcdbcd4a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f860002a970 tx=0x7f8600005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0080a0eff7de7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f85e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3517247983 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600067060 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.957+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8600036040 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3517247983 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8600030800 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3517247983 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8600055040 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f861004a740 10 client.25450 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fcdbd49ac0 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3517247983 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8600036040 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3517247983 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8600003ec0 con 0x55fcdbcc0280 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f861004a740 10 client.25450 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:26.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f861004a740 10 client.25450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f861004a740 20 client.25450 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f861004a740 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbd4a300 0x55fcdbd4c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.958+0000 7f861004a740 4 client.25450 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.959+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fcdbc38da0 con 0x55fcdbd4a300 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.959+0000 7f8606ffd640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbd4a300 0x55fcdbd4c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.959+0000 7f85e6ffd640 10 client.25450 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.959+0000 7f8606ffd640 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbd4a300 0x55fcdbd4c720 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed101a59c432fb8 server_cookie=19ea5b93ea9b9104 in_seq=0 out_seq=0 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.959+0000 7f85e6ffd640 1 -- 172.21.15.19:0/3517247983 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55fcdbc38da0 con 0x55fcdbd4a300 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.959+0000 7f85e6ffd640 10 client.25450 handle_command_reply: tid=0 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.959+0000 7f861004a740 1 client.25450 shutdown 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0280 msgr2=0x55fcdbcd4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0280 0x55fcdbcd4a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f860002a970 tx=0x7f8600005c00 comp rx=0 tx=0).stop 2024-09-11T00:05:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 shutdown_connections 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55fcdbd4a300 0x55fcdbd4c720 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcdbcccb30 0x55fcdbccfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fcdbcc0ba0 0x55fcdbcd4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 --2- 172.21.15.19:0/3517247983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcdbcc0280 0x55fcdbcd4a80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 >> 172.21.15.19:0/3517247983 conn(0x55fcdbcbe0b0 msgr2=0x55fcdbcbc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f85e6ffd640 0 client.25450 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 shutdown_connections 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 1 -- 172.21.15.19:0/3517247983 wait complete. 2024-09-11T00:05:26.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.960+0000 7f861004a740 20 client.25450 trim_cache size 0 max 16384 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:26.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:26.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:05:26.968 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85f00b55d0 msgr2=0x7f85f00b7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85f00b55d0 0x7f85f00b7a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55fcdbcbef90 tx=0x7f86000097e0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860811c0a0 msgr2=0x7f86081ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860811c0a0 0x7f86081ad7d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f85f800b410 tx=0x7f85f800b8d0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 shutdown_connections 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f85f00b55d0 0x7f85f00b7a90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f860811c0a0 0x7f86081ad7d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f860810a530 0x7f86081a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 --2- 172.21.15.19:0/439637369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f860810a150 0x7f86081a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:26.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 >> 172.21.15.19:0/439637369 conn(0x7f860806cb40 msgr2=0x7f860811c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:26.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 shutdown_connections 2024-09-11T00:05:26.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:26.961+0000 7f860dc75640 1 -- 172.21.15.19:0/439637369 wait complete. 2024-09-11T00:05:27.980 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:05:27.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:05:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:27 smithi135 ceph-mon[35432]: pgmap v413: 97 pgs: 97 active+clean; 395 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-09-11T00:05:28.245 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:28.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:27 smithi019 ceph-mon[30859]: pgmap v413: 97 pgs: 97 active+clean; 395 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-09-11T00:05:28.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:27 smithi131 ceph-mon[35491]: pgmap v413: 97 pgs: 97 active+clean; 395 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-09-11T00:05:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 -- 172.21.15.19:0/3707714508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8113b20 msgr2=0x7f2ed8115f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/3707714508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8113b20 0x7f2ed8115f10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009900 tx=0x7f2ec802a410 comp rx=0 tx=0).stop 2024-09-11T00:05:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 -- 172.21.15.19:0/3707714508 shutdown_connections 2024-09-11T00:05:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/3707714508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8113b20 0x7f2ed8115f10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/3707714508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ed8075e60 0x7f2ed81135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/3707714508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed8075540 0x7f2ed8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 -- 172.21.15.19:0/3707714508 >> 172.21.15.19:0/3707714508 conn(0x7f2ed80fe870 msgr2=0x7f2ed8100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 -- 172.21.15.19:0/3707714508 shutdown_connections 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.780+0000 7f2edf3cf640 1 -- 172.21.15.19:0/3707714508 wait complete. 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 Processor -- start 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 -- start start 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed8075540 0x7f2ed8074730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8075e60 0x7f2ed8074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ed8113b20 0x7f2ed806da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8119380 con 0x7f2ed8075e60 2024-09-11T00:05:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8119200 con 0x7f2ed8075540 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edf3cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8119500 con 0x7f2ed8113b20 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edc96a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8075e60 0x7f2ed8074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edc96a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8075e60 0x7f2ed8074c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46724/0 (socket says 172.21.15.19:46724) 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edc96a640 1 -- 172.21.15.19:0/2486191503 learned_addr learned my addr 172.21.15.19:0/2486191503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.781+0000 7f2edd96c640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ed8113b20 0x7f2ed806da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2edd16b640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed8075540 0x7f2ed8074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2edc96a640 1 -- 172.21.15.19:0/2486191503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ed8113b20 msgr2=0x7f2ed806da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2edc96a640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ed8113b20 0x7f2ed806da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2edc96a640 1 -- 172.21.15.19:0/2486191503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed8075540 msgr2=0x7f2ed8074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2edc96a640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed8075540 0x7f2ed8074730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2edc96a640 1 -- 172.21.15.19:0/2486191503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed806e340 con 0x7f2ed8075e60 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2edc96a640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8075e60 0x7f2ed8074c70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000cce0 tx=0x7f2ed000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.782+0000 7f2ece7fc640 1 -- 172.21.15.19:0/2486191503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000f650 con 0x7f2ed8075e60 2024-09-11T00:05:28.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.783+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed806e630 con 0x7f2ed8075e60 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.783+0000 7f2ece7fc640 1 -- 172.21.15.19:0/2486191503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ed000fca0 con 0x7f2ed8075e60 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.783+0000 7f2ece7fc640 1 -- 172.21.15.19:0/2486191503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0018b40 con 0x7f2ed8075e60 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.783+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed8073620 con 0x7f2ed8075e60 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.784+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed8075920 con 0x7f2ed8075e60 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.786+0000 7f2ece7fc640 1 -- 172.21.15.19:0/2486191503 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f2ed000f7f0 con 0x7f2ed8075e60 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.787+0000 7f2ece7fc640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2ec40b5450 0x7f2ec40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.787+0000 7f2ece7fc640 1 -- 172.21.15.19:0/2486191503 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2ed00e6570 con 0x7f2ed8075e60 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.787+0000 7f2edd16b640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2ec40b5450 0x7f2ec40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.788+0000 7f2edd16b640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2ec40b5450 0x7f2ec40b7910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4005d00 tx=0x7f2ed400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:28.792+0000 7f2ece7fc640 1 -- 172.21.15.19:0/2486191503 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2ed0014030 con 0x7f2ed8075e60 2024-09-11T00:05:29.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.050+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ed8073b10 con 0x7f2ed8075e60 2024-09-11T00:05:29.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.050+0000 7f2ece7fc640 1 -- 172.21.15.19:0/2486191503 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f2ed00ad200 con 0x7f2ed8075e60 2024-09-11T00:05:29.052 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:05:29.052 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":29,"btime":"2024-09-11T00:04:34:770004+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:04:34.651361+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:05:29.053 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 29 2024-09-11T00:05:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2ec40b5450 msgr2=0x7f2ec40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2ec40b5450 0x7f2ec40b7910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4005d00 tx=0x7f2ed400b410 comp rx=0 tx=0).stop 2024-09-11T00:05:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8075e60 msgr2=0x7f2ed8074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8075e60 0x7f2ed8074c70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000cce0 tx=0x7f2ed000a620 comp rx=0 tx=0).stop 2024-09-11T00:05:29.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 shutdown_connections 2024-09-11T00:05:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ed8113b20 0x7f2ed806da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2ec40b5450 0x7f2ec40b7910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ed8075e60 0x7f2ed8074c70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 --2- 172.21.15.19:0/2486191503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed8075540 0x7f2ed8074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 >> 172.21.15.19:0/2486191503 conn(0x7f2ed80fe870 msgr2=0x7f2ed80ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 shutdown_connections 2024-09-11T00:05:29.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:29.053+0000 7f2edf3cf640 1 -- 172.21.15.19:0/2486191503 wait complete. 2024-09-11T00:05:29.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:05:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:29 smithi135 ceph-mon[35432]: pgmap v414: 97 pgs: 97 active+clean; 403 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 200 op/s 2024-09-11T00:05:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:29 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2486191503' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:30.268 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:30.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:29 smithi019 ceph-mon[30859]: pgmap v414: 97 pgs: 97 active+clean; 403 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 200 op/s 2024-09-11T00:05:30.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:29 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2486191503' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:29 smithi131 ceph-mon[35491]: pgmap v414: 97 pgs: 97 active+clean; 403 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 200 op/s 2024-09-11T00:05:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:29 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2486191503' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 -- 172.21.15.19:0/2389032078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 msgr2=0x7f815410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 --2- 172.21.15.19:0/2389032078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815410e860 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f814c009ca0 tx=0x7f814c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 -- 172.21.15.19:0/2389032078 shutdown_connections 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 --2- 172.21.15.19:0/2389032078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815410e860 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 --2- 172.21.15.19:0/2389032078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81541076e0 0x7f8154107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 --2- 172.21.15.19:0/2389032078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8154101cd0 0x7f81541020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 -- 172.21.15.19:0/2389032078 >> 172.21.15.19:0/2389032078 conn(0x7f81540fd720 msgr2=0x7f81540ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 -- 172.21.15.19:0/2389032078 shutdown_connections 2024-09-11T00:05:30.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 -- 172.21.15.19:0/2389032078 wait complete. 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 Processor -- start 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.961+0000 7f815c6f8640 1 -- start start 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815c6f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101cd0 0x7f8154199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815c6f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81541076e0 0x7f81541997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815c6f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815c6f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8154111ce0 con 0x7f8154108060 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815c6f8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8154111b60 con 0x7f81541076e0 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815c6f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8154111e60 con 0x7f8154101cd0 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815a494640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101cd0 0x7f8154199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46746/0 (socket says 172.21.15.19:46746) 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815a494640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101cd0 0x7f8154199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54920/0 (socket says 172.21.15.19:54920) 2024-09-11T00:05:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 -- 172.21.15.19:0/3693244974 learned_addr learned my addr 172.21.15.19:0/3693244974 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f8159c93640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81541076e0 0x7f81541997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 -- 172.21.15.19:0/3693244974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101cd0 msgr2=0x7f8154199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101cd0 0x7f8154199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 -- 172.21.15.19:0/3693244974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81541076e0 msgr2=0x7f81541997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81541076e0 0x7f81541997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 -- 172.21.15.19:0/3693244974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815419f330 con 0x7f8154108060 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815ac95640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815419eb60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f814c0098d0 tx=0x7f814c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f814b7fe640 1 -- 172.21.15.19:0/3693244974 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c003b70 con 0x7f8154108060 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f814b7fe640 1 -- 172.21.15.19:0/3693244974 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f814c003d10 con 0x7f8154108060 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.962+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815419f5c0 con 0x7f8154108060 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.963+0000 7f814b7fe640 1 -- 172.21.15.19:0/3693244974 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c02fa20 con 0x7f8154108060 2024-09-11T00:05:30.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.963+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81541a5ce0 con 0x7f8154108060 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.965+0000 7f814b7fe640 1 -- 172.21.15.19:0/3693244974 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f814c02fc20 con 0x7f8154108060 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.965+0000 7f815eacd740 1 Processor -- start 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.965+0000 7f815eacd740 1 -- start start 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815eacd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x56432886d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815eacd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328879840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815eacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x56432887c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815eacd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5643287e3ea0 con 0x56432886d4d0 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815eacd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5643287d32d0 con 0x56432886ddf0 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815eacd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5643287d70e0 con 0x564328879d80 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x56432886d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x56432886d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46748/0 (socket says 172.21.15.19:46748) 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 -- 172.21.15.19:0/2541789600 learned_addr learned my addr 172.21.15.19:0/2541789600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:30.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815a494640 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328879840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x56432887c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f814b7fe640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f81400b54d0 0x7f81400b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 -- 172.21.15.19:0/2541789600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 msgr2=0x56432887c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x56432887c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 -- 172.21.15.19:0/2541789600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 msgr2=0x564328879840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328879840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f8159c93640 1 -- 172.21.15.19:0/2541789600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564328531650 con 0x56432886d4d0 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815ac95640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f81400b54d0 0x7f81400b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.966+0000 7f815a494640 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328879840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.967+0000 7f8159c93640 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x56432886d8b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8144005f60 tx=0x7f8144009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e6838333efbea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.967+0000 7f814b7fe640 1 -- 172.21.15.19:0/3693244974 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f814c107240 con 0x7f8154108060 2024-09-11T00:05:30.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.967+0000 7f8148ff9640 1 -- 172.21.15.19:0/2541789600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81440130d0 con 0x56432886d4d0 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.967+0000 7f8148ff9640 1 -- 172.21.15.19:0/2541789600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8144011920 con 0x56432886d4d0 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.967+0000 7f8148ff9640 1 -- 172.21.15.19:0/2541789600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81440107b0 con 0x56432886d4d0 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 -- 172.21.15.19:0/2541789600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 msgr2=0x56432886d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815ac95640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f81400b54d0 0x7f81400b7990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f814c0cd6d0 tx=0x7f814c0978d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x56432886d8b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8144005f60 tx=0x7f8144009630 comp rx=0 tx=0).stop 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 -- 172.21.15.19:0/2541789600 shutdown_connections 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x56432887c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328879840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 --2- 172.21.15.19:0/2541789600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x56432886d8b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 -- 172.21.15.19:0/2541789600 >> 172.21.15.19:0/2541789600 conn(0x56432886b300 msgr2=0x56432886c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 -- 172.21.15.19:0/2541789600 shutdown_connections 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.968+0000 7f815eacd740 1 -- 172.21.15.19:0/2541789600 wait complete. 2024-09-11T00:05:30.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 -- start start 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 Processor -- start 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328879710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328876b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x564328877230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564328634700 con 0x56432886d4d0 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56432876e160 con 0x56432886ddf0 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56432887c9a0 con 0x564328879d80 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815eacd740 10 client.0 _ll_register_callbacks cb 0x5643287879e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f8159c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328879710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f8159c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328879710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46752/0 (socket says 172.21.15.19:46752) 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f8159c93640 1 -- 172.21.15.19:0/175041654 learned_addr learned my addr 172.21.15.19:0/175041654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:30.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f8159c93640 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x564328877230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.969+0000 7f815a494640 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328876b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f8159c93640 1 -- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 msgr2=0x564328877230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f8159c93640 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x564328877230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f8159c93640 1 -- 172.21.15.19:0/175041654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 msgr2=0x564328876b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f8159c93640 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328876b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f8159c93640 1 -- 172.21.15.19:0/175041654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432879bc90 con 0x56432886d4d0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f8159c93640 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328879710 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8144006010 tx=0x7f8144010470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f508750c285f230 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f813dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f813dffb640 1 -- 172.21.15.19:0/175041654 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144004020 con 0x56432886d4d0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f813dffb640 1 -- 172.21.15.19:0/175041654 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f81440041c0 con 0x56432886d4d0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8144011920 con 0x56432886d4d0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f813dffb640 1 -- 172.21.15.19:0/175041654 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f81440043c0 con 0x56432886d4d0 2024-09-11T00:05:30.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f815eacd740 10 client.15840 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.970+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564328888370 con 0x56432886d4d0 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f813dffb640 1 -- 172.21.15.19:0/175041654 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8144011920 con 0x56432886d4d0 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f813dffb640 1 -- 172.21.15.19:0/175041654 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f81440049f0 con 0x56432886d4d0 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815eacd740 10 client.15840 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815eacd740 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815eacd740 20 client.15840 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815eacd740 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288896c0 0x56432888bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815eacd740 4 client.15840 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643287e5df0 con 0x5643288896c0 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815a494640 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288896c0 0x56432888bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.972+0000 7f813dffb640 10 client.15840 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:05:30.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.971+0000 7f815a494640 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288896c0 0x56432888bab0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ca94ccf2b3f2401 server_cookie=6d09b3b6fbc64ffd in_seq=0 out_seq=0 2024-09-11T00:05:30.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f813dffb640 1 -- 172.21.15.19:0/175041654 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643287e5df0 con 0x5643288896c0 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f813dffb640 10 client.15840 handle_command_reply: tid=0 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 client.15840 shutdown 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 msgr2=0x564328879710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328879710 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8144006010 tx=0x7f8144010470 comp rx=0 tx=0).stop 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 shutdown_connections 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288896c0 0x56432888bab0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564328879d80 0x564328877230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56432886ddf0 0x564328876b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f813dffb640 0 client.15840 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 --2- 172.21.15.19:0/175041654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328879710 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 >> 172.21.15.19:0/175041654 conn(0x56432886b300 msgr2=0x564328870ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 shutdown_connections 2024-09-11T00:05:30.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 1 -- 172.21.15.19:0/175041654 wait complete. 2024-09-11T00:05:30.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.976+0000 7f815eacd740 20 client.15840 trim_cache size 0 max 16384 2024-09-11T00:05:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.989+0000 7f815eacd740 1 Processor -- start 2024-09-11T00:05:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.989+0000 7f815eacd740 1 -- start start 2024-09-11T00:05:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815eacd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328885bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815eacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886ddf0 0x5643288788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815eacd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 0x56432887b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815eacd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f81541b0eb0 con 0x56432886d4d0 2024-09-11T00:05:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815eacd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ae720 con 0x564328879d80 2024-09-11T00:05:30.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815eacd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ac570 con 0x56432886ddf0 2024-09-11T00:05:30.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f8159c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328885bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f8159c93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328885bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46764/0 (socket says 172.21.15.19:46764) 2024-09-11T00:05:30.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f8159c93640 1 -- 172.21.15.19:0/1219284592 learned_addr learned my addr 172.21.15.19:0/1219284592 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:30.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815a494640 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886ddf0 0x5643288788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815a494640 1 -- 172.21.15.19:0/1219284592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 msgr2=0x56432887b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815a494640 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 0x56432887b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815a494640 1 -- 172.21.15.19:0/1219284592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 msgr2=0x564328885bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815a494640 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328885bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815a494640 1 -- 172.21.15.19:0/1219284592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432886bfe0 con 0x56432886ddf0 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.990+0000 7f815a494640 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886ddf0 0x5643288788a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56432876e1b0 tx=0x7f815000b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de47d11500de4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f813ffff640 1 -- 172.21.15.19:0/1219284592 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150003d60 con 0x56432886ddf0 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f813ffff640 1 -- 172.21.15.19:0/1219284592 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81500118f0 con 0x56432886ddf0 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f813ffff640 1 -- 172.21.15.19:0/1219284592 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815001d970 con 0x56432886ddf0 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 -- 172.21.15.19:0/1219284592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886ddf0 msgr2=0x5643288788a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886ddf0 0x5643288788a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56432876e1b0 tx=0x7f815000b390 comp rx=0 tx=0).stop 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 -- 172.21.15.19:0/1219284592 shutdown_connections 2024-09-11T00:05:30.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 0x56432887b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886ddf0 0x5643288788a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 --2- 172.21.15.19:0/1219284592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886d4d0 0x564328885bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 -- 172.21.15.19:0/1219284592 >> 172.21.15.19:0/1219284592 conn(0x56432886b300 msgr2=0x564328878190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 -- 172.21.15.19:0/1219284592 shutdown_connections 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.991+0000 7f815eacd740 1 -- 172.21.15.19:0/1219284592 wait complete. 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 -- start start 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 Processor -- start 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886d4d0 0x564328881c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886ddf0 0x564328882180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 0x56432887cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f81541acbe0 con 0x56432886ddf0 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ae050 con 0x564328879d80 2024-09-11T00:05:30.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ad2b0 con 0x56432886d4d0 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815eacd740 10 client.0 _ll_register_callbacks cb 0x7f815000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.992+0000 7f815a494640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886ddf0 0x564328882180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886ddf0 0x564328882180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46780/0 (socket says 172.21.15.19:46780) 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 -- 172.21.15.19:0/2496944617 learned_addr learned my addr 172.21.15.19:0/2496944617 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f8159c93640 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886d4d0 0x564328881c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f8159c93640 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 0x56432887cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 -- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886d4d0 msgr2=0x564328881c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886d4d0 0x564328881c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 -- 172.21.15.19:0/2496944617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 msgr2=0x56432887cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 0x56432887cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 -- 172.21.15.19:0/2496944617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432887d180 con 0x56432886ddf0 2024-09-11T00:05:30.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815a494640 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886ddf0 0x564328882180 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f815000bfd0 tx=0x7f815001d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270d78df2ebfb8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f813dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f813dffb640 1 -- 172.21.15.19:0/2496944617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150003b60 con 0x56432886ddf0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f813dffb640 1 -- 172.21.15.19:0/2496944617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8150003d00 con 0x56432886ddf0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81500118f0 con 0x56432886ddf0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.993+0000 7f813dffb640 1 -- 172.21.15.19:0/2496944617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8150011aa0 con 0x56432886ddf0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 10 client.15846 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643288f6d20 con 0x56432886ddf0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f813dffb640 1 -- 172.21.15.19:0/2496944617 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81500118f0 con 0x56432886ddf0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f813dffb640 1 -- 172.21.15.19:0/2496944617 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f815002d470 con 0x56432886ddf0 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 10 client.15846 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 10 client.15846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 20 client.15846 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:30.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288f74f0 0x5643288f9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:31.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 4 client.15846 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:05:31.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643287e18a0 con 0x5643288f74f0 2024-09-11T00:05:31.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.994+0000 7f8159c93640 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288f74f0 0x5643288f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:31.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.995+0000 7f813dffb640 10 client.15846 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:05:31.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:30.995+0000 7f8159c93640 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288f74f0 0x5643288f9910 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aeac17580db387cc server_cookie=b4ffe031c1b32b4e in_seq=0 out_seq=0 2024-09-11T00:05:31.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.000+0000 7f813dffb640 1 -- 172.21.15.19:0/2496944617 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643287e18a0 con 0x5643288f74f0 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.000+0000 7f813dffb640 10 client.15846 handle_command_reply: tid=0 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.000+0000 7f815eacd740 1 client.15846 shutdown 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886ddf0 msgr2=0x564328882180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886ddf0 0x564328882180 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f815000bfd0 tx=0x7f815001d480 comp rx=0 tx=0).stop 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 shutdown_connections 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5643288f74f0 0x5643288f9910 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564328879d80 0x56432887cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56432886ddf0 0x564328882180 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 --2- 172.21.15.19:0/2496944617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56432886d4d0 0x564328881c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 >> 172.21.15.19:0/2496944617 conn(0x56432886b300 msgr2=0x5643288789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:31.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f813dffb640 0 client.15846 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:05:31.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 shutdown_connections 2024-09-11T00:05:31.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 1 -- 172.21.15.19:0/2496944617 wait complete. 2024-09-11T00:05:31.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815eacd740 20 client.15846 trim_cache size 0 max 16384 2024-09-11T00:05:31.004 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f81400b54d0 msgr2=0x7f81400b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815c6f8640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f81400b54d0 0x7f81400b7990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f814c0cd6d0 tx=0x7f814c0978d0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 msgr2=0x7f815419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.001+0000 7f815c6f8640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815419eb60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f814c0098d0 tx=0x7f814c0317b0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 shutdown_connections 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f81400b54d0 0x7f81400b7990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8154108060 0x7f815419eb60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81541076e0 0x7f81541997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 --2- 172.21.15.19:0/3693244974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101cd0 0x7f8154199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:31.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 >> 172.21.15.19:0/3693244974 conn(0x7f81540fd720 msgr2=0x7f81541067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:31.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 shutdown_connections 2024-09-11T00:05:31.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:31.002+0000 7f815c6f8640 1 -- 172.21.15.19:0/3693244974 wait complete. 2024-09-11T00:05:32.038 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:05:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:31 smithi135 ceph-mon[35432]: pgmap v415: 97 pgs: 97 active+clean; 403 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 163 op/s 2024-09-11T00:05:32.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:31 smithi019 ceph-mon[30859]: pgmap v415: 97 pgs: 97 active+clean; 403 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 163 op/s 2024-09-11T00:05:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:31 smithi131 ceph-mon[35491]: pgmap v415: 97 pgs: 97 active+clean; 403 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 163 op/s 2024-09-11T00:05:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:32.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 -- 172.21.15.19:0/3002732292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 msgr2=0x7fd82810f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 --2- 172.21.15.19:0/3002732292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd82810f920 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd820009ca0 tx=0x7fd82002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 -- 172.21.15.19:0/3002732292 shutdown_connections 2024-09-11T00:05:32.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 --2- 172.21.15.19:0/3002732292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd82810f920 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 --2- 172.21.15.19:0/3002732292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 0x7fd828108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 --2- 172.21.15.19:0/3002732292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd828102d90 0x7fd828103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 -- 172.21.15.19:0/3002732292 >> 172.21.15.19:0/3002732292 conn(0x7fd8280fe820 msgr2=0x7fd828100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 -- 172.21.15.19:0/3002732292 shutdown_connections 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 -- 172.21.15.19:0/3002732292 wait complete. 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 Processor -- start 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.806+0000 7fd82efd5640 1 -- start start 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82efd5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd828102d90 0x7fd8280754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82efd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 0x7fd8280759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82efd5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd828075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82efd5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd828112e30 con 0x7fd828109120 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82efd5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd828112cb0 con 0x7fd828102d90 2024-09-11T00:05:32.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82efd5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd828112fb0 con 0x7fd8281087a0 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82d572640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd828075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 0x7fd8280759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 0x7fd8280759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42848/0 (socket says 172.21.15.19:42848) 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82d572640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd828075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52532/0 (socket says 172.21.15.19:52532) 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 -- 172.21.15.19:0/2971292919 learned_addr learned my addr 172.21.15.19:0/2971292919 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82cd71640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd828102d90 0x7fd8280754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 -- 172.21.15.19:0/2971292919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd828102d90 msgr2=0x7fd8280754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd828102d90 0x7fd8280754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 -- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 msgr2=0x7fd828075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd828075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 -- 172.21.15.19:0/2971292919 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8281a75a0 con 0x7fd8281087a0 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82cd71640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd828102d90 0x7fd8280754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:32.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd82d572640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd828075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.807+0000 7fd827fff640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 0x7fd8280759e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd81400d950 tx=0x7fd81400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.808+0000 7fd825ffb640 1 -- 172.21.15.19:0/2971292919 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd814017030 con 0x7fd8281087a0 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.808+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8281a7890 con 0x7fd8281087a0 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.808+0000 7fd825ffb640 1 -- 172.21.15.19:0/2971292919 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd814004020 con 0x7fd8281087a0 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.808+0000 7fd825ffb640 1 -- 172.21.15.19:0/2971292919 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8140047a0 con 0x7fd8281087a0 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.808+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8281a7e20 con 0x7fd8281087a0 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.810+0000 7fd8313aa740 1 Processor -- start 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.810+0000 7fd825ffb640 1 -- 172.21.15.19:0/2971292919 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fd814009a30 con 0x7fd8281087a0 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.810+0000 7fd8313aa740 1 -- start start 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.810+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a5918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a59d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 0x55c34a5a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd8313aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c34a507ea0 con 0x55c34a591df0 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd8313aa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c34a4f72d0 con 0x55c34a59dd80 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd8313aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c34a4fb0e0 con 0x55c34a5914d0 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a59d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a59d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52540/0 (socket says 172.21.15.19:52540) 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 -- 172.21.15.19:0/3262657674 learned_addr learned my addr 172.21.15.19:0/3262657674 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82d572640 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a5918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 -- 172.21.15.19:0/3262657674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 msgr2=0x55c34a5918b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a5918b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 -- 172.21.15.19:0/3262657674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 msgr2=0x55c34a5a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 0x55c34a5a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 -- 172.21.15.19:0/3262657674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c34a255650 con 0x55c34a591df0 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd825ffb640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8180b5450 0x7fd8180b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82cd71640 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a59d840 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd81c008c60 tx=0x7fd81c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c76b47158a79257 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd82d572640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8180b5450 0x7fd8180b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd812ffd640 1 -- 172.21.15.19:0/3262657674 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c014070 con 0x55c34a591df0 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd825ffb640 1 -- 172.21.15.19:0/2971292919 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd8140e5990 con 0x7fd8281087a0 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd812ffd640 1 -- 172.21.15.19:0/3262657674 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd81c0047a0 con 0x55c34a591df0 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.811+0000 7fd812ffd640 1 -- 172.21.15.19:0/3262657674 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c010670 con 0x55c34a591df0 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 -- 172.21.15.19:0/3262657674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 msgr2=0x55c34a59d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd82d572640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8180b5450 0x7fd8180b7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd828077560 tx=0x7fd820005d80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a59d840 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd81c008c60 tx=0x7fd81c00e720 comp rx=0 tx=0).stop 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 -- 172.21.15.19:0/3262657674 shutdown_connections 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 0x55c34a5a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a59d840 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3262657674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a5918b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 -- 172.21.15.19:0/3262657674 >> 172.21.15.19:0/3262657674 conn(0x55c34a58f300 msgr2=0x55c34a5904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 -- 172.21.15.19:0/3262657674 shutdown_connections 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 -- 172.21.15.19:0/3262657674 wait complete. 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.812+0000 7fd8313aa740 1 -- start start 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 1 Processor -- start 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a59d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a59dd80 0x55c34a59b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c34a358700 con 0x55c34a59dd80 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c34a492160 con 0x55c34a591df0 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c34a5a0a00 con 0x55c34a5914d0 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd8313aa740 10 client.0 _ll_register_callbacks cb 0x55c34a4ab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd82cd71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a59d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd82d572640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a59dd80 0x55c34a59b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd82cd71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a59d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42854/0 (socket says 172.21.15.19:42854) 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd82cd71640 1 -- 172.21.15.19:0/3571714434 learned_addr learned my addr 172.21.15.19:0/3571714434 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.813+0000 7fd827fff640 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.814+0000 7fd82cd71640 1 -- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 msgr2=0x55c34a59aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.814+0000 7fd82cd71640 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.814+0000 7fd82cd71640 1 -- 172.21.15.19:0/3571714434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a59dd80 msgr2=0x55c34a59b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.815+0000 7fd82cd71640 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a59dd80 0x55c34a59b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.815+0000 7fd82cd71640 1 -- 172.21.15.19:0/3571714434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c34a4bfc90 con 0x55c34a5914d0 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.815+0000 7fd82d572640 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a59dd80 0x55c34a59b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.815+0000 7fd82cd71640 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a59d750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd81c008c30 tx=0x7fd81c005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e88d99b1aea3ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.816+0000 7fd807fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.816+0000 7fd807fff640 1 -- 172.21.15.19:0/3571714434 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c014070 con 0x55c34a5914d0 2024-09-11T00:05:32.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.816+0000 7fd807fff640 1 -- 172.21.15.19:0/3571714434 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd81c004230 con 0x55c34a5914d0 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.817+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd81c0047a0 con 0x55c34a5914d0 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.817+0000 7fd807fff640 1 -- 172.21.15.19:0/3571714434 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd81c008230 con 0x55c34a5914d0 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.817+0000 7fd8313aa740 10 client.25483 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.817+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c34a5ac420 con 0x55c34a5914d0 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd807fff640 1 -- 172.21.15.19:0/3571714434 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd81c0047a0 con 0x55c34a5914d0 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd807fff640 1 -- 172.21.15.19:0/3571714434 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd81c02c430 con 0x55c34a5914d0 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd8313aa740 10 client.25483 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd8313aa740 10 client.25483 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd8313aa740 20 client.25483 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd8313aa740 4 client.25483 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.818+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c34a509df0 con 0x55c34a5ad820 2024-09-11T00:05:32.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.819+0000 7fd827fff640 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.821+0000 7fd827fff640 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5afc10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=109186b9c202726a server_cookie=65384ec6929808f3 in_seq=0 out_seq=0 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.822+0000 7fd807fff640 10 client.25483 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.822+0000 7fd807fff640 1 -- 172.21.15.19:0/3571714434 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c34a509df0 con 0x55c34a5ad820 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.822+0000 7fd807fff640 10 client.25483 handle_command_reply: tid=0 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 client.25483 shutdown 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 msgr2=0x55c34a59d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a59d750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd81c008c30 tx=0x7fd81c005230 comp rx=0 tx=0).stop 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 shutdown_connections 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5afc10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd807fff640 0 client.25483 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a59dd80 0x55c34a59b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 --2- 172.21.15.19:0/3571714434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a59d750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.823+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 >> 172.21.15.19:0/3571714434 conn(0x55c34a58f300 msgr2=0x55c34a594ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:32.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.824+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 shutdown_connections 2024-09-11T00:05:32.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.824+0000 7fd8313aa740 1 -- 172.21.15.19:0/3571714434 wait complete. 2024-09-11T00:05:32.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.824+0000 7fd8313aa740 20 client.25483 trim_cache size 0 max 16384 2024-09-11T00:05:32.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 Processor -- start 2024-09-11T00:05:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 -- start start 2024-09-11T00:05:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a5914d0 0x55c34a5a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a59dd80 0x55c34a59f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd8281b3080 con 0x55c34a5914d0 2024-09-11T00:05:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8281b08f0 con 0x55c34a591df0 2024-09-11T00:05:32.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.850+0000 7fd8313aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8281ae740 con 0x55c34a59dd80 2024-09-11T00:05:32.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a5914d0 0x55c34a5a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a5914d0 0x55c34a5a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52554/0 (socket says 172.21.15.19:52554) 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 -- 172.21.15.19:0/338419397 learned_addr learned my addr 172.21.15.19:0/338419397 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82d572640 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a59dd80 0x55c34a59f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd827fff640 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 -- 172.21.15.19:0/338419397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a59dd80 msgr2=0x55c34a59f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a59dd80 0x55c34a59f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 -- 172.21.15.19:0/338419397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 msgr2=0x55c34a59c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.851+0000 7fd82cd71640 1 -- 172.21.15.19:0/338419397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c34a59dac0 con 0x55c34a5914d0 2024-09-11T00:05:32.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.852+0000 7fd82cd71640 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a5914d0 0x55c34a5a9c30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd81c02c8d0 tx=0x7fd81c0083d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99590240e01d824 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.852+0000 7fd8127fc640 1 -- 172.21.15.19:0/338419397 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c014070 con 0x55c34a5914d0 2024-09-11T00:05:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.852+0000 7fd8127fc640 1 -- 172.21.15.19:0/338419397 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd81c008850 con 0x55c34a5914d0 2024-09-11T00:05:32.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.852+0000 7fd8127fc640 1 -- 172.21.15.19:0/338419397 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c02cac0 con 0x55c34a5914d0 2024-09-11T00:05:32.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 -- 172.21.15.19:0/338419397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a5914d0 msgr2=0x55c34a5a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a5914d0 0x55c34a5a9c30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd81c02c8d0 tx=0x7fd81c0083d0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 -- 172.21.15.19:0/338419397 shutdown_connections 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a59dd80 0x55c34a59f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a591df0 0x55c34a59c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 --2- 172.21.15.19:0/338419397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a5914d0 0x55c34a5a9c30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 -- 172.21.15.19:0/338419397 >> 172.21.15.19:0/338419397 conn(0x55c34a58f300 msgr2=0x55c34a59c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 -- 172.21.15.19:0/338419397 shutdown_connections 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.853+0000 7fd8313aa740 1 -- 172.21.15.19:0/338419397 wait complete. 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 -- start start 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 Processor -- start 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a6173e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a617920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 0x55c34a6143b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd8281aedb0 con 0x55c34a591df0 2024-09-11T00:05:32.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8281b0220 con 0x55c34a59dd80 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8281af480 con 0x55c34a5914d0 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd8313aa740 10 client.0 _ll_register_callbacks cb 0x7fd820005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd827fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a617920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd827fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a617920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52564/0 (socket says 172.21.15.19:52564) 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd827fff640 1 -- 172.21.15.19:0/4190128522 learned_addr learned my addr 172.21.15.19:0/4190128522 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd82cd71640 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a6173e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.854+0000 7fd82d572640 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 0x55c34a6143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd827fff640 1 -- 172.21.15.19:0/4190128522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 msgr2=0x55c34a6173e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd827fff640 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a6173e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd827fff640 1 -- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 msgr2=0x55c34a6143b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd827fff640 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 0x55c34a6143b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd827fff640 1 -- 172.21.15.19:0/4190128522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c34a6148f0 con 0x55c34a591df0 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd827fff640 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a617920 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd814004770 tx=0x7fd814000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706bcb4da8332876 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd807fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd807fff640 1 -- 172.21.15.19:0/4190128522 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8140ac590 con 0x55c34a591df0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd807fff640 1 -- 172.21.15.19:0/4190128522 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd8140e33e0 con 0x55c34a591df0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd81c008850 con 0x55c34a591df0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd807fff640 1 -- 172.21.15.19:0/4190128522 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8140abe90 con 0x55c34a591df0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd8313aa740 10 client.15864 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c34a5a54e0 con 0x55c34a591df0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.855+0000 7fd807fff640 1 -- 172.21.15.19:0/4190128522 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd81c008850 con 0x55c34a591df0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd807fff640 1 -- 172.21.15.19:0/4190128522 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd8140b4f90 con 0x55c34a591df0 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd8313aa740 10 client.15864 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd8313aa740 10 client.15864 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd8313aa740 20 client.15864 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd8313aa740 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd8313aa740 4 client.15864 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:05:32.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c34a5058a0 con 0x55c34a5ad820 2024-09-11T00:05:32.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.856+0000 7fd82cd71640 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd807fff640 10 client.15864 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd82cd71640 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5a5c90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7ba31326301d9bf server_cookie=1fd44ea7579ed538 in_seq=0 out_seq=0 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd807fff640 1 -- 172.21.15.19:0/4190128522 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c34a5058a0 con 0x55c34a5ad820 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd807fff640 10 client.15864 handle_command_reply: tid=0 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 client.15864 shutdown 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 msgr2=0x55c34a617920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a617920 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd814004770 tx=0x7fd814000bc0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 shutdown_connections 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55c34a5ad820 0x55c34a5a5c90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c34a59dd80 0x55c34a6143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c34a591df0 0x55c34a617920 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd807fff640 0 client.15864 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 --2- 172.21.15.19:0/4190128522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c34a5914d0 0x55c34a6173e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 >> 172.21.15.19:0/4190128522 conn(0x55c34a58f300 msgr2=0x55c34a59c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 shutdown_connections 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 1 -- 172.21.15.19:0/4190128522 wait complete. 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.857+0000 7fd8313aa740 20 client.15864 trim_cache size 0 max 16384 2024-09-11T00:05:32.863 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8180b5450 msgr2=0x7fd8180b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8180b5450 0x7fd8180b7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd828077560 tx=0x7fd820005d80 comp rx=0 tx=0).stop 2024-09-11T00:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 msgr2=0x7fd8280759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 0x7fd8280759e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd81400d950 tx=0x7fd81400de10 comp rx=0 tx=0).stop 2024-09-11T00:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 shutdown_connections 2024-09-11T00:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd8180b5450 0x7fd8180b7910 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd828109120 0x7fd828075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8281087a0 0x7fd8280759e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 --2- 172.21.15.19:0/2971292919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd828102d90 0x7fd8280754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 >> 172.21.15.19:0/2971292919 conn(0x7fd8280fe820 msgr2=0x7fd828101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:32.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 shutdown_connections 2024-09-11T00:05:32.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:32.858+0000 7fd82efd5640 1 -- 172.21.15.19:0/2971292919 wait complete. 2024-09-11T00:05:33.107 INFO:tasks.workunit.client.0.smithi019.stdout: 81 524191 703 345404 422 314824 1568 2024-09-11T00:05:33.707 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:05:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:34.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:33 smithi019 ceph-mon[30859]: pgmap v416: 97 pgs: 97 active+clean; 411 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 153 op/s 2024-09-11T00:05:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:33 smithi135 ceph-mon[35432]: pgmap v416: 97 pgs: 97 active+clean; 411 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 153 op/s 2024-09-11T00:05:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:33 smithi131 ceph-mon[35491]: pgmap v416: 97 pgs: 97 active+clean; 411 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 153 op/s 2024-09-11T00:05:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.475+0000 7f5d86dd3640 1 -- 172.21.15.19:0/161316213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d801087f0 msgr2=0x7f5d80108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.475+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/161316213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d801087f0 0x7f5d80108c30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009ca0 tx=0x7f5d6802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.475+0000 7f5d86dd3640 1 -- 172.21.15.19:0/161316213 shutdown_connections 2024-09-11T00:05:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.475+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/161316213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d80109170 0x7f5d8010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.475+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/161316213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d801087f0 0x7f5d80108c30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.475+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/161316213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d80102de0 0x7f5d801031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.475+0000 7f5d86dd3640 1 -- 172.21.15.19:0/161316213 >> 172.21.15.19:0/161316213 conn(0x7f5d800fe830 msgr2=0x7f5d80100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 -- 172.21.15.19:0/161316213 shutdown_connections 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 -- 172.21.15.19:0/161316213 wait complete. 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 Processor -- start 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 -- start start 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d80102de0 0x7f5d800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d801087f0 0x7f5d800759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d80109170 0x7f5d80075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80112df0 con 0x7f5d80109170 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80112c70 con 0x7f5d80102de0 2024-09-11T00:05:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d86dd3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80112f70 con 0x7f5d801087f0 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d85370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d80109170 0x7f5d80075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d85370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d80109170 0x7f5d80075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52594/0 (socket says 172.21.15.19:52594) 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.476+0000 7f5d85370640 1 -- 172.21.15.19:0/1739269251 learned_addr learned my addr 172.21.15.19:0/1739269251 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d801087f0 0x7f5d800759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d80102de0 0x7f5d800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d85370640 1 -- 172.21.15.19:0/1739269251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d801087f0 msgr2=0x7f5d800759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d85370640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d801087f0 0x7f5d800759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d85370640 1 -- 172.21.15.19:0/1739269251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d80102de0 msgr2=0x7f5d800754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d85370640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d80102de0 0x7f5d800754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d85370640 1 -- 172.21.15.19:0/1739269251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d801a76c0 con 0x7f5d80109170 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d85370640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d80109170 0x7f5d80075f20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800e970 tx=0x7f5d7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d7dffb640 1 -- 172.21.15.19:0/1739269251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800ccc0 con 0x7f5d80109170 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d7dffb640 1 -- 172.21.15.19:0/1739269251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d7800ce60 con 0x7f5d80109170 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d801a79b0 con 0x7f5d80109170 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d7dffb640 1 -- 172.21.15.19:0/1739269251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78010430 con 0x7f5d80109170 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.477+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d801a7f40 con 0x7f5d80109170 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d7dffb640 1 -- 172.21.15.19:0/1739269251 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f5d78004f90 con 0x7f5d80109170 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 Processor -- start 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 -- start start 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504946b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049477840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x565049477d80 0x56504947a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5650493e1ea0 con 0x56504946bdf0 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5650493d12d0 con 0x565049477d80 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d891a8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5650493d50e0 con 0x56504946b4d0 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d84b6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049477840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d84b6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049477840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52606/0 (socket says 172.21.15.19:52606) 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d84b6f640 1 -- 172.21.15.19:0/1857404829 learned_addr learned my addr 172.21.15.19:0/1857404829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.480+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504946b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d84b6f640 1 -- 172.21.15.19:0/1857404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 msgr2=0x56504946b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504946b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d84b6f640 1 -- 172.21.15.19:0/1857404829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x565049477d80 msgr2=0x56504947a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x565049477d80 0x56504947a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d7dffb640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d6c0b54d0 0x7f5d6c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d84b6f640 1 -- 172.21.15.19:0/1857404829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56504912f650 con 0x56504946bdf0 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504946b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d85370640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d6c0b54d0 0x7f5d6c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049477840 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000bd10 tx=0x7f5d7000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7e97e9ae55bc15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d7dffb640 1 -- 172.21.15.19:0/1739269251 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5d780e62e0 con 0x7f5d80109170 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d76ffd640 1 -- 172.21.15.19:0/1857404829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70015070 con 0x56504946bdf0 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d76ffd640 1 -- 172.21.15.19:0/1857404829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d7001a910 con 0x56504946bdf0 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.481+0000 7f5d76ffd640 1 -- 172.21.15.19:0/1857404829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70011900 con 0x56504946bdf0 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 -- 172.21.15.19:0/1857404829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 msgr2=0x565049477840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049477840 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000bd10 tx=0x7f5d7000f730 comp rx=0 tx=0).stop 2024-09-11T00:05:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d85370640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d6c0b54d0 0x7f5d6c0b7990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5d780a9a50 tx=0x7f5d780049b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 -- 172.21.15.19:0/1857404829 shutdown_connections 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x565049477d80 0x56504947a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049477840 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1857404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504946b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 -- 172.21.15.19:0/1857404829 >> 172.21.15.19:0/1857404829 conn(0x565049469300 msgr2=0x56504946a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 -- 172.21.15.19:0/1857404829 shutdown_connections 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 -- 172.21.15.19:0/1857404829 wait complete. 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 -- start start 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.482+0000 7f5d891a8740 1 Processor -- start 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946b4d0 0x565049477650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x565049474aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049475080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d891a8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x565049232700 con 0x56504946b4d0 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d891a8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56504936c160 con 0x56504946bdf0 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d891a8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56504947aa00 con 0x565049477d80 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d891a8740 10 client.0 _ll_register_callbacks cb 0x5650493859e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946b4d0 0x565049477650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946b4d0 0x565049477650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52612/0 (socket says 172.21.15.19:52612) 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 -- 172.21.15.19:0/1470341436 learned_addr learned my addr 172.21.15.19:0/1470341436 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049475080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x565049474aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 -- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 msgr2=0x565049475080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049475080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 -- 172.21.15.19:0/1470341436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 msgr2=0x565049474aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x565049474aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 -- 172.21.15.19:0/1470341436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565049399c90 con 0x56504946b4d0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x565049474aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946b4d0 0x565049477650 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5d6802ade0 tx=0x7f5d68005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b22d391ca899c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.483+0000 7f5d5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d5ffff640 1 -- 172.21.15.19:0/1470341436 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6804a060 con 0x56504946b4d0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d5ffff640 1 -- 172.21.15.19:0/1470341436 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5d68003970 con 0x56504946b4d0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d7001a910 con 0x56504946b4d0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d5ffff640 1 -- 172.21.15.19:0/1470341436 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d68003b70 con 0x56504946b4d0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 10 client.15876 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x565049486340 con 0x56504946b4d0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d5ffff640 1 -- 172.21.15.19:0/1470341436 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d7001a910 con 0x56504946b4d0 2024-09-11T00:05:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d5ffff640 1 -- 172.21.15.19:0/1470341436 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5d6802f6f0 con 0x56504946b4d0 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 10 client.15876 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 20 client.15876 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x565049487850 0x565049489c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 4 client.15876 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.484+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650493e3df0 con 0x565049487850 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.485+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x565049487850 0x565049489c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.485+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x565049487850 0x565049489c90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a247a62e12c246f2 server_cookie=67ebdb9abb8f3d00 in_seq=0 out_seq=0 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.485+0000 7f5d5ffff640 10 client.15876 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d5ffff640 1 -- 172.21.15.19:0/1470341436 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650493e3df0 con 0x565049487850 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d5ffff640 10 client.15876 handle_command_reply: tid=0 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 client.15876 shutdown 2024-09-11T00:05:34.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946b4d0 msgr2=0x565049477650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946b4d0 0x565049477650 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5d6802ade0 tx=0x7f5d68005f10 comp rx=0 tx=0).stop 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 shutdown_connections 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049475080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x565049474aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x565049487850 0x565049489c90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 --2- 172.21.15.19:0/1470341436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946b4d0 0x565049477650 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d5ffff640 0 client.15876 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 >> 172.21.15.19:0/1470341436 conn(0x565049469300 msgr2=0x56504946eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 shutdown_connections 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 1 -- 172.21.15.19:0/1470341436 wait complete. 2024-09-11T00:05:34.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.486+0000 7f5d891a8740 20 client.15876 trim_cache size 0 max 16384 2024-09-11T00:05:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 Processor -- start 2024-09-11T00:05:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 -- start start 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946b4d0 0x565049483c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049473f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049473320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801b3150 con 0x56504946bdf0 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801b09c0 con 0x56504946b4d0 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d891a8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801ae810 con 0x565049477d80 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d84b6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049473f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d84b6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049473f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52620/0 (socket says 172.21.15.19:52620) 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.500+0000 7f5d84b6f640 1 -- 172.21.15.19:0/4239727976 learned_addr learned my addr 172.21.15.19:0/4239727976 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049473320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946b4d0 0x565049483c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d84b6f640 1 -- 172.21.15.19:0/4239727976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 msgr2=0x565049473320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049473320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d84b6f640 1 -- 172.21.15.19:0/4239727976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946b4d0 msgr2=0x565049483c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946b4d0 0x565049483c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d84b6f640 1 -- 172.21.15.19:0/4239727976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565049474850 con 0x56504946bdf0 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049473f90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000fc30 tx=0x7f5d70000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c34c82409ad9b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d767fc640 1 -- 172.21.15.19:0/4239727976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70015050 con 0x56504946bdf0 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d767fc640 1 -- 172.21.15.19:0/4239727976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d70005040 con 0x56504946bdf0 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.501+0000 7f5d767fc640 1 -- 172.21.15.19:0/4239727976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70004ae0 con 0x56504946bdf0 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 -- 172.21.15.19:0/4239727976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 msgr2=0x565049473f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049473f90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000fc30 tx=0x7f5d70000bc0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 -- 172.21.15.19:0/4239727976 shutdown_connections 2024-09-11T00:05:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565049477d80 0x565049473320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56504946bdf0 0x565049473f90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 --2- 172.21.15.19:0/4239727976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946b4d0 0x565049483c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 -- 172.21.15.19:0/4239727976 >> 172.21.15.19:0/4239727976 conn(0x565049469300 msgr2=0x56504946fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 -- 172.21.15.19:0/4239727976 shutdown_connections 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 -- 172.21.15.19:0/4239727976 wait complete. 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 -- start start 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.502+0000 7f5d891a8740 1 Processor -- start 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504947c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x56504947c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d891a8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565049477d80 0x5650494f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d891a8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801aee80 con 0x565049477d80 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d891a8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801b02f0 con 0x56504946bdf0 2024-09-11T00:05:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d891a8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801af550 con 0x56504946b4d0 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d891a8740 10 client.0 _ll_register_callbacks cb 0x7f5d68009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504947c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504947c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42938/0 (socket says 172.21.15.19:42938) 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 -- 172.21.15.19:0/28169743 learned_addr learned my addr 172.21.15.19:0/28169743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565049477d80 0x5650494f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x56504947c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 -- 172.21.15.19:0/28169743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 msgr2=0x56504947c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x56504947c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 -- 172.21.15.19:0/28169743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565049477d80 msgr2=0x5650494f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565049477d80 0x5650494f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d7ffff640 1 -- 172.21.15.19:0/28169743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650494f3ca0 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.503+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x56504947c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d7ffff640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504947c030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d6802fb40 tx=0x7f5d68031e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=219fac2e6d43f515 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d5ffff640 1 -- 172.21.15.19:0/28169743 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6804a070 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d5ffff640 1 -- 172.21.15.19:0/28169743 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5d6802f870 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d70005040 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d5ffff640 1 -- 172.21.15.19:0/28169743 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d68004b40 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d891a8740 10 client.25507 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650494f4e60 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.504+0000 7f5d5ffff640 1 -- 172.21.15.19:0/28169743 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d70005040 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d5ffff640 1 -- 172.21.15.19:0/28169743 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5d680305c0 con 0x56504946b4d0 2024-09-11T00:05:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d891a8740 10 client.25507 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d891a8740 10 client.25507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d891a8740 20 client.25507 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d891a8740 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5650494f5520 0x5650494f7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d891a8740 4 client.25507 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5650493df8a0 con 0x5650494f5520 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5650494f5520 0x5650494f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d84b6f640 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5650494f5520 0x5650494f7940 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf620aa87e022e6 server_cookie=942d6aa812b73019 in_seq=0 out_seq=0 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d5ffff640 10 client.25507 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d5ffff640 1 -- 172.21.15.19:0/28169743 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5650493df8a0 con 0x5650494f5520 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d5ffff640 10 client.25507 handle_command_reply: tid=0 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.505+0000 7f5d891a8740 1 client.25507 shutdown 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 msgr2=0x56504947c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504947c030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d6802fb40 tx=0x7f5d68031e90 comp rx=0 tx=0).stop 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 shutdown_connections 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5650494f5520 0x5650494f7940 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565049477d80 0x5650494f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56504946bdf0 0x56504947c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d5ffff640 0 client.25507 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 --2- 172.21.15.19:0/28169743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56504946b4d0 0x56504947c030 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 >> 172.21.15.19:0/28169743 conn(0x565049469300 msgr2=0x5650494732b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 shutdown_connections 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 1 -- 172.21.15.19:0/28169743 wait complete. 2024-09-11T00:05:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d891a8740 20 client.25507 trim_cache size 0 max 16384 2024-09-11T00:05:34.522 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:05:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d6c0b54d0 msgr2=0x7f5d6c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d6c0b54d0 0x7f5d6c0b7990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5d780a9a50 tx=0x7f5d780049b0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d80109170 msgr2=0x7f5d80075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.506+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d80109170 0x7f5d80075f20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800e970 tx=0x7f5d7800ed70 comp rx=0 tx=0).stop 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 shutdown_connections 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d6c0b54d0 0x7f5d6c0b7990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d80109170 0x7f5d80075f20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d801087f0 0x7f5d800759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 --2- 172.21.15.19:0/1739269251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d80102de0 0x7f5d800754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 >> 172.21.15.19:0/1739269251 conn(0x7f5d800fe830 msgr2=0x7f5d80100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 shutdown_connections 2024-09-11T00:05:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:34.507+0000 7f5d86dd3640 1 -- 172.21.15.19:0/1739269251 wait complete. 2024-09-11T00:05:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:35 smithi135 ceph-mon[35432]: pgmap v417: 97 pgs: 97 active+clean; 415 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 128 op/s 2024-09-11T00:05:36.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:35 smithi019 ceph-mon[30859]: pgmap v417: 97 pgs: 97 active+clean; 415 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 128 op/s 2024-09-11T00:05:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:35 smithi131 ceph-mon[35491]: pgmap v417: 97 pgs: 97 active+clean; 415 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 128 op/s 2024-09-11T00:05:36.650 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:05:36.651 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:05:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.580+0000 7f2082b77640 1 -- 172.21.15.19:0/2632167912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c109150 msgr2=0x7f207c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.580+0000 7f2082b77640 1 --2- 172.21.15.19:0/2632167912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c109150 0x7f207c10f950 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2074009900 tx=0x7f207402a410 comp rx=0 tx=0).stop 2024-09-11T00:05:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.580+0000 7f2082b77640 1 -- 172.21.15.19:0/2632167912 shutdown_connections 2024-09-11T00:05:37.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.580+0000 7f2082b77640 1 --2- 172.21.15.19:0/2632167912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c109150 0x7f207c10f950 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.580+0000 7f2082b77640 1 --2- 172.21.15.19:0/2632167912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f207c1087d0 0x7f207c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.580+0000 7f2082b77640 1 --2- 172.21.15.19:0/2632167912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 0x7f207c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.580+0000 7f2082b77640 1 -- 172.21.15.19:0/2632167912 >> 172.21.15.19:0/2632167912 conn(0x7f207c0fe830 msgr2=0x7f207c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.581+0000 7f2082b77640 1 -- 172.21.15.19:0/2632167912 shutdown_connections 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.581+0000 7f2082b77640 1 -- 172.21.15.19:0/2632167912 wait complete. 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.581+0000 7f2082b77640 1 Processor -- start 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.581+0000 7f2082b77640 1 -- start start 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2082b77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 0x7f207c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2082b77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c1087d0 0x7f207c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2082b77640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f207c109150 0x7f207c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2082b77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f207c112e10 con 0x7f207c1087d0 2024-09-11T00:05:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2082b77640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f207c112c90 con 0x7f207c109150 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2082b77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f207c112f90 con 0x7f207c102dc0 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 0x7f207c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f207bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c1087d0 0x7f207c199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 0x7f207c199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42958/0 (socket says 172.21.15.19:42958) 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f207bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c1087d0 0x7f207c199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52642/0 (socket says 172.21.15.19:52642) 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 -- 172.21.15.19:0/2342886286 learned_addr learned my addr 172.21.15.19:0/2342886286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2081114640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f207c109150 0x7f207c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 -- 172.21.15.19:0/2342886286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f207c109150 msgr2=0x7f207c19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f207c109150 0x7f207c19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 -- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c1087d0 msgr2=0x7f207c199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c1087d0 0x7f207c199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 -- 172.21.15.19:0/2342886286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207c19f2f0 con 0x7f207c102dc0 2024-09-11T00:05:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f207bfff640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c1087d0 0x7f207c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.582+0000 7f2080913640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 0x7f207c199240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f206c00eb90 tx=0x7f206c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.583+0000 7f2079ffb640 1 -- 172.21.15.19:0/2342886286 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c004d20 con 0x7f207c102dc0 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.583+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207c19f5e0 con 0x7f207c102dc0 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.583+0000 7f2079ffb640 1 -- 172.21.15.19:0/2342886286 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f206c00ee90 con 0x7f207c102dc0 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.583+0000 7f2079ffb640 1 -- 172.21.15.19:0/2342886286 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c010670 con 0x7f207c102dc0 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.583+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207c1a5ca0 con 0x7f207c102dc0 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.585+0000 7f2084f4c740 1 Processor -- start 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.585+0000 7f2084f4c740 1 -- start start 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a0ee0 0x564e6c1a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2079ffb640 1 -- 172.21.15.19:0/2342886286 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f206c005020 con 0x7f207c102dc0 2024-09-11T00:05:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2084f4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e6c117e60 con 0x564e6c1b1ba0 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2084f4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564e6c107290 con 0x564e6c1a1800 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2084f4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e6c10b0a0 con 0x564e6c1a0ee0 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2081114640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a0ee0 0x564e6c1a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f207bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2081114640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a0ee0 0x564e6c1a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42972/0 (socket says 172.21.15.19:42972) 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2081114640 1 -- 172.21.15.19:0/2557984987 learned_addr learned my addr 172.21.15.19:0/2557984987 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2080913640 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f207bfff640 1 -- 172.21.15.19:0/2557984987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a0ee0 msgr2=0x564e6c1a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f207bfff640 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a0ee0 0x564e6c1a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f207bfff640 1 -- 172.21.15.19:0/2557984987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 msgr2=0x564e6c1b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f207bfff640 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f207bfff640 1 -- 172.21.15.19:0/2557984987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6be65930 con 0x564e6c1b1ba0 2024-09-11T00:05:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f2080913640 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.586+0000 7f207bfff640 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b3f90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2064005d00 tx=0x7f206400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c214f3dad2daa43a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2072ffd640 1 -- 172.21.15.19:0/2557984987 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2064011700 con 0x564e6c1b1ba0 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2072ffd640 1 -- 172.21.15.19:0/2557984987 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2064011d50 con 0x564e6c1b1ba0 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2072ffd640 1 -- 172.21.15.19:0/2557984987 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206401a380 con 0x564e6c1b1ba0 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2079ffb640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20680b5450 0x7f20680b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2081114640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20680b5450 0x7f20680b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2079ffb640 1 -- 172.21.15.19:0/2342886286 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f206c0e65a0 con 0x7f207c102dc0 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2084f4c740 1 -- 172.21.15.19:0/2557984987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 msgr2=0x564e6c1b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2084f4c740 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b3f90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2064005d00 tx=0x7f206400bf90 comp rx=0 tx=0).stop 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2084f4c740 1 -- 172.21.15.19:0/2557984987 shutdown_connections 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2084f4c740 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b3f90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2084f4c740 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2084f4c740 1 --2- 172.21.15.19:0/2557984987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a0ee0 0x564e6c1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.587+0000 7f2084f4c740 1 -- 172.21.15.19:0/2557984987 >> 172.21.15.19:0/2557984987 conn(0x564e6c19ed10 msgr2=0x564e6c19feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 -- 172.21.15.19:0/2557984987 shutdown_connections 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2081114640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20680b5450 0x7f20680b7910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20740096c0 tx=0x7f20740058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 -- 172.21.15.19:0/2557984987 wait complete. 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 -- start start 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 Processor -- start 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1a0ee0 0x564e6c1aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1b1ba0 0x564e6c1af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e6bf68890 con 0x564e6c1a0ee0 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564e6c0a1d40 con 0x564e6c1a1800 2024-09-11T00:05:37.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e6c1b4850 con 0x564e6c1b1ba0 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.588+0000 7f2084f4c740 10 client.0 _ll_register_callbacks cb 0x564e6c105c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1a0ee0 0x564e6c1aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2081114640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1b1ba0 0x564e6c1af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f207bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1a0ee0 0x564e6c1aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52662/0 (socket says 172.21.15.19:52662) 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 -- 172.21.15.19:0/11546837 learned_addr learned my addr 172.21.15.19:0/11546837 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 -- 172.21.15.19:0/11546837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1b1ba0 msgr2=0x564e6c1af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1b1ba0 0x564e6c1af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 -- 172.21.15.19:0/11546837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 msgr2=0x564e6c1af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 -- 172.21.15.19:0/11546837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6c1bdbd0 con 0x564e6c1a0ee0 2024-09-11T00:05:37.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2080913640 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1a0ee0 0x564e6c1aeb00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f206c0a9d10 tx=0x7f206c0a8a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f16567e6aee7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f205bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f205bfff640 1 -- 172.21.15.19:0/11546837 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c0ac210 con 0x564e6c1a0ee0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f205bfff640 1 -- 172.21.15.19:0/11546837 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f206c0b1180 con 0x564e6c1a0ee0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2064011d50 con 0x564e6c1a0ee0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f205bfff640 1 -- 172.21.15.19:0/11546837 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f206c0a8210 con 0x564e6c1a0ee0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2084f4c740 10 client.15894 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.589+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e6c1c0550 con 0x564e6c1a0ee0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f205bfff640 1 -- 172.21.15.19:0/11546837 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2064011d50 con 0x564e6c1a0ee0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f205bfff640 1 -- 172.21.15.19:0/11546837 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f206c0abd00 con 0x564e6c1a0ee0 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f2084f4c740 10 client.15894 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f2084f4c740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f2084f4c740 20 client.15894 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:37.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f2084f4c740 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c1c1ab0 0x564e6c1c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f2084f4c740 4 client.15894 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:37.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e6c119db0 con 0x564e6c1c1ab0 2024-09-11T00:05:37.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.590+0000 7f207bfff640 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c1c1ab0 0x564e6c1c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.591+0000 7f205bfff640 10 client.15894 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:37.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.591+0000 7f207bfff640 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c1c1ab0 0x564e6c1c3f00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0bafb8c04f97a5 server_cookie=58cf31d3b26544fa in_seq=0 out_seq=0 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f205bfff640 1 -- 172.21.15.19:0/11546837 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e6c119db0 con 0x564e6c1c1ab0 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f205bfff640 10 client.15894 handle_command_reply: tid=0 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 client.15894 shutdown 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1a0ee0 msgr2=0x564e6c1aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1a0ee0 0x564e6c1aeb00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f206c0a9d10 tx=0x7f206c0a8a00 comp rx=0 tx=0).stop 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 shutdown_connections 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1b1ba0 0x564e6c1af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a1800 0x564e6c1af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c1c1ab0 0x564e6c1c3f00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 --2- 172.21.15.19:0/11546837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1a0ee0 0x564e6c1aeb00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 >> 172.21.15.19:0/11546837 conn(0x564e6c19ed10 msgr2=0x564e6c19df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f205bfff640 0 client.15894 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 shutdown_connections 2024-09-11T00:05:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 1 -- 172.21.15.19:0/11546837 wait complete. 2024-09-11T00:05:37.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.592+0000 7f2084f4c740 20 client.15894 trim_cache size 0 max 16384 2024-09-11T00:05:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 Processor -- start 2024-09-11T00:05:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 -- start start 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1ac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f207c1aec80 con 0x564e6c1b1ba0 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f207c1ac4f0 con 0x564e6c1a0ee0 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2084f4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f207c1aa360 con 0x564e6c1a1800 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2081114640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2081114640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1a2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52664/0 (socket says 172.21.15.19:52664) 2024-09-11T00:05:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f207bfff640 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2081114640 1 -- 172.21.15.19:0/1580791088 learned_addr learned my addr 172.21.15.19:0/1580791088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:37.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2080913640 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.610+0000 7f2081114640 1 -- 172.21.15.19:0/1580791088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 msgr2=0x564e6c1b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f2081114640 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f2081114640 1 -- 172.21.15.19:0/1580791088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 msgr2=0x564e6c1ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f2081114640 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f2081114640 1 -- 172.21.15.19:0/1580791088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6c1b11a0 con 0x564e6c1b1ba0 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f2081114640 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1a2f40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2074032bd0 tx=0x7f207403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf0f16f3f34f8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f20727fc640 1 -- 172.21.15.19:0/1580791088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074035040 con 0x564e6c1b1ba0 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f20727fc640 1 -- 172.21.15.19:0/1580791088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207404e070 con 0x564e6c1b1ba0 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.611+0000 7f20727fc640 1 -- 172.21.15.19:0/1580791088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074004c70 con 0x564e6c1b1ba0 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 -- 172.21.15.19:0/1580791088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 msgr2=0x564e6c1a2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1a2f40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2074032bd0 tx=0x7f207403f000 comp rx=0 tx=0).stop 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 -- 172.21.15.19:0/1580791088 shutdown_connections 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1a2f40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1580791088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 -- 172.21.15.19:0/1580791088 >> 172.21.15.19:0/1580791088 conn(0x564e6c19ed10 msgr2=0x564e6c1b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 -- 172.21.15.19:0/1580791088 shutdown_connections 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 -- 172.21.15.19:0/1580791088 wait complete. 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 -- start start 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.612+0000 7f2084f4c740 1 Processor -- start 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2084f4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2084f4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f207c1aa9b0 con 0x564e6c1b1ba0 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2084f4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f207c1abe20 con 0x564e6c1a0ee0 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2084f4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f207c1ab080 con 0x564e6c1a1800 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2084f4c740 10 client.0 _ll_register_callbacks cb 0x7f206c0a91c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52680/0 (socket says 172.21.15.19:52680) 2024-09-11T00:05:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 -- 172.21.15.19:0/1185120880 learned_addr learned my addr 172.21.15.19:0/1185120880 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f207bfff640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2080913640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 -- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 msgr2=0x564e6c1ba4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1ba4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 -- 172.21.15.19:0/1185120880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 msgr2=0x564e6c1b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1b9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f2081114640 1 -- 172.21.15.19:0/1185120880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6c1b7530 con 0x564e6c1b1ba0 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.613+0000 7f207bfff640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1ba4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f2081114640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b6d00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2074005ab0 tx=0x7f20740043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7390b51c748431e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f205bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f205bfff640 1 -- 172.21.15.19:0/1185120880 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074061060 con 0x564e6c1b1ba0 2024-09-11T00:05:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f205bfff640 1 -- 172.21.15.19:0/1185120880 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2074003800 con 0x564e6c1b1ba0 2024-09-11T00:05:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f207404e070 con 0x564e6c1b1ba0 2024-09-11T00:05:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f205bfff640 1 -- 172.21.15.19:0/1185120880 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20740314a0 con 0x564e6c1b1ba0 2024-09-11T00:05:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f2084f4c740 10 client.15900 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e6c22f750 con 0x564e6c1b1ba0 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f205bfff640 1 -- 172.21.15.19:0/1185120880 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207404e070 con 0x564e6c1b1ba0 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f205bfff640 1 -- 172.21.15.19:0/1185120880 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2074053890 con 0x564e6c1b1ba0 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f2084f4c740 10 client.15900 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.614+0000 7f2084f4c740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.615+0000 7f2084f4c740 20 client.15900 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.615+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c22fe50 0x564e6c232270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.615+0000 7f2084f4c740 4 client.15900 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.615+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564e6c1c4290 con 0x564e6c22fe50 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.615+0000 7f2080913640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c22fe50 0x564e6c232270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.615+0000 7f205bfff640 10 client.15900 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.615+0000 7f2080913640 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c22fe50 0x564e6c232270 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5cffc313c565f9 server_cookie=a031dbe851f3fa92 in_seq=0 out_seq=0 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f205bfff640 1 -- 172.21.15.19:0/1185120880 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564e6c1c4290 con 0x564e6c22fe50 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f205bfff640 10 client.15900 handle_command_reply: tid=0 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 client.15900 shutdown 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 msgr2=0x564e6c1b6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b6d00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2074005ab0 tx=0x7f20740043f0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 shutdown_connections 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x564e6c22fe50 0x564e6c232270 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e6c1b1ba0 0x564e6c1b6d00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e6c1a1800 0x564e6c1ba4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 --2- 172.21.15.19:0/1185120880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e6c1a0ee0 0x564e6c1b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 >> 172.21.15.19:0/1185120880 conn(0x564e6c19ed10 msgr2=0x564e6c1b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f205bfff640 0 client.15900 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 shutdown_connections 2024-09-11T00:05:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 1 -- 172.21.15.19:0/1185120880 wait complete. 2024-09-11T00:05:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.617+0000 7f2084f4c740 20 client.15900 trim_cache size 0 max 16384 2024-09-11T00:05:37.623 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:05:37.623 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:05:37.623 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "ce46908f-d85e-4336-a09e-ef5f7957d972", 2024-09-11T00:05:37.623 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:05:37.623 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20680b5450 msgr2=0x7f20680b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20680b5450 0x7f20680b7910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20740096c0 tx=0x7f20740058d0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 msgr2=0x7f207c199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 0x7f207c199240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f206c00eb90 tx=0x7f206c00c6a0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 shutdown_connections 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f207c109150 0x7f207c19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f20680b5450 0x7f20680b7910 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f207c1087d0 0x7f207c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 --2- 172.21.15.19:0/2342886286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c102dc0 0x7f207c199240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 >> 172.21.15.19:0/2342886286 conn(0x7f207c0fe830 msgr2=0x7f207c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 shutdown_connections 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:37.618+0000 7f2082b77640 1 -- 172.21.15.19:0/2342886286 wait complete. 2024-09-11T00:05:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:37 smithi135 ceph-mon[35432]: pgmap v418: 97 pgs: 97 active+clean; 431 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 196 op/s 2024-09-11T00:05:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:37 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:05:38.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:37 smithi019 ceph-mon[30859]: pgmap v418: 97 pgs: 97 active+clean; 431 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 196 op/s 2024-09-11T00:05:38.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:37 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:05:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:37 smithi131 ceph-mon[35491]: pgmap v418: 97 pgs: 97 active+clean; 431 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 196 op/s 2024-09-11T00:05:38.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:37 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:05:38.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:05:38.673 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:39.101 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:38 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:05:39.101 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:38 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:39.101 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:38 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:05:39.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:38 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:05:39.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:38 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:39.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:38 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 -- 172.21.15.19:0/1414225019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 msgr2=0x7fa488107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 --2- 172.21.15.19:0/1414225019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa488107b20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009900 tx=0x7fa47c02a410 comp rx=0 tx=0).stop 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 -- 172.21.15.19:0/1414225019 shutdown_connections 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 --2- 172.21.15.19:0/1414225019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa488108060 0x7fa48810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 --2- 172.21.15.19:0/1414225019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa488107b20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 --2- 172.21.15.19:0/1414225019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa488101cd0 0x7fa4881020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 -- 172.21.15.19:0/1414225019 >> 172.21.15.19:0/1414225019 conn(0x7fa4880fd740 msgr2=0x7fa4880ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 -- 172.21.15.19:0/1414225019 shutdown_connections 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.183+0000 7fa48d776640 1 -- 172.21.15.19:0/1414225019 wait complete. 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 Processor -- start 2024-09-11T00:05:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 -- start start 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa488101cd0 0x7fa4880fdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa4880fe180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa488108060 0x7fa4880fe6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa488111ce0 con 0x7fa4881076e0 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa488111b60 con 0x7fa488101cd0 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa48d776640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa488111e60 con 0x7fa488108060 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa4867fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa4880fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa488101cd0 0x7fa4880fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa4877fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa488108060 0x7fa4880fe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa4867fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa4880fe180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52698/0 (socket says 172.21.15.19:52698) 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa488101cd0 0x7fa4880fdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:46308/0 (socket says 172.21.15.19:46308) 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.184+0000 7fa4867fc640 1 -- 172.21.15.19:0/1249231551 learned_addr learned my addr 172.21.15.19:0/1249231551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa4877fe640 1 -- 172.21.15.19:0/1249231551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa488101cd0 msgr2=0x7fa4880fdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa4877fe640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa488101cd0 0x7fa4880fdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa4877fe640 1 -- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 msgr2=0x7fa4880fe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa4877fe640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa4880fe180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa4877fe640 1 -- 172.21.15.19:0/1249231551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4881a76c0 con 0x7fa488108060 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa4867fc640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa4880fe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa4877fe640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa488108060 0x7fa4880fe6c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa480009fd0 tx=0x7fa48000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa46ffff640 1 -- 172.21.15.19:0/1249231551 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48000ce20 con 0x7fa488108060 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4881a79b0 con 0x7fa488108060 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa46ffff640 1 -- 172.21.15.19:0/1249231551 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa480005020 con 0x7fa488108060 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa46ffff640 1 -- 172.21.15.19:0/1249231551 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480010690 con 0x7fa488108060 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.185+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4881a7f10 con 0x7fa488108060 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.188+0000 7fa48fb4b740 1 Processor -- start 2024-09-11T00:05:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.188+0000 7fa46ffff640 1 -- 172.21.15.19:0/1249231551 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fa4800054d0 con 0x7fa488108060 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa48fb4b740 1 -- start start 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa239480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2399c0 0x5575fa245410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa245950 0x5575fa247d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5575fa1afe50 con 0x5575fa2390a0 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5575fa19f280 con 0x5575fa2399c0 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5575fa1a3090 con 0x5575fa245950 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa239480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa239480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52708/0 (socket says 172.21.15.19:52708) 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 -- 172.21.15.19:0/1266559002 learned_addr learned my addr 172.21.15.19:0/1266559002 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa245950 0x5575fa247d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa486ffd640 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2399c0 0x5575fa245410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 -- 172.21.15.19:0/1266559002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa245950 msgr2=0x5575fa247d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa245950 0x5575fa247d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 -- 172.21.15.19:0/1266559002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2399c0 msgr2=0x5575fa245410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2399c0 0x5575fa245410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 -- 172.21.15.19:0/1266559002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f9efd650 con 0x5575fa2390a0 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa46ffff640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4700b54d0 0x7fa4700b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa4867fc640 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa239480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005c40 tx=0x7fa47c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee15d9f401123b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.189+0000 7fa486ffd640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4700b54d0 0x7fa4700b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa46ffff640 1 -- 172.21.15.19:0/1249231551 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa4800e65a0 con 0x7fa488108060 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa46d7fa640 1 -- 172.21.15.19:0/1266559002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c044030 con 0x5575fa2390a0 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa46d7fa640 1 -- 172.21.15.19:0/1266559002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa47c005020 con 0x5575fa2390a0 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa46d7fa640 1 -- 172.21.15.19:0/1266559002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c035040 con 0x5575fa2390a0 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1266559002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 msgr2=0x5575fa239480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa239480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005c40 tx=0x7fa47c005b50 comp rx=0 tx=0).stop 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa486ffd640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4700b54d0 0x7fa4700b7990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5575fa237db0 tx=0x7fa47800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1266559002 shutdown_connections 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa245950 0x5575fa247d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2399c0 0x5575fa245410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1266559002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa239480 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1266559002 >> 172.21.15.19:0/1266559002 conn(0x5575fa236ed0 msgr2=0x5575fa238070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.190+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1266559002 shutdown_connections 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1266559002 wait complete. 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 -- start start 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 Processor -- start 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2390a0 0x5575fa2451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa242640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa245950 0x5575fa242c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5575fa000700 con 0x5575fa245950 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5575fa13a110 con 0x5575fa2390a0 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5575fa248570 con 0x5575fa2399c0 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa48fb4b740 10 client.0 _ll_register_callbacks cb 0x5575fa153990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa4877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa245950 0x5575fa242c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa4877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa245950 0x5575fa242c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52716/0 (socket says 172.21.15.19:52716) 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa4877fe640 1 -- 172.21.15.19:0/444003466 learned_addr learned my addr 172.21.15.19:0/444003466 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa4867fc640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa242640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.191+0000 7fa486ffd640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2390a0 0x5575fa2451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa4877fe640 1 -- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 msgr2=0x5575fa242640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa4877fe640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa242640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa4877fe640 1 -- 172.21.15.19:0/444003466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2390a0 msgr2=0x5575fa2451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa4877fe640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2390a0 0x5575fa2451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa4877fe640 1 -- 172.21.15.19:0/444003466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575fa167c40 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa486ffd640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2390a0 0x5575fa2451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa4877fe640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa245950 0x5575fa242c00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa4800a9070 tx=0x7fa4800ac210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6484bf38fdc547 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa46aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa46aff5640 1 -- 172.21.15.19:0/444003466 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4800acaa0 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa46aff5640 1 -- 172.21.15.19:0/444003466 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa4800b10d0 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa47c005020 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa46aff5640 1 -- 172.21.15.19:0/444003466 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4800c7050 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa48fb4b740 10 client.15912 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5575fa253ec0 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa46aff5640 1 -- 172.21.15.19:0/444003466 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa47c005020 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.192+0000 7fa46aff5640 1 -- 172.21.15.19:0/444003466 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa4800abd00 con 0x5575fa245950 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa48fb4b740 10 client.15912 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa48fb4b740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa48fb4b740 20 client.15912 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2553d0 0x5575fa257830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa48fb4b740 4 client.15912 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575fa1b1da0 con 0x5575fa2553d0 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa486ffd640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2553d0 0x5575fa257830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa486ffd640 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2553d0 0x5575fa257830 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69a4f98ef56604f2 server_cookie=38c53f97588fa5d3 in_seq=0 out_seq=0 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.193+0000 7fa46aff5640 10 client.15912 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa46aff5640 1 -- 172.21.15.19:0/444003466 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575fa1b1da0 con 0x5575fa2553d0 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa46aff5640 10 client.15912 handle_command_reply: tid=0 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 client.15912 shutdown 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa245950 msgr2=0x5575fa242c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa245950 0x5575fa242c00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa4800a9070 tx=0x7fa4800ac210 comp rx=0 tx=0).stop 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 shutdown_connections 2024-09-11T00:05:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2553d0 0x5575fa257830 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa245950 0x5575fa242c00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa242640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa46aff5640 0 client.15912 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/444003466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa2390a0 0x5575fa2451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.194+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 >> 172.21.15.19:0/444003466 conn(0x5575fa236ed0 msgr2=0x5575fa23ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.195+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 shutdown_connections 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.195+0000 7fa48fb4b740 1 -- 172.21.15.19:0/444003466 wait complete. 2024-09-11T00:05:39.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.195+0000 7fa48fb4b740 20 client.15912 trim_cache size 0 max 16384 2024-09-11T00:05:39.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.212+0000 7fa48fb4b740 1 Processor -- start 2024-09-11T00:05:39.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.212+0000 7fa48fb4b740 1 -- start start 2024-09-11T00:05:39.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa237f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa235e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa246d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881b2e90 con 0x5575fa2390a0 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881b0700 con 0x5575fa245950 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ae550 con 0x5575fa2399c0 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa237f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa237f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52728/0 (socket says 172.21.15.19:52728) 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 -- 172.21.15.19:0/1687158898 learned_addr learned my addr 172.21.15.19:0/1687158898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa4867fc640 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa235e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa4877fe640 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa246d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 -- 172.21.15.19:0/1687158898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 msgr2=0x5575fa235e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa235e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 -- 172.21.15.19:0/1687158898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 msgr2=0x5575fa246d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa246d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 -- 172.21.15.19:0/1687158898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575fa237950 con 0x5575fa2390a0 2024-09-11T00:05:39.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa4877fe640 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa246d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:39.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.213+0000 7fa486ffd640 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa237f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x5575fa258070 tx=0x7fa478015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9e919756590670 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa46cff9640 1 -- 172.21.15.19:0/1687158898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478010e00 con 0x5575fa2390a0 2024-09-11T00:05:39.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa46cff9640 1 -- 172.21.15.19:0/1687158898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa47801e0d0 con 0x5575fa2390a0 2024-09-11T00:05:39.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa46cff9640 1 -- 172.21.15.19:0/1687158898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478003850 con 0x5575fa2390a0 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1687158898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 msgr2=0x5575fa237f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa237f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x5575fa258070 tx=0x7fa478015000 comp rx=0 tx=0).stop 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1687158898 shutdown_connections 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa246d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa235e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/1687158898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa237f90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1687158898 >> 172.21.15.19:0/1687158898 conn(0x5575fa236ed0 msgr2=0x5575fa235700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1687158898 shutdown_connections 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.214+0000 7fa48fb4b740 1 -- 172.21.15.19:0/1687158898 wait complete. 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 -- start start 2024-09-11T00:05:39.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 Processor -- start 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa24d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa24dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa23e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881aebc0 con 0x5575fa2390a0 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881b0030 con 0x5575fa245950 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881af290 con 0x5575fa2399c0 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa48fb4b740 10 client.0 _ll_register_callbacks cb 0x7fa4800a90f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa24d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa4867fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa24dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa24d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52742/0 (socket says 172.21.15.19:52742) 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.215+0000 7fa486ffd640 1 -- 172.21.15.19:0/2494203441 learned_addr learned my addr 172.21.15.19:0/2494203441 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa4877fe640 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa23e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa486ffd640 1 -- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 msgr2=0x5575fa24dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa486ffd640 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa24dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa486ffd640 1 -- 172.21.15.19:0/2494203441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 msgr2=0x5575fa23e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa486ffd640 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa23e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa486ffd640 1 -- 172.21.15.19:0/2494203441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575fa24e3b0 con 0x5575fa2390a0 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa4867fc640 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa24dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa486ffd640 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa24d800 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa47801e370 tx=0x7fa47801e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7112059ae853795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa46aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa46aff5640 1 -- 172.21.15.19:0/2494203441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478033040 con 0x5575fa2390a0 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa46aff5640 1 -- 172.21.15.19:0/2494203441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fa47801c450 con 0x5575fa2390a0 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa47801e0d0 con 0x5575fa2390a0 2024-09-11T00:05:39.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa46aff5640 1 -- 172.21.15.19:0/2494203441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa47801c690 con 0x5575fa2390a0 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa48fb4b740 10 client.15918 fetch_fsmap learned FSMap version 29 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.216+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5575fa2c3780 con 0x5575fa2390a0 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa46aff5640 1 -- 172.21.15.19:0/2494203441 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa47801e0d0 con 0x5575fa2390a0 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa46aff5640 1 -- 172.21.15.19:0/2494203441 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa478036070 con 0x5575fa2390a0 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa48fb4b740 10 client.15918 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa48fb4b740 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa48fb4b740 20 client.15918 populate_metadata read hostname 'smithi019' 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2c3f80 0x5575fa2c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa48fb4b740 4 client.15918 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5575fa1ad850 con 0x5575fa2c3f80 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa4867fc640 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2c3f80 0x5575fa2c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa4867fc640 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2c3f80 0x5575fa2c63a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b392d4800b33bfa server_cookie=b6d6449bff0e71d4 in_seq=0 out_seq=0 2024-09-11T00:05:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.217+0000 7fa46aff5640 10 client.15918 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa46aff5640 1 -- 172.21.15.19:0/2494203441 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x5575fa1ad850 con 0x5575fa2c3f80 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa46aff5640 10 client.15918 handle_command_reply: tid=0 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 client.15918 shutdown 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 msgr2=0x5575fa24d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa24d800 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa47801e370 tx=0x7fa47801e3a0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 shutdown_connections 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5575fa245950 0x5575fa23e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fa2399c0 0x5575fa24dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575fa2c3f80 0x5575fa2c63a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 --2- 172.21.15.19:0/2494203441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575fa2390a0 0x5575fa24d800 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa46aff5640 0 client.15918 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 >> 172.21.15.19:0/2494203441 conn(0x5575fa236ed0 msgr2=0x5575fa235f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 shutdown_connections 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 1 -- 172.21.15.19:0/2494203441 wait complete. 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.218+0000 7fa48fb4b740 20 client.15918 trim_cache size 0 max 16384 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "ce46908f-d85e-4336-a09e-ef5f7957d972", 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:05:39.227 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:05:39.228 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:39.229 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:05:39.230 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:05:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:05:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:05:39.231 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:05:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4700b54d0 msgr2=0x7fa4700b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4700b54d0 0x7fa4700b7990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5575fa237db0 tx=0x7fa47800a2d0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa488108060 msgr2=0x7fa4880fe6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa488108060 0x7fa4880fe6c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa480009fd0 tx=0x7fa48000ef10 comp rx=0 tx=0).stop 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 shutdown_connections 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa488108060 0x7fa4880fe6c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4700b54d0 0x7fa4700b7990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881076e0 0x7fa4880fe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 --2- 172.21.15.19:0/1249231551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa488101cd0 0x7fa4880fdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 >> 172.21.15.19:0/1249231551 conn(0x7fa4880fd740 msgr2=0x7fa488104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 shutdown_connections 2024-09-11T00:05:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:05:39.219+0000 7fa48d776640 1 -- 172.21.15.19:0/1249231551 wait complete. 2024-09-11T00:05:39.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:38 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:05:39.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:38 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:39.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:38 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:05:40.059 INFO:tasks.cephfs.filesystem:scrub status for tag:ce46908f-d85e-4336-a09e-ef5f7957d972 - {'path': '/', 'tag': 'ce46908f-d85e-4336-a09e-ef5f7957d972', 'options': 'recursive,force'} 2024-09-11T00:05:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:39 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:05:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:39 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:39 smithi135 ceph-mon[35432]: pgmap v419: 97 pgs: 97 active+clean; 458 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 325 op/s 2024-09-11T00:05:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:39 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:05:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:39 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:40.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:39 smithi019 ceph-mon[30859]: pgmap v419: 97 pgs: 97 active+clean; 458 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 325 op/s 2024-09-11T00:05:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:39 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:05:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:39 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:39 smithi131 ceph-mon[35491]: pgmap v419: 97 pgs: 97 active+clean; 458 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 325 op/s 2024-09-11T00:05:41.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:40 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:41.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:40 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:05:41.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:40 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:41.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:40 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:41.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:40 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:05:41.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:40 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:41.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:40 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:41.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:40 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:05:41.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:40 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:41 smithi135 ceph-mon[35432]: pgmap v420: 97 pgs: 97 active+clean; 483 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 505 op/s 2024-09-11T00:05:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:41 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:05:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:41 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:41 smithi131 ceph-mon[35491]: pgmap v420: 97 pgs: 97 active+clean; 483 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 505 op/s 2024-09-11T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:41 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:41 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:05:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:41 smithi019 ceph-mon[30859]: pgmap v420: 97 pgs: 97 active+clean; 483 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 505 op/s 2024-09-11T00:05:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:41 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:05:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:41 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:05:43.107 INFO:tasks.workunit.client.0.smithi019.stdout: 84 8578 142 5542 126 3671 527 2024-09-11T00:05:43.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:42 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:43.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:42 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:43.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:42 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:44.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:43 smithi135 ceph-mon[35432]: pgmap v421: 97 pgs: 97 active+clean; 503 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.2 MiB/s wr, 651 op/s 2024-09-11T00:05:44.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:43 smithi019 ceph-mon[30859]: pgmap v421: 97 pgs: 97 active+clean; 503 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.2 MiB/s wr, 651 op/s 2024-09-11T00:05:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:43 smithi131 ceph-mon[35491]: pgmap v421: 97 pgs: 97 active+clean; 503 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.2 MiB/s wr, 651 op/s 2024-09-11T00:05:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:45 smithi135 ceph-mon[35432]: pgmap v422: 97 pgs: 97 active+clean; 507 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.8 MiB/s wr, 639 op/s 2024-09-11T00:05:46.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:45 smithi019 ceph-mon[30859]: pgmap v422: 97 pgs: 97 active+clean; 507 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.8 MiB/s wr, 639 op/s 2024-09-11T00:05:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:45 smithi131 ceph-mon[35491]: pgmap v422: 97 pgs: 97 active+clean; 507 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.8 MiB/s wr, 639 op/s 2024-09-11T00:05:48.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:47 smithi019 ceph-mon[30859]: pgmap v423: 97 pgs: 97 active+clean; 513 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 765 op/s 2024-09-11T00:05:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:47 smithi131 ceph-mon[35491]: pgmap v423: 97 pgs: 97 active+clean; 513 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 765 op/s 2024-09-11T00:05:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:47 smithi135 ceph-mon[35432]: pgmap v423: 97 pgs: 97 active+clean; 513 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 765 op/s 2024-09-11T00:05:49.017 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.018 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.018 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.018 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95519]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.018 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95522]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.018 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95522]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.018 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.018 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:05:48 smithi019 sudo[95522]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.109 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68711]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.109 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68711]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.109 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.109 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68711]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68705]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68705]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68705]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68708]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68708]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.110 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:05:48 smithi131 sudo[68708]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.272 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95527]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95527]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95527]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95530]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95530]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.273 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95530]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69650]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69650]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69650]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.336 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:05:48 smithi135 sudo[69653]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.464 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68714]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.465 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68714]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.465 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.465 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68714]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69656]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69656]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69659]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69659]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69659]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.772 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95533]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95533]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95533]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95536]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95536]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:05:49 smithi019 sudo[95536]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68717]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:49.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68717]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68717]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68720]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:49.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68720]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:49.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:49.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:05:49 smithi131 sudo[68720]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:49.960 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:49 smithi135 ceph-mon[35432]: pgmap v424: 97 pgs: 97 active+clean; 516 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 796 op/s 2024-09-11T00:05:49.960 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:49.960 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:49.961 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:49 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:49.961 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69662]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:50.102 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:49 smithi131 ceph-mon[35491]: pgmap v424: 97 pgs: 97 active+clean; 516 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 796 op/s 2024-09-11T00:05:50.102 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:50.102 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:50.102 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:49 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:50.102 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68723]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:50.103 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68723]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.103 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.103 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68723]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.223 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69669]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:50.223 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69669]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.224 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.224 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69669]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.224 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69662]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.225 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.225 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:49 smithi135 sudo[69662]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.225 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69666]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:50.225 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69666]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.226 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.226 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69666]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.242 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:49 smithi019 ceph-mon[30859]: pgmap v424: 97 pgs: 97 active+clean; 516 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 796 op/s 2024-09-11T00:05:50.242 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:50.242 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:50.242 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:49 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:50.243 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95540]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:50.243 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95540]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.243 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.243 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95540]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.243 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95543]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:50.244 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95543]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.244 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.244 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95543]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.355 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68729]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:50.355 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.355 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.355 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68729]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.356 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68726]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:50.356 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68726]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.356 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.356 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68726]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95546]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95546]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95546]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95549]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95549]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 sudo[95549]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.675 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69672]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:50.675 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69672]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.675 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.675 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69672]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69675]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69675]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69675]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69678]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69678]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 sudo[69678]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:50.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68732]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:05:50.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68732]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:05:50.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:05:50.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 sudo[68732]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:05:51.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:50 smithi135 ceph-mon[35432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:50 smithi019 ceph-mon[30859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:05:51.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:50 smithi131 ceph-mon[35491]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:05:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:51 smithi135 ceph-mon[35432]: pgmap v425: 97 pgs: 97 active+clean; 516 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 638 op/s 2024-09-11T00:05:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:51 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:05:52.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:51 smithi019 ceph-mon[30859]: pgmap v425: 97 pgs: 97 active+clean; 516 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 638 op/s 2024-09-11T00:05:52.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:51 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:05:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:51 smithi131 ceph-mon[35491]: pgmap v425: 97 pgs: 97 active+clean; 516 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 638 op/s 2024-09-11T00:05:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:51 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:05:53.107 INFO:tasks.workunit.client.0.smithi019.stdout: 84 8150 13 3358 1 1320 33 2024-09-11T00:05:54.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:53 smithi135 ceph-mon[35432]: pgmap v426: 97 pgs: 97 active+clean; 518 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 493 op/s 2024-09-11T00:05:54.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:53 smithi019 ceph-mon[30859]: pgmap v426: 97 pgs: 97 active+clean; 518 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 493 op/s 2024-09-11T00:05:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:53 smithi131 ceph-mon[35491]: pgmap v426: 97 pgs: 97 active+clean; 518 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 493 op/s 2024-09-11T00:05:55.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:54 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:55.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:54 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:55.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:54 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:05:56.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:55 smithi135 ceph-mon[35432]: pgmap v427: 97 pgs: 97 active+clean; 519 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 359 op/s 2024-09-11T00:05:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:55 smithi019 ceph-mon[30859]: pgmap v427: 97 pgs: 97 active+clean; 519 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 359 op/s 2024-09-11T00:05:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:55 smithi131 ceph-mon[35491]: pgmap v427: 97 pgs: 97 active+clean; 519 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 359 op/s 2024-09-11T00:05:57.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:05:57.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:05:57.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:56 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:57.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:05:57.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:05:57.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:56 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:57.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:05:57.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:05:57.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:56 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:05:58.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:57 smithi135 ceph-mon[35432]: pgmap v428: 97 pgs: 97 active+clean; 519 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 345 op/s 2024-09-11T00:05:58.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:57 smithi019 ceph-mon[30859]: pgmap v428: 97 pgs: 97 active+clean; 519 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 345 op/s 2024-09-11T00:05:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:57 smithi131 ceph-mon[35491]: pgmap v428: 97 pgs: 97 active+clean; 519 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 345 op/s 2024-09-11T00:06:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:05:59 smithi135 ceph-mon[35432]: pgmap v429: 97 pgs: 97 active+clean; 521 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 997 KiB/s wr, 270 op/s 2024-09-11T00:06:00.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:05:59 smithi019 ceph-mon[30859]: pgmap v429: 97 pgs: 97 active+clean; 521 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 997 KiB/s wr, 270 op/s 2024-09-11T00:06:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:05:59 smithi131 ceph-mon[35491]: pgmap v429: 97 pgs: 97 active+clean; 521 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 997 KiB/s wr, 270 op/s 2024-09-11T00:06:02.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:01 smithi135 ceph-mon[35432]: pgmap v430: 97 pgs: 97 active+clean; 525 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1014 KiB/s wr, 209 op/s 2024-09-11T00:06:02.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:01 smithi019 ceph-mon[30859]: pgmap v430: 97 pgs: 97 active+clean; 525 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1014 KiB/s wr, 209 op/s 2024-09-11T00:06:02.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:01 smithi131 ceph-mon[35491]: pgmap v430: 97 pgs: 97 active+clean; 525 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1014 KiB/s wr, 209 op/s 2024-09-11T00:06:03.107 INFO:tasks.workunit.client.0.smithi019.stdout: 84 10593 135 7780 75 8324 360 2024-09-11T00:06:04.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:03 smithi135 ceph-mon[35432]: pgmap v431: 97 pgs: 97 active+clean; 532 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-11T00:06:04.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:03 smithi019 ceph-mon[30859]: pgmap v431: 97 pgs: 97 active+clean; 532 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-11T00:06:04.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:03 smithi131 ceph-mon[35491]: pgmap v431: 97 pgs: 97 active+clean; 532 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-11T00:06:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:05 smithi135 ceph-mon[35432]: pgmap v432: 97 pgs: 97 active+clean; 533 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-11T00:06:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:05 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:06:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:05 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:06:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:05 smithi019 ceph-mon[30859]: pgmap v432: 97 pgs: 97 active+clean; 533 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-11T00:06:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:05 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:06:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:05 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:06:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:05 smithi131 ceph-mon[35491]: pgmap v432: 97 pgs: 97 active+clean; 533 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-11T00:06:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:05 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:06:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:05 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:06:07.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:06 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:06:07.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:06 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:06:07.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:06 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:06:08.138 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:07 smithi135 ceph-mon[35432]: pgmap v433: 97 pgs: 97 active+clean; 539 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 352 op/s 2024-09-11T00:06:08.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:07 smithi019 ceph-mon[30859]: pgmap v433: 97 pgs: 97 active+clean; 539 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 352 op/s 2024-09-11T00:06:08.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:07 smithi131 ceph-mon[35491]: pgmap v433: 97 pgs: 97 active+clean; 539 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 352 op/s 2024-09-11T00:06:10.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:06:10.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:09 smithi135 ceph-mon[35432]: pgmap v434: 97 pgs: 97 active+clean; 539 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 418 op/s 2024-09-11T00:06:10.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:09 smithi019 ceph-mon[30859]: pgmap v434: 97 pgs: 97 active+clean; 539 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 418 op/s 2024-09-11T00:06:10.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:09 smithi131 ceph-mon[35491]: pgmap v434: 97 pgs: 97 active+clean; 539 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 418 op/s 2024-09-11T00:06:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:12.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:11 smithi135 ceph-mon[35432]: pgmap v435: 97 pgs: 97 active+clean; 542 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 415 op/s 2024-09-11T00:06:12.265 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:11 smithi019 ceph-mon[30859]: pgmap v435: 97 pgs: 97 active+clean; 542 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 415 op/s 2024-09-11T00:06:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:11 smithi131 ceph-mon[35491]: pgmap v435: 97 pgs: 97 active+clean; 542 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 415 op/s 2024-09-11T00:06:12.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.698+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1824629173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a38108fd0 msgr2=0x7f7a3810f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:12.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.698+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1824629173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a38108fd0 0x7f7a3810f7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009860 tx=0x7f7a2c02a360 comp rx=0 tx=0).stop 2024-09-11T00:06:12.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.699+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1824629173 shutdown_connections 2024-09-11T00:06:12.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.699+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1824629173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a38108fd0 0x7f7a3810f7b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.699+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1824629173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a38108630 0x7f7a38108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.699+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1824629173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38100c30 0x7f7a38101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.699+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1824629173 >> 172.21.15.19:0/1824629173 conn(0x7f7a380fc8c0 msgr2=0x7f7a380fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.701+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1824629173 shutdown_connections 2024-09-11T00:06:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.703+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1824629173 wait complete. 2024-09-11T00:06:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 Processor -- start 2024-09-11T00:06:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 -- start start 2024-09-11T00:06:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a38100c30 0x7f7a3810f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38108630 0x7f7a3810c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a38108fd0 0x7f7a3810cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38114e10 con 0x7f7a38108630 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38114c90 con 0x7f7a38100c30 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.704+0000 7f7a3dceb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38114f90 con 0x7f7a38108fd0 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38108630 0x7f7a3810c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38108630 0x7f7a3810c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33642/0 (socket says 172.21.15.19:33642) 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 -- 172.21.15.19:0/1374199224 learned_addr learned my addr 172.21.15.19:0/1374199224 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 -- 172.21.15.19:0/1374199224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a38108fd0 msgr2=0x7f7a3810cc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a38108fd0 0x7f7a3810cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 -- 172.21.15.19:0/1374199224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a38100c30 msgr2=0x7f7a3810f4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:06:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a38100c30 0x7f7a3810f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.705+0000 7f7a37fff640 1 -- 172.21.15.19:0/1374199224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3810d4c0 con 0x7f7a38108630 2024-09-11T00:06:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.706+0000 7f7a37fff640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38108630 0x7f7a3810c720 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000ed70 tx=0x7f7a3000c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:12.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.708+0000 7f7a35ffb640 1 -- 172.21.15.19:0/1374199224 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30011470 con 0x7f7a38108630 2024-09-11T00:06:12.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.708+0000 7f7a35ffb640 1 -- 172.21.15.19:0/1374199224 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a30011ac0 con 0x7f7a38108630 2024-09-11T00:06:12.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.708+0000 7f7a35ffb640 1 -- 172.21.15.19:0/1374199224 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3001aa40 con 0x7f7a38108630 2024-09-11T00:06:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.709+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3819a300 con 0x7f7a38108630 2024-09-11T00:06:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.709+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3819a7f0 con 0x7f7a38108630 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.719+0000 7f7a41322740 1 Processor -- start 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a35ffb640 1 -- 172.21.15.19:0/1374199224 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f7a30022030 con 0x7f7a38108630 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a41322740 1 -- start start 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a41322740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae245a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a41322740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245f70 0x5577ae2519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a41322740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae2542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a41322740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5577ae1bbe50 con 0x5577ae251f00 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a41322740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5577ae1ab280 con 0x5577ae245650 2024-09-11T00:06:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.720+0000 7f7a41322740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577ae1af090 con 0x5577ae245f70 2024-09-11T00:06:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.722+0000 7f7a3cce9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245f70 0x5577ae2519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.722+0000 7f7a3cce9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245f70 0x5577ae2519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60340/0 (socket says 172.21.15.19:60340) 2024-09-11T00:06:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.722+0000 7f7a3cce9640 1 -- 172.21.15.19:0/4115415749 learned_addr learned my addr 172.21.15.19:0/4115415749 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.722+0000 7f7a3d4ea640 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae245a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a3d4ea640 1 -- 172.21.15.19:0/4115415749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245f70 msgr2=0x5577ae2519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a37fff640 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae2542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a3d4ea640 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245f70 0x5577ae2519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a3d4ea640 1 -- 172.21.15.19:0/4115415749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 msgr2=0x5577ae2542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a3d4ea640 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae2542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a3d4ea640 1 -- 172.21.15.19:0/4115415749 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577adf09650 con 0x5577ae245650 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245f70 0x5577ae2519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:12.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.726+0000 7f7a37fff640 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae2542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:12.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.727+0000 7f7a35ffb640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7a200b5720 0x7f7a200b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.727+0000 7f7a35ffb640 1 -- 172.21.15.19:0/1374199224 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f7a300e5f60 con 0x7f7a38108630 2024-09-11T00:06:12.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.730+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7a200b5720 0x7f7a200b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.730+0000 7f7a3d4ea640 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae245a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c02a8d0 tx=0x7f7a2c005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5334a28ffc680992 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:12.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.731+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7a200b5720 0x7f7a200b7be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5577ae244360 tx=0x7f7a28009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.731+0000 7f7a1effd640 1 -- 172.21.15.19:0/4115415749 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c037040 con 0x5577ae245650 2024-09-11T00:06:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.731+0000 7f7a1effd640 1 -- 172.21.15.19:0/4115415749 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2c0035f0 con 0x5577ae245650 2024-09-11T00:06:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.732+0000 7f7a41322740 1 -- 172.21.15.19:0/4115415749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 msgr2=0x5577ae245a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.732+0000 7f7a41322740 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae245a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c02a8d0 tx=0x7f7a2c005760 comp rx=0 tx=0).stop 2024-09-11T00:06:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 -- 172.21.15.19:0/4115415749 shutdown_connections 2024-09-11T00:06:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae2542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245f70 0x5577ae2519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 --2- 172.21.15.19:0/4115415749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae245a30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 -- 172.21.15.19:0/4115415749 >> 172.21.15.19:0/4115415749 conn(0x5577ae243480 msgr2=0x5577ae244620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 -- 172.21.15.19:0/4115415749 shutdown_connections 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 -- 172.21.15.19:0/4115415749 wait complete. 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.736+0000 7f7a41322740 1 -- start start 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.737+0000 7f7a41322740 1 Processor -- start 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.737+0000 7f7a41322740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245650 0x5577ae251740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.737+0000 7f7a41322740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae24eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.737+0000 7f7a41322740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae24f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae24eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae24eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:44910/0 (socket says 172.21.15.19:44910) 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a3cce9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245650 0x5577ae251740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a3cce9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245650 0x5577ae251740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60356/0 (socket says 172.21.15.19:60356) 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a41322740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5577ae00c700 con 0x5577ae251f00 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a41322740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5577ae146110 con 0x5577ae245f70 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a41322740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577ae254b70 con 0x5577ae245650 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a41322740 10 client.0 _ll_register_callbacks cb 0x5577ae15f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.738+0000 7f7a37fff640 1 -- 172.21.15.19:0/2156194637 learned_addr learned my addr 172.21.15.19:0/2156194637 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a37fff640 1 -- 172.21.15.19:0/2156194637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245650 msgr2=0x5577ae251740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a37fff640 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245650 0x5577ae251740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a37fff640 1 -- 172.21.15.19:0/2156194637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 msgr2=0x5577ae24f0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a3d4ea640 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae24f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a37fff640 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae24f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a37fff640 1 -- 172.21.15.19:0/2156194637 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577ae173c40 con 0x5577ae245f70 2024-09-11T00:06:12.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a3d4ea640 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae24f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:12.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.739+0000 7f7a37fff640 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae24eb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a300a89d0 tx=0x7f7a300abe80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5440e88891c26dfa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:12.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.740+0000 7f7a17fff640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:06:12.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.740+0000 7f7a17fff640 1 -- 172.21.15.19:0/2156194637 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300acb00 con 0x5577ae245f70 2024-09-11T00:06:12.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.740+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a2c0035f0 con 0x5577ae245f70 2024-09-11T00:06:12.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.740+0000 7f7a17fff640 1 -- 172.21.15.19:0/2156194637 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f7a30011610 con 0x5577ae245f70 2024-09-11T00:06:12.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.740+0000 7f7a17fff640 1 -- 172.21.15.19:0/2156194637 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a300ac400 con 0x5577ae245f70 2024-09-11T00:06:12.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.746+0000 7f7a41322740 10 client.25355 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:12.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.746+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5577ae25d420 con 0x5577ae245f70 2024-09-11T00:06:12.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.750+0000 7f7a17fff640 1 -- 172.21.15.19:0/2156194637 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2c0035f0 con 0x5577ae245f70 2024-09-11T00:06:12.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.750+0000 7f7a17fff640 1 -- 172.21.15.19:0/2156194637 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f7a3000f040 con 0x5577ae245f70 2024-09-11T00:06:12.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.751+0000 7f7a41322740 10 client.25355 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:12.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.751+0000 7f7a41322740 10 client.25355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:12.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.751+0000 7f7a41322740 20 client.25355 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:12.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.751+0000 7f7a41322740 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae25ee70 0x5577ae2612d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.751+0000 7f7a41322740 4 client.25355 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:12.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.751+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577ae1bdda0 con 0x5577ae25ee70 2024-09-11T00:06:12.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.756+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae25ee70 0x5577ae2612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.756+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae25ee70 0x5577ae2612d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64a012c17fe01fe5 server_cookie=8a42bc509da9fa22 in_seq=0 out_seq=0 2024-09-11T00:06:12.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.756+0000 7f7a17fff640 10 client.25355 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:12.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.757+0000 7f7a17fff640 1 -- 172.21.15.19:0/2156194637 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577ae1bdda0 con 0x5577ae25ee70 2024-09-11T00:06:12.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.757+0000 7f7a17fff640 10 client.25355 handle_command_reply: tid=0 2024-09-11T00:06:12.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.757+0000 7f7a41322740 1 client.25355 shutdown 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 msgr2=0x5577ae24eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae24eb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a300a89d0 tx=0x7f7a300abe80 comp rx=0 tx=0).stop 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 shutdown_connections 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae25ee70 0x5577ae2612d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae251f00 0x5577ae24f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae24eb90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 --2- 172.21.15.19:0/2156194637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae245650 0x5577ae251740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 >> 172.21.15.19:0/2156194637 conn(0x5577ae243480 msgr2=0x5577ae248ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:12.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a17fff640 0 client.25355 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:12.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 shutdown_connections 2024-09-11T00:06:12.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 1 -- 172.21.15.19:0/2156194637 wait complete. 2024-09-11T00:06:12.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.759+0000 7f7a41322740 20 client.25355 trim_cache size 0 max 16384 2024-09-11T00:06:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.803+0000 7f7a41322740 1 Processor -- start 2024-09-11T00:06:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.803+0000 7f7a41322740 1 -- start start 2024-09-11T00:06:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.804+0000 7f7a41322740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae242e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.804+0000 7f7a41322740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245f70 0x5577ae24bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.804+0000 7f7a41322740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae24c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.804+0000 7f7a41322740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a24010fe0 con 0x5577ae245f70 2024-09-11T00:06:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.805+0000 7f7a3d4ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae24c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.805+0000 7f7a3d4ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae24c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60364/0 (socket says 172.21.15.19:60364) 2024-09-11T00:06:12.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.805+0000 7f7a3d4ea640 1 -- 172.21.15.19:0/201711366 learned_addr learned my addr 172.21.15.19:0/201711366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:12.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.805+0000 7f7a41322740 1 -- 172.21.15.19:0/201711366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2400e850 con 0x5577ae245650 2024-09-11T00:06:12.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.805+0000 7f7a41322740 1 -- 172.21.15.19:0/201711366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2400c6a0 con 0x5577ae251f00 2024-09-11T00:06:12.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.805+0000 7f7a37fff640 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245f70 0x5577ae24bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.806+0000 7f7a37fff640 1 -- 172.21.15.19:0/201711366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 msgr2=0x5577ae24c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.806+0000 7f7a37fff640 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae24c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.806+0000 7f7a37fff640 1 -- 172.21.15.19:0/201711366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 msgr2=0x5577ae242e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.806+0000 7f7a37fff640 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae242e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.806+0000 7f7a37fff640 1 -- 172.21.15.19:0/201711366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577ae249900 con 0x5577ae245f70 2024-09-11T00:06:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.807+0000 7f7a37fff640 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245f70 0x5577ae24bda0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a300ac100 tx=0x7f7a300abd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46d531939232a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.807+0000 7f7a1e7fc640 1 -- 172.21.15.19:0/201711366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300c6070 con 0x5577ae245f70 2024-09-11T00:06:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.807+0000 7f7a1e7fc640 1 -- 172.21.15.19:0/201711366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a300acb00 con 0x5577ae245f70 2024-09-11T00:06:12.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.808+0000 7f7a41322740 1 -- 172.21.15.19:0/201711366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245f70 msgr2=0x5577ae24bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:12.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.808+0000 7f7a41322740 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245f70 0x5577ae24bda0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a300ac100 tx=0x7f7a300abd50 comp rx=0 tx=0).stop 2024-09-11T00:06:12.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.814+0000 7f7a41322740 1 -- 172.21.15.19:0/201711366 shutdown_connections 2024-09-11T00:06:12.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.814+0000 7f7a41322740 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae24c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.814+0000 7f7a41322740 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245f70 0x5577ae24bda0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.814+0000 7f7a41322740 1 --2- 172.21.15.19:0/201711366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245650 0x5577ae242e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.814+0000 7f7a41322740 1 -- 172.21.15.19:0/201711366 >> 172.21.15.19:0/201711366 conn(0x5577ae243480 msgr2=0x5577ae24d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:12.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.820+0000 7f7a41322740 1 -- 172.21.15.19:0/201711366 shutdown_connections 2024-09-11T00:06:12.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.820+0000 7f7a41322740 1 -- 172.21.15.19:0/201711366 wait complete. 2024-09-11T00:06:12.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.821+0000 7f7a41322740 1 -- start start 2024-09-11T00:06:12.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.821+0000 7f7a41322740 1 Processor -- start 2024-09-11T00:06:12.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.824+0000 7f7a41322740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245650 0x5577ae25aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.824+0000 7f7a41322740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae255f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.824+0000 7f7a41322740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae2564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.824+0000 7f7a41322740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2400cd10 con 0x5577ae245650 2024-09-11T00:06:12.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.824+0000 7f7a41322740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2400e180 con 0x5577ae245f70 2024-09-11T00:06:12.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.824+0000 7f7a41322740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2400d3e0 con 0x5577ae251f00 2024-09-11T00:06:12.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.825+0000 7f7a41322740 10 client.0 _ll_register_callbacks cb 0x7f7a300ac280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.825+0000 7f7a3cce9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245650 0x5577ae25aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.825+0000 7f7a3cce9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245650 0x5577ae25aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33680/0 (socket says 172.21.15.19:33680) 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.825+0000 7f7a3cce9640 1 -- 172.21.15.19:0/4024300790 learned_addr learned my addr 172.21.15.19:0/4024300790 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a3cce9640 1 -- 172.21.15.19:0/4024300790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 msgr2=0x5577ae2564a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae2564a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a3cce9640 1 -- 172.21.15.19:0/4024300790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 msgr2=0x5577ae255f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae255f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a3cce9640 1 -- 172.21.15.19:0/4024300790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577ae256a90 con 0x5577ae245650 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a3cce9640 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245650 0x5577ae25aa90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a28012010 tx=0x7f7a28014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1f1d49d6fec8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a17fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a17fff640 1 -- 172.21.15.19:0/4024300790 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2801f830 con 0x5577ae245650 2024-09-11T00:06:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.826+0000 7f7a17fff640 1 -- 172.21.15.19:0/4024300790 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f7a2801f9d0 con 0x5577ae245650 2024-09-11T00:06:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.827+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a300acb00 con 0x5577ae245650 2024-09-11T00:06:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.828+0000 7f7a17fff640 1 -- 172.21.15.19:0/4024300790 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a2801fbd0 con 0x5577ae245650 2024-09-11T00:06:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.828+0000 7f7a41322740 10 client.15933 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.828+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5577ae2f1040 con 0x5577ae245650 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a17fff640 1 -- 172.21.15.19:0/4024300790 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a300acb00 con 0x5577ae245650 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a17fff640 1 -- 172.21.15.19:0/4024300790 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f7a28028380 con 0x5577ae245650 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a41322740 10 client.15933 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a41322740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a41322740 20 client.15933 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a41322740 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae2f18a0 0x5577ae2f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a41322740 4 client.15933 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:06:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.829+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5577ae1b9850 con 0x5577ae2f18a0 2024-09-11T00:06:12.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.831+0000 7f7a37fff640 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae2f18a0 0x5577ae2f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:12.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.843+0000 7f7a37fff640 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae2f18a0 0x5577ae2f3cc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b361784cbabef273 server_cookie=119e8690b6af2afe in_seq=0 out_seq=0 2024-09-11T00:06:12.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.844+0000 7f7a17fff640 10 client.15933 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.847+0000 7f7a17fff640 1 -- 172.21.15.19:0/4024300790 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x5577ae1b9850 con 0x5577ae2f18a0 2024-09-11T00:06:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.847+0000 7f7a17fff640 10 client.15933 handle_command_reply: tid=0 2024-09-11T00:06:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.847+0000 7f7a41322740 1 client.15933 shutdown 2024-09-11T00:06:12.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.858+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245650 msgr2=0x5577ae25aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:12.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.858+0000 7f7a41322740 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245650 0x5577ae25aa90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a28012010 tx=0x7f7a28014070 comp rx=0 tx=0).stop 2024-09-11T00:06:12.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.865+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 shutdown_connections 2024-09-11T00:06:12.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.865+0000 7f7a41322740 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577ae251f00 0x5577ae2564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.865+0000 7f7a41322740 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577ae245f70 0x5577ae255f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.865+0000 7f7a41322740 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5577ae2f18a0 0x5577ae2f3cc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.865+0000 7f7a41322740 1 --2- 172.21.15.19:0/4024300790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577ae245650 0x5577ae25aa90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.865+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 >> 172.21.15.19:0/4024300790 conn(0x5577ae243480 msgr2=0x5577ae2501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:12.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.865+0000 7f7a17fff640 0 client.15933 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:12.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.869+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 shutdown_connections 2024-09-11T00:06:12.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.873+0000 7f7a41322740 1 -- 172.21.15.19:0/4024300790 wait complete. 2024-09-11T00:06:12.882 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:06:12.882 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:12.883 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:12.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:12.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:06:12.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.874+0000 7f7a41322740 20 client.15933 trim_cache size 0 max 16384 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.878+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7a200b5720 msgr2=0x7f7a200b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.878+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7a200b5720 0x7f7a200b7be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5577ae244360 tx=0x7f7a28009260 comp rx=0 tx=0).stop 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.878+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38108630 msgr2=0x7f7a3810c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.878+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38108630 0x7f7a3810c720 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000ed70 tx=0x7f7a3000c640 comp rx=0 tx=0).stop 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 shutdown_connections 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a38108fd0 0x7f7a3810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7a200b5720 0x7f7a200b7be0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a38108630 0x7f7a3810c720 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 --2- 172.21.15.19:0/1374199224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a38100c30 0x7f7a3810f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 >> 172.21.15.19:0/1374199224 conn(0x7f7a380fc8c0 msgr2=0x7f7a381068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 shutdown_connections 2024-09-11T00:06:12.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:12.879+0000 7f7a3dceb640 1 -- 172.21.15.19:0/1374199224 wait complete. 2024-09-11T00:06:13.115 INFO:tasks.workunit.client.0.smithi019.stdout: 90 989557 420 634234 375 558859 1172 2024-09-11T00:06:13.998 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:06:13.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:06:14.024 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:13 smithi019 ceph-mon[30859]: pgmap v436: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 454 op/s 2024-09-11T00:06:14.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:13 smithi135 ceph-mon[35432]: pgmap v436: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 454 op/s 2024-09-11T00:06:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:13 smithi131 ceph-mon[35491]: pgmap v436: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 454 op/s 2024-09-11T00:06:15.421 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:16.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:15 smithi019 ceph-mon[30859]: pgmap v437: 97 pgs: 97 active+clean; 554 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 453 op/s 2024-09-11T00:06:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:15 smithi135 ceph-mon[35432]: pgmap v437: 97 pgs: 97 active+clean; 554 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 453 op/s 2024-09-11T00:06:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:15 smithi131 ceph-mon[35491]: pgmap v437: 97 pgs: 97 active+clean; 554 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 453 op/s 2024-09-11T00:06:16.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.333+0000 7f8a7d79c640 1 -- 172.21.15.19:0/1766851473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a781111b0 msgr2=0x7f8a781135a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:16.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.333+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/1766851473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a781111b0 0x7f8a781135a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009900 tx=0x7f8a6c02a440 comp rx=0 tx=0).stop 2024-09-11T00:06:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.337+0000 7f8a7d79c640 1 -- 172.21.15.19:0/1766851473 shutdown_connections 2024-09-11T00:06:16.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.337+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/1766851473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a78113ae0 0x7f8a78115ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.337+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/1766851473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a781111b0 0x7f8a781135a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.337+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/1766851473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a7810a3b0 0x7f8a7810a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.337+0000 7f8a7d79c640 1 -- 172.21.15.19:0/1766851473 >> 172.21.15.19:0/1766851473 conn(0x7f8a7806cf20 msgr2=0x7f8a7806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:16.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.343+0000 7f8a7d79c640 1 -- 172.21.15.19:0/1766851473 shutdown_connections 2024-09-11T00:06:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.345+0000 7f8a7d79c640 1 -- 172.21.15.19:0/1766851473 wait complete. 2024-09-11T00:06:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.346+0000 7f8a7d79c640 1 Processor -- start 2024-09-11T00:06:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.351+0000 7f8a7d79c640 1 -- start start 2024-09-11T00:06:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.351+0000 7f8a7d79c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7810a3b0 0x7f8a781a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.351+0000 7f8a7d79c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a78113ae0 0x7f8a781a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.351+0000 7f8a7d79c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a781a7550 0x7f8a781a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.351+0000 7f8a7d79c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78119680 con 0x7f8a7810a3b0 2024-09-11T00:06:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.351+0000 7f8a7d79c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78119500 con 0x7f8a78113ae0 2024-09-11T00:06:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.351+0000 7f8a7d79c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78119800 con 0x7f8a781a7550 2024-09-11T00:06:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.352+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7810a3b0 0x7f8a781a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.352+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7810a3b0 0x7f8a781a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33708/0 (socket says 172.21.15.19:33708) 2024-09-11T00:06:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.352+0000 7f8a77fff640 1 -- 172.21.15.19:0/3554224295 learned_addr learned my addr 172.21.15.19:0/3554224295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.352+0000 7f8a777fe640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a78113ae0 0x7f8a781a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.353+0000 7f8a77fff640 1 -- 172.21.15.19:0/3554224295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a781a7550 msgr2=0x7f8a781a7a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:06:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.353+0000 7f8a77fff640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a781a7550 0x7f8a781a7a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.353+0000 7f8a77fff640 1 -- 172.21.15.19:0/3554224295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a78113ae0 msgr2=0x7f8a781a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.353+0000 7f8a77fff640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a78113ae0 0x7f8a781a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.353+0000 7f8a77fff640 1 -- 172.21.15.19:0/3554224295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a781a7f40 con 0x7f8a7810a3b0 2024-09-11T00:06:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.353+0000 7f8a77fff640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7810a3b0 0x7f8a781a04f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800e9f0 tx=0x7f8a6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.355+0000 7f8a757fa640 1 -- 172.21.15.19:0/3554224295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800cd80 con 0x7f8a7810a3b0 2024-09-11T00:06:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.355+0000 7f8a757fa640 1 -- 172.21.15.19:0/3554224295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a680108e0 con 0x7f8a7810a3b0 2024-09-11T00:06:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.355+0000 7f8a757fa640 1 -- 172.21.15.19:0/3554224295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68018980 con 0x7f8a7810a3b0 2024-09-11T00:06:16.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.356+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a781a8230 con 0x7f8a7810a3b0 2024-09-11T00:06:16.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.356+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a781a86f0 con 0x7f8a7810a3b0 2024-09-11T00:06:16.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.364+0000 7f8a757fa640 1 -- 172.21.15.19:0/3554224295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f8a68010430 con 0x7f8a7810a3b0 2024-09-11T00:06:16.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.364+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a78074ae0 con 0x7f8a7810a3b0 2024-09-11T00:06:16.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.365+0000 7f8a757fa640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a600b5720 0x7f8a600b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:16.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.366+0000 7f8a777fe640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a600b5720 0x7f8a600b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:16.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.366+0000 7f8a757fa640 1 -- 172.21.15.19:0/3554224295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8a680e6560 con 0x7f8a7810a3b0 2024-09-11T00:06:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.375+0000 7f8a777fe640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a600b5720 0x7f8a600b7be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c033040 tx=0x7f8a6c000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.375+0000 7f8a757fa640 1 -- 172.21.15.19:0/3554224295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8a680ad100 con 0x7f8a7810a3b0 2024-09-11T00:06:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:06:16.875 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":30,"btime":"2024-09-11T00:05:40:909781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:05:39.915441+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:06:16.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.871+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a781a89e0 con 0x7f8a7810a3b0 2024-09-11T00:06:16.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.873+0000 7f8a757fa640 1 -- 172.21.15.19:0/3554224295 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11919 (secure 0 0 0) 0x7f8a680aca00 con 0x7f8a7810a3b0 2024-09-11T00:06:16.876 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 30 2024-09-11T00:06:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.877+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a600b5720 msgr2=0x7f8a600b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.877+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a600b5720 0x7f8a600b7be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c033040 tx=0x7f8a6c000bc0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.878+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7810a3b0 msgr2=0x7f8a781a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.878+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7810a3b0 0x7f8a781a04f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800e9f0 tx=0x7f8a6800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 shutdown_connections 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a781a7550 0x7f8a781a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a78113ae0 0x7f8a781a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8a600b5720 0x7f8a600b7be0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 --2- 172.21.15.19:0/3554224295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7810a3b0 0x7f8a781a04f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 >> 172.21.15.19:0/3554224295 conn(0x7f8a7806cf20 msgr2=0x7f8a7811a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 shutdown_connections 2024-09-11T00:06:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:16.894+0000 7f8a7d79c640 1 -- 172.21.15.19:0/3554224295 wait complete. 2024-09-11T00:06:17.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:16 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3554224295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:06:17.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:16 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3554224295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:06:17.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:16 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3554224295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:06:18.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:17 smithi135 ceph-mon[35432]: pgmap v438: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 566 op/s 2024-09-11T00:06:18.177 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:17 smithi019 ceph-mon[30859]: pgmap v438: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 566 op/s 2024-09-11T00:06:18.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:06:18.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:17 smithi131 ceph-mon[35491]: pgmap v438: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 566 op/s 2024-09-11T00:06:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.161+0000 7f8d411c5640 1 -- 172.21.15.19:0/1570958820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 msgr2=0x7f8d3c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.161+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1570958820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 0x7f8d3c10cab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d3002a410 comp rx=0 tx=0).stop 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.162+0000 7f8d411c5640 1 -- 172.21.15.19:0/1570958820 shutdown_connections 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.162+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1570958820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d3c10d100 0x7f8d3c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.162+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1570958820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 0x7f8d3c10cab0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.162+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1570958820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d3c103ca0 0x7f8d3c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.162+0000 7f8d411c5640 1 -- 172.21.15.19:0/1570958820 >> 172.21.15.19:0/1570958820 conn(0x7f8d3c0fd700 msgr2=0x7f8d3c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.162+0000 7f8d411c5640 1 -- 172.21.15.19:0/1570958820 shutdown_connections 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.162+0000 7f8d411c5640 1 -- 172.21.15.19:0/1570958820 wait complete. 2024-09-11T00:06:19.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.163+0000 7f8d411c5640 1 Processor -- start 2024-09-11T00:06:19.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.164+0000 7f8d411c5640 1 -- start start 2024-09-11T00:06:19.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.164+0000 7f8d411c5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d3c103ca0 0x7f8d3c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.164+0000 7f8d411c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 0x7f8d3c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.164+0000 7f8d411c5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d3c10d100 0x7f8d3c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 0x7f8d3c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d3c10d100 0x7f8d3c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d411c5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c112d70 con 0x7f8d3c1045c0 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d3c103ca0 0x7f8d3c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d411c5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c112bf0 con 0x7f8d3c10d100 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d3c10d100 0x7f8d3c19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:44962/0 (socket says 172.21.15.19:44962) 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 0x7f8d3c1997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33730/0 (socket says 172.21.15.19:33730) 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d411c5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c112ef0 con 0x7f8d3c103ca0 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3b59e640 1 -- 172.21.15.19:0/1257617733 learned_addr learned my addr 172.21.15.19:0/1257617733 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3ad9d640 1 -- 172.21.15.19:0/1257617733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d3c10d100 msgr2=0x7f8d3c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3ad9d640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d3c10d100 0x7f8d3c19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3ad9d640 1 -- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 msgr2=0x7f8d3c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3ad9d640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 0x7f8d3c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.165+0000 7f8d3ad9d640 1 -- 172.21.15.19:0/1257617733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c19f350 con 0x7f8d3c103ca0 2024-09-11T00:06:19.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.166+0000 7f8d3ad9d640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d3c103ca0 0x7f8d3c1992a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00e9f0 tx=0x7f8d2c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:19.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.166+0000 7f8d23fff640 1 -- 172.21.15.19:0/1257617733 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00ccc0 con 0x7f8d3c103ca0 2024-09-11T00:06:19.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.166+0000 7f8d23fff640 1 -- 172.21.15.19:0/1257617733 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d2c0108e0 con 0x7f8d3c103ca0 2024-09-11T00:06:19.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.166+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c19f640 con 0x7f8d3c103ca0 2024-09-11T00:06:19.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.166+0000 7f8d23fff640 1 -- 172.21.15.19:0/1257617733 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c018880 con 0x7f8d3c103ca0 2024-09-11T00:06:19.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.166+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c101830 con 0x7f8d3c103ca0 2024-09-11T00:06:19.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.169+0000 7f8d4359a740 1 Processor -- start 2024-09-11T00:06:19.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.169+0000 7f8d4359a740 1 -- start start 2024-09-11T00:06:19.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce250f0 0x55aebce254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce31460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce33d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d4359a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aebcd9bea0 con 0x55aebce319a0 2024-09-11T00:06:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d4359a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55aebcd8b2d0 con 0x55aebce250f0 2024-09-11T00:06:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d4359a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aebcd8f0e0 con 0x55aebce25a10 2024-09-11T00:06:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce250f0 0x55aebce254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce33d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce250f0 0x55aebce254d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:44976/0 (socket says 172.21.15.19:44976) 2024-09-11T00:06:19.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce33d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33738/0 (socket says 172.21.15.19:33738) 2024-09-11T00:06:19.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 -- 172.21.15.19:0/3808495108 learned_addr learned my addr 172.21.15.19:0/3808495108 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:19.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d23fff640 1 -- 172.21.15.19:0/1257617733 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f8d2c010430 con 0x7f8d3c103ca0 2024-09-11T00:06:19.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3ad9d640 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce31460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 -- 172.21.15.19:0/3808495108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 msgr2=0x55aebce31460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce31460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 -- 172.21.15.19:0/3808495108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 msgr2=0x55aebce33d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce33d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3b59e640 1 -- 172.21.15.19:0/3808495108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebcae9650 con 0x55aebce250f0 2024-09-11T00:06:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.170+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce33d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.171+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce250f0 0x55aebce254d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d34010810 tx=0x7f8d34009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7bece8320fef20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.171+0000 7f8d217fa640 1 -- 172.21.15.19:0/3808495108 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3401e070 con 0x55aebce250f0 2024-09-11T00:06:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.171+0000 7f8d217fa640 1 -- 172.21.15.19:0/3808495108 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d34010e50 con 0x55aebce250f0 2024-09-11T00:06:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.171+0000 7f8d217fa640 1 -- 172.21.15.19:0/3808495108 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34005570 con 0x55aebce250f0 2024-09-11T00:06:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d23fff640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8d240b54d0 0x7f8d240b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d23fff640 1 -- 172.21.15.19:0/1257617733 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8d2c0e62e0 con 0x7f8d3c103ca0 2024-09-11T00:06:19.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d3ad9d640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8d240b54d0 0x7f8d240b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d4359a740 1 -- 172.21.15.19:0/3808495108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce250f0 msgr2=0x55aebce254d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d4359a740 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce250f0 0x55aebce254d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d34010810 tx=0x7f8d34009500 comp rx=0 tx=0).stop 2024-09-11T00:06:19.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d4359a740 1 -- 172.21.15.19:0/3808495108 shutdown_connections 2024-09-11T00:06:19.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d4359a740 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce33d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d4359a740 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce31460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d4359a740 1 --2- 172.21.15.19:0/3808495108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce250f0 0x55aebce254d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.172+0000 7f8d4359a740 1 -- 172.21.15.19:0/3808495108 >> 172.21.15.19:0/3808495108 conn(0x55aebce22f20 msgr2=0x55aebce240c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.173+0000 7f8d4359a740 1 -- 172.21.15.19:0/3808495108 shutdown_connections 2024-09-11T00:06:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.173+0000 7f8d3ad9d640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8d240b54d0 0x7f8d240b7990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55aebce23e00 tx=0x7f8d2c00ce60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.173+0000 7f8d4359a740 1 -- 172.21.15.19:0/3808495108 wait complete. 2024-09-11T00:06:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.173+0000 7f8d4359a740 1 -- start start 2024-09-11T00:06:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.173+0000 7f8d4359a740 1 Processor -- start 2024-09-11T00:06:19.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce31200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce319a0 0x55aebce2ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d4359a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55aebcbec700 con 0x55aebce250f0 2024-09-11T00:06:19.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d4359a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55aebcd26160 con 0x55aebce25a10 2024-09-11T00:06:19.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d4359a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aebce34620 con 0x55aebce319a0 2024-09-11T00:06:19.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce31200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce31200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33740/0 (socket says 172.21.15.19:33740) 2024-09-11T00:06:19.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d3b59e640 1 -- 172.21.15.19:0/1390146116 learned_addr learned my addr 172.21.15.19:0/1390146116 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:19.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d4359a740 10 client.0 _ll_register_callbacks cb 0x55aebcd3f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:19.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.174+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce319a0 0x55aebce2ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d3a59c640 1 -- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce319a0 msgr2=0x55aebce2ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce319a0 0x55aebce2ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d3a59c640 1 -- 172.21.15.19:0/1390146116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 msgr2=0x55aebce31200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce31200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d3a59c640 1 -- 172.21.15.19:0/1390146116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebcd53c90 con 0x55aebce25a10 2024-09-11T00:06:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2e650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d30006010 tx=0x7f8d30032e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb26bb5f0b172755 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:06:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d1eff5640 1 -- 172.21.15.19:0/1390146116 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30035040 con 0x55aebce25a10 2024-09-11T00:06:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d34010e50 con 0x55aebce25a10 2024-09-11T00:06:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.175+0000 7f8d1eff5640 1 -- 172.21.15.19:0/1390146116 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8d300316a0 con 0x55aebce25a10 2024-09-11T00:06:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d1eff5640 1 -- 172.21.15.19:0/1390146116 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d300318a0 con 0x55aebce25a10 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 10 client.25373 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aebce3ff20 con 0x55aebce25a10 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d1eff5640 1 -- 172.21.15.19:0/1390146116 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d34010e50 con 0x55aebce25a10 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d1eff5640 1 -- 172.21.15.19:0/1390146116 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f8d30004750 con 0x55aebce25a10 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 10 client.25373 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 10 client.25373 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 20 client.25373 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebce43b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 4 client.25373 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.176+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aebcd9ddf0 con 0x55aebce41720 2024-09-11T00:06:19.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.177+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebce43b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.177+0000 7f8d1eff5640 10 client.25373 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:06:19.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.177+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebce43b80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=57ea555a536b5c70 server_cookie=26e6f82b6fc2aa47 in_seq=0 out_seq=0 2024-09-11T00:06:19.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d1eff5640 1 -- 172.21.15.19:0/1390146116 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aebcd9ddf0 con 0x55aebce41720 2024-09-11T00:06:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d1eff5640 10 client.25373 handle_command_reply: tid=0 2024-09-11T00:06:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 client.25373 shutdown 2024-09-11T00:06:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 msgr2=0x55aebce2e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2e650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d30006010 tx=0x7f8d30032e20 comp rx=0 tx=0).stop 2024-09-11T00:06:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 shutdown_connections 2024-09-11T00:06:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebce43b80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce319a0 0x55aebce2ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d1eff5640 0 client.25373 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:06:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2e650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1390146116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce31200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 >> 172.21.15.19:0/1390146116 conn(0x55aebce22f20 msgr2=0x55aebce28a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:19.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 shutdown_connections 2024-09-11T00:06:19.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.180+0000 7f8d4359a740 1 -- 172.21.15.19:0/1390146116 wait complete. 2024-09-11T00:06:19.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.181+0000 7f8d4359a740 20 client.25373 trim_cache size 0 max 16384 2024-09-11T00:06:19.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 Processor -- start 2024-09-11T00:06:19.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 -- start start 2024-09-11T00:06:19.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce250f0 0x55aebce3d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce2d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1aecd0 con 0x55aebce319a0 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1ac540 con 0x55aebce25a10 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.194+0000 7f8d4359a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1aa3b0 con 0x55aebce250f0 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce2d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce2d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33754/0 (socket says 172.21.15.19:33754) 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 -- 172.21.15.19:0/1168819951 learned_addr learned my addr 172.21.15.19:0/1168819951 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce250f0 0x55aebce3d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 -- 172.21.15.19:0/1168819951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce250f0 msgr2=0x55aebce3d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce250f0 0x55aebce3d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 -- 172.21.15.19:0/1168819951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 msgr2=0x55aebce2ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 -- 172.21.15.19:0/1168819951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebce25840 con 0x55aebce319a0 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce2d410 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009a80 tx=0x7f8d34029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fbd4aaf0a109a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.195+0000 7f8d20ff9640 1 -- 172.21.15.19:0/1168819951 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3401e040 con 0x55aebce319a0 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d20ff9640 1 -- 172.21.15.19:0/1168819951 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d34036020 con 0x55aebce319a0 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d20ff9640 1 -- 172.21.15.19:0/1168819951 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340254e0 con 0x55aebce319a0 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 -- 172.21.15.19:0/1168819951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 msgr2=0x55aebce2d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce2d410 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009a80 tx=0x7f8d34029040 comp rx=0 tx=0).stop 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 -- 172.21.15.19:0/1168819951 shutdown_connections 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce319a0 0x55aebce2d410 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce25a10 0x55aebce2ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 --2- 172.21.15.19:0/1168819951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce250f0 0x55aebce3d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 -- 172.21.15.19:0/1168819951 >> 172.21.15.19:0/1168819951 conn(0x55aebce22f20 msgr2=0x55aebce29890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 -- 172.21.15.19:0/1168819951 shutdown_connections 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.196+0000 7f8d4359a740 1 -- 172.21.15.19:0/1168819951 wait complete. 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 -- start start 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 Processor -- start 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce398c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce39e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce319a0 0x55aebce34870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1aaa00 con 0x55aebce250f0 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1abe70 con 0x55aebce319a0 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1ab0d0 con 0x55aebce25a10 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d4359a740 10 client.0 _ll_register_callbacks cb 0x7f8d30032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.197+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33768/0 (socket says 172.21.15.19:33768) 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3b59e640 1 -- 172.21.15.19:0/326690912 learned_addr learned my addr 172.21.15.19:0/326690912 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce39e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce319a0 0x55aebce34870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3a59c640 1 -- 172.21.15.19:0/326690912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce319a0 msgr2=0x55aebce34870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce319a0 0x55aebce34870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3a59c640 1 -- 172.21.15.19:0/326690912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 msgr2=0x55aebce398c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce398c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3a59c640 1 -- 172.21.15.19:0/326690912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebce3a570 con 0x55aebce25a10 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d3a59c640 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce39e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d30004c60 tx=0x7f8d300048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a31c345294f00bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d1eff5640 1 -- 172.21.15.19:0/326690912 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30035070 con 0x55aebce25a10 2024-09-11T00:06:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d34036020 con 0x55aebce25a10 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.198+0000 7f8d1eff5640 1 -- 172.21.15.19:0/326690912 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8d30004240 con 0x55aebce25a10 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d1eff5640 1 -- 172.21.15.19:0/326690912 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d30060050 con 0x55aebce25a10 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 10 client.25579 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aebceaebc0 con 0x55aebce25a10 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d1eff5640 1 -- 172.21.15.19:0/326690912 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d34036020 con 0x55aebce25a10 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d1eff5640 1 -- 172.21.15.19:0/326690912 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f8d30003680 con 0x55aebce25a10 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 10 client.25579 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 10 client.25579 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 20 client.25579 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebceb1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 4 client.25579 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aebcd998a0 con 0x55aebce41720 2024-09-11T00:06:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.199+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebceb1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.200+0000 7f8d3b59e640 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebceb1460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba9af0f33a190d7d server_cookie=43f0261f06ee2e3f in_seq=0 out_seq=0 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.200+0000 7f8d1eff5640 10 client.25579 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d1eff5640 1 -- 172.21.15.19:0/326690912 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aebcd998a0 con 0x55aebce41720 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d1eff5640 10 client.25579 handle_command_reply: tid=0 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 client.25579 shutdown 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 msgr2=0x55aebce39e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce39e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d30004c60 tx=0x7f8d300048f0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 shutdown_connections 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55aebce41720 0x55aebceb1460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aebce319a0 0x55aebce34870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebce25a10 0x55aebce39e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 --2- 172.21.15.19:0/326690912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55aebce250f0 0x55aebce398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.201+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 >> 172.21.15.19:0/326690912 conn(0x55aebce22f20 msgr2=0x55aebce2ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d1eff5640 0 client.25579 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:06:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 shutdown_connections 2024-09-11T00:06:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d4359a740 1 -- 172.21.15.19:0/326690912 wait complete. 2024-09-11T00:06:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d4359a740 20 client.25579 trim_cache size 0 max 16384 2024-09-11T00:06:19.210 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8d240b54d0 msgr2=0x7f8d240b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8d240b54d0 0x7f8d240b7990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55aebce23e00 tx=0x7f8d2c00ce60 comp rx=0 tx=0).stop 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d3c103ca0 msgr2=0x7f8d3c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d3c103ca0 0x7f8d3c1992a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00e9f0 tx=0x7f8d2c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 shutdown_connections 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d3c10d100 0x7f8d3c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8d240b54d0 0x7f8d240b7990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d3c1045c0 0x7f8d3c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.202+0000 7f8d411c5640 1 --2- 172.21.15.19:0/1257617733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d3c103ca0 0x7f8d3c1992a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.203+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 >> 172.21.15.19:0/1257617733 conn(0x7f8d3c0fd700 msgr2=0x7f8d3c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.203+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 shutdown_connections 2024-09-11T00:06:19.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:19.203+0000 7f8d411c5640 1 -- 172.21.15.19:0/1257617733 wait complete. 2024-09-11T00:06:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:19 smithi019 ceph-mon[30859]: pgmap v439: 97 pgs: 97 active+clean; 578 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 528 op/s 2024-09-11T00:06:20.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:19 smithi131 ceph-mon[35491]: pgmap v439: 97 pgs: 97 active+clean; 578 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 528 op/s 2024-09-11T00:06:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:19 smithi135 ceph-mon[35432]: pgmap v439: 97 pgs: 97 active+clean; 578 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 528 op/s 2024-09-11T00:06:20.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:06:21.727 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:22.201 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:21 smithi019 ceph-mon[30859]: pgmap v440: 97 pgs: 97 active+clean; 596 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 620 op/s 2024-09-11T00:06:22.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:21 smithi131 ceph-mon[35491]: pgmap v440: 97 pgs: 97 active+clean; 596 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 620 op/s 2024-09-11T00:06:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:21 smithi135 ceph-mon[35432]: pgmap v440: 97 pgs: 97 active+clean; 596 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 620 op/s 2024-09-11T00:06:22.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.749+0000 7f06c5082640 1 -- 172.21.15.19:0/2957612811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 msgr2=0x7f06c01159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.749+0000 7f06c5082640 1 --2- 172.21.15.19:0/2957612811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 0x7f06c01159e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009ca0 tx=0x7f06b802a8f0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.755+0000 7f06c5082640 1 -- 172.21.15.19:0/2957612811 shutdown_connections 2024-09-11T00:06:22.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.755+0000 7f06c5082640 1 --2- 172.21.15.19:0/2957612811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 0x7f06c01159e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.755+0000 7f06c5082640 1 --2- 172.21.15.19:0/2957612811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101b50 0x7f06c0112f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.755+0000 7f06c5082640 1 --2- 172.21.15.19:0/2957612811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c0101230 0x7f06c0101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.755+0000 7f06c5082640 1 -- 172.21.15.19:0/2957612811 >> 172.21.15.19:0/2957612811 conn(0x7f06c00fd2f0 msgr2=0x7f06c00ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:22.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.756+0000 7f06c5082640 1 -- 172.21.15.19:0/2957612811 shutdown_connections 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.758+0000 7f06c5082640 1 -- 172.21.15.19:0/2957612811 wait complete. 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.759+0000 7f06c5082640 1 Processor -- start 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.759+0000 7f06c5082640 1 -- start start 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.760+0000 7f06c5082640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101230 0x7f06c00746e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.760+0000 7f06c5082640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c0101b50 0x7f06c0074c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.760+0000 7f06c5082640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 0x7f06c006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.760+0000 7f06c5082640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01191d0 con 0x7f06c0113590 2024-09-11T00:06:22.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.760+0000 7f06c5082640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0119050 con 0x7f06c0101230 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.760+0000 7f06c5082640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0119350 con 0x7f06c0101b50 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101230 0x7f06c00746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101230 0x7f06c00746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:41868/0 (socket says 172.21.15.19:41868) 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 -- 172.21.15.19:0/1979850037 learned_addr learned my addr 172.21.15.19:0/1979850037 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c0101b50 0x7f06c0074c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06c4881640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 0x7f06c006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 -- 172.21.15.19:0/1979850037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c0101b50 msgr2=0x7f06c0074c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c0101b50 0x7f06c0074c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 -- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 msgr2=0x7f06c006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 0x7f06c006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.761+0000 7f06bffff640 1 -- 172.21.15.19:0/1979850037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c006e270 con 0x7f06c0101230 2024-09-11T00:06:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.763+0000 7f06bffff640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101230 0x7f06c00746e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d950 tx=0x7f06b000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:22.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.764+0000 7f06bd7fa640 1 -- 172.21.15.19:0/1979850037 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0017070 con 0x7f06c0101230 2024-09-11T00:06:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.764+0000 7f06bd7fa640 1 -- 172.21.15.19:0/1979850037 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b0009c30 con 0x7f06c0101230 2024-09-11T00:06:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.764+0000 7f06bd7fa640 1 -- 172.21.15.19:0/1979850037 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b000f620 con 0x7f06c0101230 2024-09-11T00:06:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.764+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c006e560 con 0x7f06c0101230 2024-09-11T00:06:22.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.764+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c0073520 con 0x7f06c0101230 2024-09-11T00:06:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.773+0000 7f06c86b9740 1 Processor -- start 2024-09-11T00:06:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06c86b9740 1 -- start start 2024-09-11T00:06:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa76a0 0x562677aa7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 0x562677ab3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677ab3f50 0x562677ab6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06c86b9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562677a1dea0 con 0x562677ab3f50 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06c86b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562677a0d2d0 con 0x562677aa76a0 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06c86b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562677a110e0 con 0x562677aa7fc0 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.774+0000 7f06bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677ab3f50 0x562677ab6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677ab3f50 0x562677ab6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54500/0 (socket says 172.21.15.19:54500) 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06bf7fe640 1 -- 172.21.15.19:0/309921971 learned_addr learned my addr 172.21.15.19:0/309921971 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06c4881640 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa76a0 0x562677aa7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06bf7fe640 1 -- 172.21.15.19:0/309921971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 msgr2=0x562677ab3a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:22.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 0x562677ab3a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06bf7fe640 1 -- 172.21.15.19:0/309921971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa76a0 msgr2=0x562677aa7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:22.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa76a0 0x562677aa7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.775+0000 7f06bf7fe640 1 -- 172.21.15.19:0/309921971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267776b650 con 0x562677ab3f50 2024-09-11T00:06:22.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.776+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677ab3f50 0x562677ab6340 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f06b400ab90 tx=0x7f06b400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc526741daac1190 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:22.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.780+0000 7f06a67fc640 1 -- 172.21.15.19:0/309921971 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4004220 con 0x562677ab3f50 2024-09-11T00:06:22.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.780+0000 7f06a67fc640 1 -- 172.21.15.19:0/309921971 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b40043c0 con 0x562677ab3f50 2024-09-11T00:06:22.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.781+0000 7f06c86b9740 1 -- 172.21.15.19:0/309921971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677ab3f50 msgr2=0x562677ab6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.781+0000 7f06c86b9740 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677ab3f50 0x562677ab6340 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f06b400ab90 tx=0x7f06b400f790 comp rx=0 tx=0).stop 2024-09-11T00:06:22.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.783+0000 7f06bd7fa640 1 -- 172.21.15.19:0/1979850037 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f06b0010460 con 0x7f06c0101230 2024-09-11T00:06:22.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.784+0000 7f06bd7fa640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06a80b5720 0x7f06a80b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.784+0000 7f06bd7fa640 1 -- 172.21.15.19:0/1979850037 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f06b00e5a40 con 0x7f06c0101230 2024-09-11T00:06:22.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.787+0000 7f06c4881640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06a80b5720 0x7f06a80b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.788+0000 7f06c86b9740 1 -- 172.21.15.19:0/309921971 shutdown_connections 2024-09-11T00:06:22.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.788+0000 7f06c86b9740 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677ab3f50 0x562677ab6340 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.788+0000 7f06c86b9740 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 0x562677ab3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.788+0000 7f06c86b9740 1 --2- 172.21.15.19:0/309921971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa76a0 0x562677aa7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.788+0000 7f06c86b9740 1 -- 172.21.15.19:0/309921971 >> 172.21.15.19:0/309921971 conn(0x562677aa54d0 msgr2=0x562677aa6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:22.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.788+0000 7f06c4881640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06a80b5720 0x7f06a80b7be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f06b8006010 tx=0x7f06b8009780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.795+0000 7f06c86b9740 1 -- 172.21.15.19:0/309921971 shutdown_connections 2024-09-11T00:06:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.798+0000 7f06c86b9740 1 -- 172.21.15.19:0/309921971 wait complete. 2024-09-11T00:06:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.798+0000 7f06c86b9740 1 -- start start 2024-09-11T00:06:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.799+0000 7f06c86b9740 1 Processor -- start 2024-09-11T00:06:22.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.800+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677ab3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.800+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 0x562677ab0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.800+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677ab3f50 0x562677ab10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.800+0000 7f06c86b9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56267786e700 con 0x562677aa76a0 2024-09-11T00:06:22.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.800+0000 7f06c86b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5626779a8160 con 0x562677ab3f50 2024-09-11T00:06:22.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.800+0000 7f06c86b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562677ab6c70 con 0x562677aa7fc0 2024-09-11T00:06:22.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.800+0000 7f06c86b9740 10 client.0 _ll_register_callbacks cb 0x5626779c19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:22.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677ab3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677ab3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54510/0 (socket says 172.21.15.19:54510) 2024-09-11T00:06:22.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 -- 172.21.15.19:0/4240739331 learned_addr learned my addr 172.21.15.19:0/4240739331 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:22.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 -- 172.21.15.19:0/4240739331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 msgr2=0x562677ab0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:22.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 0x562677ab0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 -- 172.21.15.19:0/4240739331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677ab3f50 msgr2=0x562677ab10f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:06:22.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677ab3f50 0x562677ab10f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.801+0000 7f06bffff640 1 -- 172.21.15.19:0/4240739331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626779d5c90 con 0x562677aa76a0 2024-09-11T00:06:22.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.802+0000 7f06bffff640 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677ab3760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f06b00abc90 tx=0x7f06b00abe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d312c81ba12578 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:22.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.802+0000 7f069f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:06:22.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.803+0000 7f069f7fe640 1 -- 172.21.15.19:0/4240739331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0020040 con 0x562677aa76a0 2024-09-11T00:06:22.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.803+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06b40043c0 con 0x562677aa76a0 2024-09-11T00:06:22.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.803+0000 7f069f7fe640 1 -- 172.21.15.19:0/4240739331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f06b00971b0 con 0x562677aa76a0 2024-09-11T00:06:22.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.803+0000 7f069f7fe640 1 -- 172.21.15.19:0/4240739331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f06b0009de0 con 0x562677aa76a0 2024-09-11T00:06:22.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.806+0000 7f06c86b9740 10 client.15966 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:22.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.806+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562677ac2590 con 0x562677aa76a0 2024-09-11T00:06:22.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.809+0000 7f069f7fe640 1 -- 172.21.15.19:0/4240739331 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b40043c0 con 0x562677aa76a0 2024-09-11T00:06:22.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.809+0000 7f069f7fe640 1 -- 172.21.15.19:0/4240739331 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f06b00a7920 con 0x562677aa76a0 2024-09-11T00:06:22.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.811+0000 7f06c86b9740 10 client.15966 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:22.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.811+0000 7f06c86b9740 10 client.15966 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:06:22.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.811+0000 7f06c86b9740 20 client.15966 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:22.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.811+0000 7f06c86b9740 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677ac3a50 0x562677ac5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.811+0000 7f06c86b9740 4 client.15966 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:22.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.811+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562677a1fdf0 con 0x562677ac3a50 2024-09-11T00:06:22.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.812+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677ac3a50 0x562677ac5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.824+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677ac3a50 0x562677ac5ec0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1fa48d54d9e3bbae server_cookie=71f473e687fa3143 in_seq=0 out_seq=0 2024-09-11T00:06:22.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.826+0000 7f069f7fe640 10 client.15966 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:06:22.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.826+0000 7f069f7fe640 1 -- 172.21.15.19:0/4240739331 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562677a1fdf0 con 0x562677ac3a50 2024-09-11T00:06:22.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.826+0000 7f069f7fe640 10 client.15966 handle_command_reply: tid=0 2024-09-11T00:06:22.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.826+0000 7f06c86b9740 1 client.15966 shutdown 2024-09-11T00:06:22.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.834+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 msgr2=0x562677ab3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.834+0000 7f06c86b9740 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677ab3760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f06b00abc90 tx=0x7f06b00abe60 comp rx=0 tx=0).stop 2024-09-11T00:06:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.835+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 shutdown_connections 2024-09-11T00:06:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.835+0000 7f06c86b9740 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677ac3a50 0x562677ac5ec0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.835+0000 7f06c86b9740 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677ab3f50 0x562677ab10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.835+0000 7f06c86b9740 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677aa7fc0 0x562677ab0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.835+0000 7f06c86b9740 1 --2- 172.21.15.19:0/4240739331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677ab3760 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.835+0000 7f069f7fe640 0 client.15966 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:06:22.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.835+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 >> 172.21.15.19:0/4240739331 conn(0x562677aa54d0 msgr2=0x562677aab070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.836+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 shutdown_connections 2024-09-11T00:06:22.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.837+0000 7f06c86b9740 1 -- 172.21.15.19:0/4240739331 wait complete. 2024-09-11T00:06:22.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.838+0000 7f06c86b9740 20 client.15966 trim_cache size 0 max 16384 2024-09-11T00:06:22.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.875+0000 7f06c86b9740 1 Processor -- start 2024-09-11T00:06:22.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.878+0000 7f06c86b9740 1 -- start start 2024-09-11T00:06:22.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.879+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677aa6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.879+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 0x562677aa4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.879+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677aadde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.879+0000 7f06c86b9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01bfa30 con 0x562677aa76a0 2024-09-11T00:06:22.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.879+0000 7f06c86b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01bd2a0 con 0x562677aa7fc0 2024-09-11T00:06:22.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.880+0000 7f06c4881640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677aadde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.880+0000 7f06c4881640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677aadde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39744/0 (socket says 172.21.15.19:39744) 2024-09-11T00:06:22.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.880+0000 7f06c4881640 1 -- 172.21.15.19:0/1074948898 learned_addr learned my addr 172.21.15.19:0/1074948898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:22.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.880+0000 7f06c86b9740 1 -- 172.21.15.19:0/1074948898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01bb0f0 con 0x562677ab3f50 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.880+0000 7f06bffff640 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677aa6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.880+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 0x562677aa4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.881+0000 7f06bffff640 1 -- 172.21.15.19:0/1074948898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 msgr2=0x562677aadde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.881+0000 7f06bffff640 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677aadde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.881+0000 7f06bffff640 1 -- 172.21.15.19:0/1074948898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 msgr2=0x562677aa4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.881+0000 7f06bffff640 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 0x562677aa4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.881+0000 7f06bffff640 1 -- 172.21.15.19:0/1074948898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562677aa5f50 con 0x562677aa76a0 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.882+0000 7f06bffff640 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677aa6520 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f06b00058c0 tx=0x7f06b0010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea584312e811017 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.883+0000 7f06a5ffb640 1 -- 172.21.15.19:0/1074948898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0020070 con 0x562677aa76a0 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.883+0000 7f06a5ffb640 1 -- 172.21.15.19:0/1074948898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b0014070 con 0x562677aa76a0 2024-09-11T00:06:22.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.883+0000 7f06a5ffb640 1 -- 172.21.15.19:0/1074948898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b00aad00 con 0x562677aa76a0 2024-09-11T00:06:22.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.884+0000 7f06c86b9740 1 -- 172.21.15.19:0/1074948898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 msgr2=0x562677aa6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.885+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677aa6520 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f06b00058c0 tx=0x7f06b0010c40 comp rx=0 tx=0).stop 2024-09-11T00:06:22.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.886+0000 7f06c86b9740 1 -- 172.21.15.19:0/1074948898 shutdown_connections 2024-09-11T00:06:22.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.886+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677aadde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.886+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 0x562677aa4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.886+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1074948898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677aa6520 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.886+0000 7f06c86b9740 1 -- 172.21.15.19:0/1074948898 >> 172.21.15.19:0/1074948898 conn(0x562677aa54d0 msgr2=0x562677aa3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:22.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.890+0000 7f06c86b9740 1 -- 172.21.15.19:0/1074948898 shutdown_connections 2024-09-11T00:06:22.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.890+0000 7f06c86b9740 1 -- 172.21.15.19:0/1074948898 wait complete. 2024-09-11T00:06:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.891+0000 7f06c86b9740 1 -- start start 2024-09-11T00:06:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.891+0000 7f06c86b9740 1 Processor -- start 2024-09-11T00:06:22.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.892+0000 7f06c86b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677abc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.892+0000 7f06bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677abc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.892+0000 7f06bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677abc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54536/0 (socket says 172.21.15.19:54536) 2024-09-11T00:06:22.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.893+0000 7f06bffff640 1 -- 172.21.15.19:0/1274782202 learned_addr learned my addr 172.21.15.19:0/1274782202 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:22.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.893+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 0x562677abc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.893+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677ab90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.893+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01bb760 con 0x562677aa76a0 2024-09-11T00:06:22.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.893+0000 7f06c4881640 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677ab90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.893+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01bcbd0 con 0x562677aa7fc0 2024-09-11T00:06:22.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.893+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01bbe30 con 0x562677ab3f50 2024-09-11T00:06:22.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.895+0000 7f06bffff640 1 -- 172.21.15.19:0/1274782202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 msgr2=0x562677ab90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:22.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.895+0000 7f06bffff640 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677ab90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.895+0000 7f06bffff640 1 -- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 msgr2=0x562677abc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:22.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.895+0000 7f06bffff640 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 0x562677abc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.895+0000 7f06bffff640 1 -- 172.21.15.19:0/1274782202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562677ab98e0 con 0x562677aa76a0 2024-09-11T00:06:22.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.895+0000 7f06bffff640 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677abc350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f06b0005c40 tx=0x7f06b00aaee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa1d425d4581d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:22.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.896+0000 7f06c86b9740 10 client.0 _ll_register_callbacks cb 0x7f06b000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:22.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.896+0000 7f069f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:06:22.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.896+0000 7f069f7fe640 1 -- 172.21.15.19:0/1274782202 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b00c5030 con 0x562677aa76a0 2024-09-11T00:06:22.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.896+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06b0014070 con 0x562677aa76a0 2024-09-11T00:06:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.898+0000 7f069f7fe640 1 -- 172.21.15.19:0/1274782202 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f06b00ab1f0 con 0x562677aa76a0 2024-09-11T00:06:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.898+0000 7f069f7fe640 1 -- 172.21.15.19:0/1274782202 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f06b0020070 con 0x562677aa76a0 2024-09-11T00:06:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.898+0000 7f06c86b9740 10 client.15972 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.898+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=30}) -- 0x562677b312c0 con 0x562677aa76a0 2024-09-11T00:06:22.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.900+0000 7f069f7fe640 1 -- 172.21.15.19:0/1274782202 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f06b00cd2e0 con 0x562677aa76a0 2024-09-11T00:06:22.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.904+0000 7f06c86b9740 10 client.15972 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:22.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.904+0000 7f06c86b9740 10 client.15972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:06:22.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.904+0000 7f06c86b9740 20 client.15972 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:22.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.904+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677b317e0 0x562677b33ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:22.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.904+0000 7f06c86b9740 4 client.15972 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:06:22.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.904+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f06b0014070 con 0x562677b317e0 2024-09-11T00:06:22.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.908+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677b317e0 0x562677b33ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.915+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677b317e0 0x562677b33ca0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51789173bf49c1b3 server_cookie=e7c0a8c894132350 in_seq=0 out_seq=0 2024-09-11T00:06:22.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.915+0000 7f069f7fe640 10 client.15972 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:06:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.920+0000 7f069f7fe640 1 -- 172.21.15.19:0/1274782202 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f06b0014070 con 0x562677b317e0 2024-09-11T00:06:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.920+0000 7f069f7fe640 10 client.15972 handle_command_reply: tid=0 2024-09-11T00:06:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.923+0000 7f06c86b9740 1 client.15972 shutdown 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 msgr2=0x562677abc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677abc350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f06b0005c40 tx=0x7f06b00aaee0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 shutdown_connections 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x562677b317e0 0x562677b33ca0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562677ab3f50 0x562677ab90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562677aa7fc0 0x562677abc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 --2- 172.21.15.19:0/1274782202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562677aa76a0 0x562677abc350 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 >> 172.21.15.19:0/1274782202 conn(0x562677aa54d0 msgr2=0x562677ab2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.927+0000 7f069f7fe640 0 client.15972 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:06:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.931+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 shutdown_connections 2024-09-11T00:06:22.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.931+0000 7f06c86b9740 1 -- 172.21.15.19:0/1274782202 wait complete. 2024-09-11T00:06:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.936+0000 7f06c86b9740 20 client.15972 trim_cache size 0 max 16384 2024-09-11T00:06:22.939 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:06:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06a80b5720 msgr2=0x7f06a80b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06a80b5720 0x7f06a80b7be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f06b8006010 tx=0x7f06b8009780 comp rx=0 tx=0).stop 2024-09-11T00:06:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101230 msgr2=0x7f06c00746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101230 0x7f06c00746e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d950 tx=0x7f06b000de10 comp rx=0 tx=0).stop 2024-09-11T00:06:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 shutdown_connections 2024-09-11T00:06:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f06a80b5720 0x7f06a80b7be0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c0113590 0x7f06c006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c0101b50 0x7f06c0074c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 --2- 172.21.15.19:0/1979850037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c0101230 0x7f06c00746e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:22.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.941+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 >> 172.21.15.19:0/1979850037 conn(0x7f06c00fd2f0 msgr2=0x7f06c0110f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:22.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.942+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 shutdown_connections 2024-09-11T00:06:22.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:22.942+0000 7f06c5082640 1 -- 172.21.15.19:0/1979850037 wait complete. 2024-09-11T00:06:23.115 INFO:tasks.workunit.client.0.smithi019.stdout: 96 1674120 337 1084232 443 968824 1239 2024-09-11T00:06:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:23 smithi019 ceph-mon[30859]: pgmap v441: 97 pgs: 97 active+clean; 608 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.7 MiB/s wr, 781 op/s 2024-09-11T00:06:24.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:23 smithi131 ceph-mon[35491]: pgmap v441: 97 pgs: 97 active+clean; 608 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.7 MiB/s wr, 781 op/s 2024-09-11T00:06:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:23 smithi135 ceph-mon[35432]: pgmap v441: 97 pgs: 97 active+clean; 608 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.7 MiB/s wr, 781 op/s 2024-09-11T00:06:24.431 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:06:26.149 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:26.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:25 smithi019 ceph-mon[30859]: pgmap v442: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.2 MiB/s wr, 729 op/s 2024-09-11T00:06:26.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:25 smithi131 ceph-mon[35491]: pgmap v442: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.2 MiB/s wr, 729 op/s 2024-09-11T00:06:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:25 smithi135 ceph-mon[35432]: pgmap v442: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.2 MiB/s wr, 729 op/s 2024-09-11T00:06:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 -- 172.21.15.19:0/2213702574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 msgr2=0x7f35ec103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/2213702574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec103f70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009900 tx=0x7f35dc02a410 comp rx=0 tx=0).stop 2024-09-11T00:06:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 -- 172.21.15.19:0/2213702574 shutdown_connections 2024-09-11T00:06:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/2213702574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec10d140 0x7f35ec10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/2213702574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec104590 0x7f35ec10cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/2213702574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec103f70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 -- 172.21.15.19:0/2213702574 >> 172.21.15.19:0/2213702574 conn(0x7f35ec0fd700 msgr2=0x7f35ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 -- 172.21.15.19:0/2213702574 shutdown_connections 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.356+0000 7f35f0dfa640 1 -- 172.21.15.19:0/2213702574 wait complete. 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.357+0000 7f35f0dfa640 1 Processor -- start 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35f0dfa640 1 -- start start 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35f0dfa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35f0dfa640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec104590 0x7f35ec199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35f0dfa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec10d140 0x7f35ec19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35f0dfa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec112d60 con 0x7f35ec103b90 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35f0dfa640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec112be0 con 0x7f35ec104590 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35f0dfa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec112ee0 con 0x7f35ec10d140 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35ead9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec10d140 0x7f35ec19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54540/0 (socket says 172.21.15.19:54540) 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35ea59c640 1 -- 172.21.15.19:0/247371144 learned_addr learned my addr 172.21.15.19:0/247371144 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35ead9d640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec10d140 0x7f35ec19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39776/0 (socket says 172.21.15.19:39776) 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.358+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec104590 0x7f35ec199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35ead9d640 1 -- 172.21.15.19:0/247371144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec104590 msgr2=0x7f35ec199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35ead9d640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec104590 0x7f35ec199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35ead9d640 1 -- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 msgr2=0x7f35ec199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35ead9d640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35ead9d640 1 -- 172.21.15.19:0/247371144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec19f3c0 con 0x7f35ec10d140 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35ea59c640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35ead9d640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec10d140 0x7f35ec19ebf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35e4005fd0 tx=0x7f35e400edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35db7fe640 1 -- 172.21.15.19:0/247371144 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4004d20 con 0x7f35ec10d140 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35db7fe640 1 -- 172.21.15.19:0/247371144 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e4005020 con 0x7f35ec10d140 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec19f6b0 con 0x7f35ec10d140 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.359+0000 7f35db7fe640 1 -- 172.21.15.19:0/247371144 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e40116b0 con 0x7f35ec10d140 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.360+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec1018f0 con 0x7f35ec10d140 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.362+0000 7f35f31cf740 1 Processor -- start 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35db7fe640 1 -- 172.21.15.19:0/247371144 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f35e400f040 con 0x7f35ec10d140 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35f31cf740 1 -- start start 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea1a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea1c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35f31cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ccfe97bea0 con 0x55ccfea1a590 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35f31cf740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ccfe96b2d0 con 0x55ccfea0e600 2024-09-11T00:06:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.363+0000 7f35f31cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ccfe96f0e0 con 0x55ccfea0dce0 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea1a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea1a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:41916/0 (socket says 172.21.15.19:41916) 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 -- 172.21.15.19:0/2356991287 learned_addr learned my addr 172.21.15.19:0/2356991287 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35db7fe640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f35d40b5450 0x7f35d40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 -- 172.21.15.19:0/2356991287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 msgr2=0x55ccfea0e0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0e0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 -- 172.21.15.19:0/2356991287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 msgr2=0x55ccfea1c980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea1c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea1c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ead9d640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f35d40b5450 0x7f35d40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 -- 172.21.15.19:0/2356991287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccfe6c9650 con 0x55ccfea0e600 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35db7fe640 1 -- 172.21.15.19:0/247371144 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f35e40e5c20 con 0x7f35ec10d140 2024-09-11T00:06:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea1c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.364+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea1a050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000c00 tx=0x7f35dc005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccd376faeb063825 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.365+0000 7f35d8ff9640 1 -- 172.21.15.19:0/2356991287 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc035040 con 0x55ccfea0e600 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.365+0000 7f35ead9d640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f35d40b5450 0x7f35d40b7910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f35e40e39f0 tx=0x7f35e40cf040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.365+0000 7f35d8ff9640 1 -- 172.21.15.19:0/2356991287 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc031820 con 0x55ccfea0e600 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.365+0000 7f35d8ff9640 1 -- 172.21.15.19:0/2356991287 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc004a00 con 0x55ccfea0e600 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 -- 172.21.15.19:0/2356991287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 msgr2=0x55ccfea1a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea1a050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000c00 tx=0x7f35dc005be0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 -- 172.21.15.19:0/2356991287 shutdown_connections 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea1c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea1a050 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2356991287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 -- 172.21.15.19:0/2356991287 >> 172.21.15.19:0/2356991287 conn(0x55ccfea0bb10 msgr2=0x55ccfea0ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 -- 172.21.15.19:0/2356991287 shutdown_connections 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.366+0000 7f35f31cf740 1 -- 172.21.15.19:0/2356991287 wait complete. 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 -- start start 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 Processor -- start 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0dce0 0x55ccfea19f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0e600 0x55ccfea173a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea17a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ccfe7cc700 con 0x55ccfea1a590 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ccfe906160 con 0x55ccfea0dce0 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ccfea1d1e0 con 0x55ccfea0e600 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.367+0000 7f35f31cf740 10 client.0 _ll_register_callbacks cb 0x55ccfe91f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0e600 0x55ccfea173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0e600 0x55ccfea173a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39786/0 (socket says 172.21.15.19:39786) 2024-09-11T00:06:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 -- 172.21.15.19:0/2820312589 learned_addr learned my addr 172.21.15.19:0/2820312589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea17a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0dce0 0x55ccfea19f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 -- 172.21.15.19:0/2820312589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0dce0 msgr2=0x55ccfea19f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0dce0 0x55ccfea19f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 -- 172.21.15.19:0/2820312589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 msgr2=0x55ccfea17a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea17a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 -- 172.21.15.19:0/2820312589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccfe933c90 con 0x55ccfea0e600 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0e600 0x55ccfea173a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009a20 tx=0x7f35dc005510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f643205b891a4b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35d1ffb640 1 -- 172.21.15.19:0/2820312589 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc035040 con 0x55ccfea0e600 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35dc031820 con 0x55ccfea0e600 2024-09-11T00:06:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.368+0000 7f35d1ffb640 1 -- 172.21.15.19:0/2820312589 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f35dc0035f0 con 0x55ccfea0e600 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35d1ffb640 1 -- 172.21.15.19:0/2820312589 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f35dc009520 con 0x55ccfea0e600 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 10 client.25600 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ccfea28b60 con 0x55ccfea0e600 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35d1ffb640 1 -- 172.21.15.19:0/2820312589 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc031820 con 0x55ccfea0e600 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35d1ffb640 1 -- 172.21.15.19:0/2820312589 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f35dc004c30 con 0x55ccfea0e600 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 10 client.25600 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 20 client.25600 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea29eb0 0x55ccfea2c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 4 client.25600 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccfe97ddf0 con 0x55ccfea29eb0 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.369+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea29eb0 0x55ccfea2c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.370+0000 7f35d1ffb640 10 client.25600 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.370+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea29eb0 0x55ccfea2c2a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ebfd61b0e055e3d server_cookie=50c0aa426ed29827 in_seq=0 out_seq=0 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.370+0000 7f35d1ffb640 1 -- 172.21.15.19:0/2820312589 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ccfe97ddf0 con 0x55ccfea29eb0 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.370+0000 7f35d1ffb640 10 client.25600 handle_command_reply: tid=0 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.370+0000 7f35f31cf740 1 client.25600 shutdown 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0e600 msgr2=0x55ccfea173a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0e600 0x55ccfea173a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009a20 tx=0x7f35dc005510 comp rx=0 tx=0).stop 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 shutdown_connections 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea29eb0 0x55ccfea2c2a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea17a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0e600 0x55ccfea173a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35d1ffb640 0 client.25600 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2820312589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0dce0 0x55ccfea19f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 >> 172.21.15.19:0/2820312589 conn(0x55ccfea0bb10 msgr2=0x55ccfea116b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 shutdown_connections 2024-09-11T00:06:27.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 1 -- 172.21.15.19:0/2820312589 wait complete. 2024-09-11T00:06:27.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.371+0000 7f35f31cf740 20 client.25600 trim_cache size 0 max 16384 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 Processor -- start 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 -- start start 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea26480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1aec20 con 0x55ccfea1a590 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1ac490 con 0x55ccfea0e600 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35f31cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1aa2e0 con 0x55ccfea0dce0 2024-09-11T00:06:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35e9d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35e9d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39790/0 (socket says 172.21.15.19:39790) 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35e9d9b640 1 -- 172.21.15.19:0/2031519755 learned_addr learned my addr 172.21.15.19:0/2031519755 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.387+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea26480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35ea59c640 1 -- 172.21.15.19:0/2031519755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 msgr2=0x55ccfea0d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35ea59c640 1 -- 172.21.15.19:0/2031519755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 msgr2=0x55ccfea145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea145b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35ea59c640 1 -- 172.21.15.19:0/2031519755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccfea158a0 con 0x55ccfea0e600 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35ea59c640 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea26480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35dc004650 tx=0x7f35dc0056c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3490dbfe52738c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35d3fff640 1 -- 172.21.15.19:0/2031519755 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc035070 con 0x55ccfea0e600 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35d3fff640 1 -- 172.21.15.19:0/2031519755 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc04f070 con 0x55ccfea0e600 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.388+0000 7f35d3fff640 1 -- 172.21.15.19:0/2031519755 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc046980 con 0x55ccfea0e600 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 -- 172.21.15.19:0/2031519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 msgr2=0x55ccfea26480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea26480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35dc004650 tx=0x7f35dc0056c0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 -- 172.21.15.19:0/2031519755 shutdown_connections 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea1a590 0x55ccfea145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea0e600 0x55ccfea26480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 --2- 172.21.15.19:0/2031519755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea0d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 -- 172.21.15.19:0/2031519755 >> 172.21.15.19:0/2031519755 conn(0x55ccfea0bb10 msgr2=0x55ccfea0c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 -- 172.21.15.19:0/2031519755 shutdown_connections 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 -- 172.21.15.19:0/2031519755 wait complete. 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.389+0000 7f35f31cf740 1 -- start start 2024-09-11T00:06:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 1 Processor -- start 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea2f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea0e600 0x55ccfea2abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea1a590 0x55ccfea2b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1aa950 con 0x55ccfea0e600 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1abdc0 con 0x55ccfea1a590 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1ab020 con 0x55ccfea0dce0 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35f31cf740 10 client.0 _ll_register_callbacks cb 0x7f35dc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35e9d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea2f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea0e600 0x55ccfea2abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35ea59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea0e600 0x55ccfea2abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54570/0 (socket says 172.21.15.19:54570) 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35ea59c640 1 -- 172.21.15.19:0/1049513989 learned_addr learned my addr 172.21.15.19:0/1049513989 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.390+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea1a590 0x55ccfea2b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35e9d9b640 1 -- 172.21.15.19:0/1049513989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea1a590 msgr2=0x55ccfea2b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea1a590 0x55ccfea2b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35e9d9b640 1 -- 172.21.15.19:0/1049513989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea0e600 msgr2=0x55ccfea2abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea0e600 0x55ccfea2abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35e9d9b640 1 -- 172.21.15.19:0/1049513989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccfea2b960 con 0x55ccfea0dce0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35e9d9b640 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea2f6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35e0012420 tx=0x7f35e0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664a6652a3df7c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35d1ffb640 1 -- 172.21.15.19:0/1049513989 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0031060 con 0x55ccfea0dce0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35d1ffb640 1 -- 172.21.15.19:0/1049513989 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f35e0012de0 con 0x55ccfea0dce0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35dc04f070 con 0x55ccfea0dce0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35d1ffb640 1 -- 172.21.15.19:0/1049513989 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f35e001b040 con 0x55ccfea0dce0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35f31cf740 10 client.25606 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.391+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ccfea96b40 con 0x55ccfea0dce0 2024-09-11T00:06:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35d1ffb640 1 -- 172.21.15.19:0/1049513989 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc04f070 con 0x55ccfea0dce0 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35d1ffb640 1 -- 172.21.15.19:0/1049513989 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f35e0021040 con 0x55ccfea0dce0 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35f31cf740 10 client.25606 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35f31cf740 10 client.25606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35f31cf740 20 client.25606 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35f31cf740 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea972d0 0x55ccfea996f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35f31cf740 4 client.25606 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ccfe9798a0 con 0x55ccfea972d0 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.392+0000 7f35ea59c640 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea972d0 0x55ccfea996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35d1ffb640 10 client.25606 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35ea59c640 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea972d0 0x55ccfea996f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85231b7d737580a server_cookie=49b23a4101556bfb in_seq=0 out_seq=0 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35d1ffb640 1 -- 172.21.15.19:0/1049513989 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ccfe9798a0 con 0x55ccfea972d0 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35d1ffb640 10 client.25606 handle_command_reply: tid=0 2024-09-11T00:06:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 client.25606 shutdown 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 msgr2=0x55ccfea2f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea2f6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35e0012420 tx=0x7f35e0004730 comp rx=0 tx=0).stop 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 shutdown_connections 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfea1a590 0x55ccfea2b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ccfea972d0 0x55ccfea996f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfea0e600 0x55ccfea2abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 --2- 172.21.15.19:0/1049513989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfea0dce0 0x55ccfea2f6e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 >> 172.21.15.19:0/1049513989 conn(0x55ccfea0bb10 msgr2=0x55ccfea10d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35d1ffb640 0 client.25606 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 shutdown_connections 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.393+0000 7f35f31cf740 1 -- 172.21.15.19:0/1049513989 wait complete. 2024-09-11T00:06:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f31cf740 20 client.25606 trim_cache size 0 max 16384 2024-09-11T00:06:27.408 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f35d40b5450 msgr2=0x7f35d40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f35d40b5450 0x7f35d40b7910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f35e40e39f0 tx=0x7f35e40cf040 comp rx=0 tx=0).stop 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec10d140 msgr2=0x7f35ec19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec10d140 0x7f35ec19ebf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35e4005fd0 tx=0x7f35e400edd0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 shutdown_connections 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec10d140 0x7f35ec19ebf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec104590 0x7f35ec199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f35d40b5450 0x7f35d40b7910 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 --2- 172.21.15.19:0/247371144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35ec103b90 0x7f35ec199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 >> 172.21.15.19:0/247371144 conn(0x7f35ec0fd700 msgr2=0x7f35ec0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.394+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 shutdown_connections 2024-09-11T00:06:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:27.395+0000 7f35f0dfa640 1 -- 172.21.15.19:0/247371144 wait complete. 2024-09-11T00:06:28.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:27 smithi019 ceph-mon[30859]: pgmap v443: 97 pgs: 97 active+clean; 595 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 755 op/s 2024-09-11T00:06:28.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:27 smithi131 ceph-mon[35491]: pgmap v443: 97 pgs: 97 active+clean; 595 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 755 op/s 2024-09-11T00:06:28.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:27 smithi135 ceph-mon[35432]: pgmap v443: 97 pgs: 97 active+clean; 595 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 755 op/s 2024-09-11T00:06:29.568 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:06:29.568 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:06:30.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:29 smithi019 ceph-mon[30859]: pgmap v444: 97 pgs: 97 active+clean; 600 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-09-11T00:06:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:29 smithi131 ceph-mon[35491]: pgmap v444: 97 pgs: 97 active+clean; 600 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-09-11T00:06:30.345 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:29 smithi135 ceph-mon[35432]: pgmap v444: 97 pgs: 97 active+clean; 600 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-09-11T00:06:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.006+0000 7f5148fa4640 1 -- 172.21.15.19:0/3110028460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514411c0a0 msgr2=0x7f514411e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.006+0000 7f5148fa4640 1 --2- 172.21.15.19:0/3110028460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514411c0a0 0x7f514411e490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f513c009900 tx=0x7f513c02a4b0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.013+0000 7f5148fa4640 1 -- 172.21.15.19:0/3110028460 shutdown_connections 2024-09-11T00:06:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.013+0000 7f5148fa4640 1 --2- 172.21.15.19:0/3110028460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514411c0a0 0x7f514411e490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.013+0000 7f5148fa4640 1 --2- 172.21.15.19:0/3110028460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514410a530 0x7f514410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.013+0000 7f5148fa4640 1 --2- 172.21.15.19:0/3110028460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 0x7f51441111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.013+0000 7f5148fa4640 1 -- 172.21.15.19:0/3110028460 >> 172.21.15.19:0/3110028460 conn(0x7f514406dfc0 msgr2=0x7f514406e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.014+0000 7f5148fa4640 1 -- 172.21.15.19:0/3110028460 shutdown_connections 2024-09-11T00:06:31.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.021+0000 7f5148fa4640 1 -- 172.21.15.19:0/3110028460 wait complete. 2024-09-11T00:06:31.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.022+0000 7f5148fa4640 1 Processor -- start 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.027+0000 7f5148fa4640 1 -- start start 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f5148fa4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 0x7f51441193f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f5148fa4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514410a530 0x7f5144119930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f5148fa4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514411c0a0 0x7f51441126c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f5148fa4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5144121c10 con 0x7f514410a150 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f5148fa4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5144121a90 con 0x7f514410a530 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f5148fa4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5144121d90 con 0x7f514411c0a0 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f514259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 0x7f51441193f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f514259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 0x7f51441193f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54584/0 (socket says 172.21.15.19:54584) 2024-09-11T00:06:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.028+0000 7f514259c640 1 -- 172.21.15.19:0/616772437 learned_addr learned my addr 172.21.15.19:0/616772437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.029+0000 7f514259c640 1 -- 172.21.15.19:0/616772437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514411c0a0 msgr2=0x7f51441126c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:06:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.029+0000 7f514259c640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514411c0a0 0x7f51441126c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.029+0000 7f514259c640 1 -- 172.21.15.19:0/616772437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514410a530 msgr2=0x7f5144119930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:06:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.029+0000 7f514259c640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514410a530 0x7f5144119930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.029+0000 7f514259c640 1 -- 172.21.15.19:0/616772437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5144112f80 con 0x7f514410a150 2024-09-11T00:06:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.030+0000 7f514259c640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 0x7f51441193f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f513400cce0 tx=0x7f513400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.030+0000 7f513b7fe640 1 -- 172.21.15.19:0/616772437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513400f650 con 0x7f514410a150 2024-09-11T00:06:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.031+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5144113270 con 0x7f514410a150 2024-09-11T00:06:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.031+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51441182b0 con 0x7f514410a150 2024-09-11T00:06:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.031+0000 7f513b7fe640 1 -- 172.21.15.19:0/616772437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f513400fca0 con 0x7f514410a150 2024-09-11T00:06:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.031+0000 7f513b7fe640 1 -- 172.21.15.19:0/616772437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134018b60 con 0x7f514410a150 2024-09-11T00:06:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.038+0000 7f513b7fe640 1 -- 172.21.15.19:0/616772437 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f513400f7f0 con 0x7f514410a150 2024-09-11T00:06:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.040+0000 7f513b7fe640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f51300b5620 0x7f51300b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.041+0000 7f513b7fe640 1 -- 172.21.15.19:0/616772437 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f51340e6200 con 0x7f514410a150 2024-09-11T00:06:31.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.043+0000 7f514b379740 1 Processor -- start 2024-09-11T00:06:31.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.043+0000 7f5141d9b640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f51300b5620 0x7f51300b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.044+0000 7f5141d9b640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f51300b5620 0x7f51300b7ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f514411e600 tx=0x7f512c006bd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.045+0000 7f514b379740 1 -- start start 2024-09-11T00:06:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.045+0000 7f514b379740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86ccee0 0x556ab86cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86ccee0 0x556ab86cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86ccee0 0x556ab86cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54598/0 (socket says 172.21.15.19:54598) 2024-09-11T00:06:31.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514259c640 1 -- 172.21.15.19:0/2482101665 learned_addr learned my addr 172.21.15.19:0/2482101665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:31.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514b379740 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86cd800 0x556ab86d9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514b379740 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86d9790 0x556ab86dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556ab8643e60 con 0x556ab86ccee0 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556ab8633290 con 0x556ab86cd800 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.049+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ab86370a0 con 0x556ab86d9790 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.050+0000 7f5141d9b640 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86cd800 0x556ab86d9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.050+0000 7f514259c640 1 -- 172.21.15.19:0/2482101665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86d9790 msgr2=0x556ab86dbb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.050+0000 7f514259c640 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86d9790 0x556ab86dbb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.050+0000 7f514259c640 1 -- 172.21.15.19:0/2482101665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86cd800 msgr2=0x556ab86d9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.050+0000 7f514259c640 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86cd800 0x556ab86d9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.050+0000 7f514259c640 1 -- 172.21.15.19:0/2482101665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab8391930 con 0x556ab86ccee0 2024-09-11T00:06:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.050+0000 7f514259c640 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86ccee0 0x556ab86cd2c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f51340a9910 tx=0x7f5134018740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe5f9c35f4d011f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.051+0000 7f5138ff9640 1 -- 172.21.15.19:0/2482101665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134097030 con 0x556ab86ccee0 2024-09-11T00:06:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.051+0000 7f5138ff9640 1 -- 172.21.15.19:0/2482101665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51340ac1b0 con 0x556ab86ccee0 2024-09-11T00:06:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.051+0000 7f5138ff9640 1 -- 172.21.15.19:0/2482101665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340a8910 con 0x556ab86ccee0 2024-09-11T00:06:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.052+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86ccee0 msgr2=0x556ab86cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.052+0000 7f514b379740 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86ccee0 0x556ab86cd2c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f51340a9910 tx=0x7f5134018740 comp rx=0 tx=0).stop 2024-09-11T00:06:31.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.057+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 shutdown_connections 2024-09-11T00:06:31.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.057+0000 7f514b379740 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86d9790 0x556ab86dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.057+0000 7f514b379740 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86cd800 0x556ab86d9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.057+0000 7f514b379740 1 --2- 172.21.15.19:0/2482101665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86ccee0 0x556ab86cd2c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.057+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 >> 172.21.15.19:0/2482101665 conn(0x556ab86cad10 msgr2=0x556ab86cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.063+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 shutdown_connections 2024-09-11T00:06:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.063+0000 7f514b379740 1 -- 172.21.15.19:0/2482101665 wait complete. 2024-09-11T00:06:31.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.064+0000 7f514b379740 1 -- start start 2024-09-11T00:06:31.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.064+0000 7f514b379740 1 Processor -- start 2024-09-11T00:06:31.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.065+0000 7f514b379740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86d6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.065+0000 7f514b379740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 0x556ab86d6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.065+0000 7f514259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.065+0000 7f514259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86d6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39816/0 (socket says 172.21.15.19:39816) 2024-09-11T00:06:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.065+0000 7f514259c640 1 -- 172.21.15.19:0/2702201978 learned_addr learned my addr 172.21.15.19:0/2702201978 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:31.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.065+0000 7f514b379740 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f5142d9d640 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556ab8494890 con 0x556ab86d71d0 2024-09-11T00:06:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556ab85cdd40 con 0x556ab86d9790 2024-09-11T00:06:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ab86dc3e0 con 0x556ab86ccee0 2024-09-11T00:06:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514b379740 10 client.0 _ll_register_callbacks cb 0x556ab8631c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:31.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514259c640 1 -- 172.21.15.19:0/2702201978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 msgr2=0x556ab86d6c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514259c640 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 0x556ab86d6c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514259c640 1 -- 172.21.15.19:0/2702201978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 msgr2=0x556ab86e57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514259c640 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86e57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.066+0000 7f514259c640 1 -- 172.21.15.19:0/2702201978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab86e5cf0 con 0x556ab86ccee0 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.067+0000 7f514259c640 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86d6750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f51340ac3a0 tx=0x7f51340a8bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acbd3fa346478c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.067+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51340ac1b0 con 0x556ab86ccee0 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.067+0000 7f5129ffb640 10 client.25609 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:06:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.067+0000 7f5129ffb640 1 -- 172.21.15.19:0/2702201978 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134097040 con 0x556ab86ccee0 2024-09-11T00:06:31.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.067+0000 7f5129ffb640 1 -- 172.21.15.19:0/2702201978 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f51340b57a0 con 0x556ab86ccee0 2024-09-11T00:06:31.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.070+0000 7f5142d9d640 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:31.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.070+0000 7f5129ffb640 1 -- 172.21.15.19:0/2702201978 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f51340e3df0 con 0x556ab86ccee0 2024-09-11T00:06:31.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.071+0000 7f514b379740 10 client.25609 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:31.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.071+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556ab86e8480 con 0x556ab86ccee0 2024-09-11T00:06:31.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.073+0000 7f5129ffb640 1 -- 172.21.15.19:0/2702201978 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f51340ab900 con 0x556ab86ccee0 2024-09-11T00:06:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.074+0000 7f514b379740 10 client.25609 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.074+0000 7f514b379740 10 client.25609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.074+0000 7f514b379740 20 client.25609 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.074+0000 7f514b379740 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab86e97d0 0x556ab86ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.074+0000 7f514b379740 4 client.25609 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.074+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f51340ac1b0 con 0x556ab86e97d0 2024-09-11T00:06:31.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.091+0000 7f5141d9b640 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab86e97d0 0x556ab86ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.105+0000 7f5141d9b640 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab86e97d0 0x556ab86ebbc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5892451073ca967 server_cookie=f4ccd2ca131619a1 in_seq=0 out_seq=0 2024-09-11T00:06:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.105+0000 7f5129ffb640 10 client.25609 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.109+0000 7f5129ffb640 1 -- 172.21.15.19:0/2702201978 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f51340ac1b0 con 0x556ab86e97d0 2024-09-11T00:06:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.109+0000 7f5129ffb640 10 client.25609 handle_command_reply: tid=0 2024-09-11T00:06:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.109+0000 7f514b379740 1 client.25609 shutdown 2024-09-11T00:06:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 msgr2=0x556ab86d6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86d6750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f51340ac3a0 tx=0x7f51340a8bc0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 shutdown_connections 2024-09-11T00:06:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab86e97d0 0x556ab86ebbc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 0x556ab86d6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 --2- 172.21.15.19:0/2702201978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86d6750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 >> 172.21.15.19:0/2702201978 conn(0x556ab86cad10 msgr2=0x556ab86c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.113+0000 7f5129ffb640 0 client.25609 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.114+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 shutdown_connections 2024-09-11T00:06:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.114+0000 7f514b379740 1 -- 172.21.15.19:0/2702201978 wait complete. 2024-09-11T00:06:31.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.118+0000 7f514b379740 20 client.25609 trim_cache size 0 max 16384 2024-09-11T00:06:31.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.163+0000 7f514b379740 1 Processor -- start 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.163+0000 7f514b379740 1 -- start start 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.164+0000 7f514b379740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86e5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.164+0000 7f514b379740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d71d0 0x556ab86d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.164+0000 7f514b379740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d9790 0x556ab86d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.164+0000 7f514b379740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5124010f50 con 0x556ab86d9790 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.164+0000 7f514b379740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f512400e7c0 con 0x556ab86d71d0 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.164+0000 7f514b379740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f512400c610 con 0x556ab86ccee0 2024-09-11T00:06:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.165+0000 7f514259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.165+0000 7f514259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39820/0 (socket says 172.21.15.19:39820) 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.165+0000 7f514259c640 1 -- 172.21.15.19:0/2577677892 learned_addr learned my addr 172.21.15.19:0/2577677892 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.165+0000 7f514259c640 1 -- 172.21.15.19:0/2577677892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d71d0 msgr2=0x556ab86d3930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.165+0000 7f514259c640 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d71d0 0x556ab86d3930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.165+0000 7f514259c640 1 -- 172.21.15.19:0/2577677892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d9790 msgr2=0x556ab86d3e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.166+0000 7f5142d9d640 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d9790 0x556ab86d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.166+0000 7f514259c640 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d9790 0x556ab86d3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.166+0000 7f514259c640 1 -- 172.21.15.19:0/2577677892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab86cb790 con 0x556ab86ccee0 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.166+0000 7f5142d9d640 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d9790 0x556ab86d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.166+0000 7f514259c640 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86e5720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f513400cfd0 tx=0x7f51340d0000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caa94580b3823903 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:31.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.170+0000 7f512bfff640 1 -- 172.21.15.19:0/2577677892 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340ac1b0 con 0x556ab86ccee0 2024-09-11T00:06:31.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.170+0000 7f512bfff640 1 -- 172.21.15.19:0/2577677892 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51340b1180 con 0x556ab86ccee0 2024-09-11T00:06:31.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.170+0000 7f512bfff640 1 -- 172.21.15.19:0/2577677892 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340b5a00 con 0x556ab86ccee0 2024-09-11T00:06:31.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.172+0000 7f514b379740 1 -- 172.21.15.19:0/2577677892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 msgr2=0x556ab86e5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:31.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.172+0000 7f514b379740 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86e5720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f513400cfd0 tx=0x7f51340d0000 comp rx=0 tx=0).stop 2024-09-11T00:06:31.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.175+0000 7f514b379740 1 -- 172.21.15.19:0/2577677892 shutdown_connections 2024-09-11T00:06:31.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.175+0000 7f514b379740 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d9790 0x556ab86d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.175+0000 7f514b379740 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d71d0 0x556ab86d3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.175+0000 7f514b379740 1 --2- 172.21.15.19:0/2577677892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86e5720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.175+0000 7f514b379740 1 -- 172.21.15.19:0/2577677892 >> 172.21.15.19:0/2577677892 conn(0x556ab86cad10 msgr2=0x556ab86d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:31.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.180+0000 7f514b379740 1 -- 172.21.15.19:0/2577677892 shutdown_connections 2024-09-11T00:06:31.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.181+0000 7f514b379740 1 -- 172.21.15.19:0/2577677892 wait complete. 2024-09-11T00:06:31.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.181+0000 7f514b379740 1 -- start start 2024-09-11T00:06:31.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.181+0000 7f514b379740 1 Processor -- start 2024-09-11T00:06:31.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.184+0000 7f514b379740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.184+0000 7f514b379740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86ed030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.184+0000 7f514b379740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 0x556ab8755340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.184+0000 7f514b379740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f512400cc80 con 0x556ab86d71d0 2024-09-11T00:06:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.184+0000 7f514b379740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f512400e0f0 con 0x556ab86d9790 2024-09-11T00:06:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.184+0000 7f514b379740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f512400d350 con 0x556ab86ccee0 2024-09-11T00:06:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.184+0000 7f514b379740 10 client.0 _ll_register_callbacks cb 0x7f51340a8d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.185+0000 7f514259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.185+0000 7f5141d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.185+0000 7f5142d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 0x556ab8755340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.185+0000 7f5141d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54628/0 (socket says 172.21.15.19:54628) 2024-09-11T00:06:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.185+0000 7f5141d9b640 1 -- 172.21.15.19:0/1119267528 learned_addr learned my addr 172.21.15.19:0/1119267528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.186+0000 7f5141d9b640 1 -- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 msgr2=0x556ab86ecaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.186+0000 7f5141d9b640 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86ecaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.186+0000 7f5141d9b640 1 -- 172.21.15.19:0/1119267528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 msgr2=0x556ab8755340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.186+0000 7f5141d9b640 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 0x556ab8755340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.186+0000 7f5141d9b640 1 -- 172.21.15.19:0/1119267528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab8755880 con 0x556ab86d71d0 2024-09-11T00:06:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.186+0000 7f514259c640 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.187+0000 7f5141d9b640 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86ed030 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x556ab86cb9f0 tx=0x7f512c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4345dd163281918 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.187+0000 7f5129ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:06:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.188+0000 7f5129ffb640 1 -- 172.21.15.19:0/1119267528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c012bf0 con 0x556ab86d71d0 2024-09-11T00:06:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.188+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51340b1180 con 0x556ab86d71d0 2024-09-11T00:06:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.188+0000 7f5129ffb640 1 -- 172.21.15.19:0/1119267528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f512c012d90 con 0x556ab86d71d0 2024-09-11T00:06:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.188+0000 7f5129ffb640 1 -- 172.21.15.19:0/1119267528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f512c026470 con 0x556ab86d71d0 2024-09-11T00:06:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.189+0000 7f514b379740 10 client.15996 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.189+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ab8756a20 con 0x556ab86d71d0 2024-09-11T00:06:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.189+0000 7f5129ffb640 1 -- 172.21.15.19:0/1119267528 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51340b1180 con 0x556ab86d71d0 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.190+0000 7f5129ffb640 1 -- 172.21.15.19:0/1119267528 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f512c012070 con 0x556ab86d71d0 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.190+0000 7f514b379740 10 client.15996 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.190+0000 7f514b379740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.190+0000 7f514b379740 20 client.15996 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.190+0000 7f514b379740 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab8757230 0x556ab8759650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.190+0000 7f514b379740 4 client.15996 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.190+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556ab8645db0 con 0x556ab8757230 2024-09-11T00:06:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.191+0000 7f514259c640 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab8757230 0x556ab8759650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:31.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.198+0000 7f514259c640 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab8757230 0x556ab8759650 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da64894d9355c968 server_cookie=da8f81611cb3bb5d in_seq=0 out_seq=0 2024-09-11T00:06:31.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.200+0000 7f5129ffb640 10 client.15996 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.209+0000 7f5129ffb640 1 -- 172.21.15.19:0/1119267528 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556ab8645db0 con 0x556ab8757230 2024-09-11T00:06:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.209+0000 7f5129ffb640 10 client.15996 handle_command_reply: tid=0 2024-09-11T00:06:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.209+0000 7f514b379740 1 client.15996 shutdown 2024-09-11T00:06:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.218+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 msgr2=0x556ab86ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.218+0000 7f514b379740 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86ed030 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x556ab86cb9f0 tx=0x7f512c004750 comp rx=0 tx=0).stop 2024-09-11T00:06:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 shutdown_connections 2024-09-11T00:06:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f514b379740 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ab86d9790 0x556ab8755340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f514b379740 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x556ab8757230 0x556ab8759650 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f514b379740 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ab86d71d0 0x556ab86ed030 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f514b379740 1 --2- 172.21.15.19:0/1119267528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab86ccee0 0x556ab86ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 >> 172.21.15.19:0/1119267528 conn(0x556ab86cad10 msgr2=0x556ab86d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f5129ffb640 0 client.15996 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.219+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 shutdown_connections 2024-09-11T00:06:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.220+0000 7f514b379740 1 -- 172.21.15.19:0/1119267528 wait complete. 2024-09-11T00:06:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.221+0000 7f514b379740 20 client.15996 trim_cache size 0 max 16384 2024-09-11T00:06:31.222 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:06:31.222 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:06:31.222 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "b25bf178-3e8c-4709-8b4b-03638eecafc8", 2024-09-11T00:06:31.222 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:06:31.223 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:06:31.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f51300b5620 msgr2=0x7f51300b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:31.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f51300b5620 0x7f51300b7ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f514411e600 tx=0x7f512c006bd0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 msgr2=0x7f51441193f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:31.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 0x7f51441193f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f513400cce0 tx=0x7f513400a620 comp rx=0 tx=0).stop 2024-09-11T00:06:31.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 shutdown_connections 2024-09-11T00:06:31.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514411c0a0 0x7f51441126c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514410a530 0x7f5144119930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f51300b5620 0x7f51300b7ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 --2- 172.21.15.19:0/616772437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514410a150 0x7f51441193f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:31.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.222+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 >> 172.21.15.19:0/616772437 conn(0x7f514406dfc0 msgr2=0x7f514411c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:31.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.223+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 shutdown_connections 2024-09-11T00:06:31.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:31.223+0000 7f5148fa4640 1 -- 172.21.15.19:0/616772437 wait complete. 2024-09-11T00:06:31.972 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:31 smithi019 ceph-mon[30859]: pgmap v445: 97 pgs: 97 active+clean; 603 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 545 op/s 2024-09-11T00:06:31.972 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:31 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:06:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:31 smithi131 ceph-mon[35491]: pgmap v445: 97 pgs: 97 active+clean; 603 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 545 op/s 2024-09-11T00:06:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:31 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:06:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:31 smithi135 ceph-mon[35432]: pgmap v445: 97 pgs: 97 active+clean; 603 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 545 op/s 2024-09-11T00:06:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:31 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:06:32.590 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:06:33.115 INFO:tasks.workunit.client.0.smithi019.stdout: 105 1875721 695 1246712 467 1094686 1594 2024-09-11T00:06:33.124 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:33.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:32 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:06:33.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:32 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:33.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:32 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:06:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:32 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:06:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:32 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:33.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:32 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:06:33.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:32 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:06:33.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:32 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:33.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:32 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:06:33.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.922+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2853240780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a150 msgr2=0x7f5a481111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:33.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.922+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2853240780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a150 0x7f5a481111b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009900 tx=0x7f5a3c02a4b0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.927+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2853240780 shutdown_connections 2024-09-11T00:06:33.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.927+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2853240780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4811c0a0 0x7f5a4811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.927+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2853240780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a530 0x7f5a4810a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.927+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2853240780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a150 0x7f5a481111b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.927+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2853240780 >> 172.21.15.19:0/2853240780 conn(0x7f5a4806dfc0 msgr2=0x7f5a4806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:33.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.928+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2853240780 shutdown_connections 2024-09-11T00:06:33.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.929+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2853240780 wait complete. 2024-09-11T00:06:33.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.930+0000 7f5a4d45b640 1 Processor -- start 2024-09-11T00:06:33.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.935+0000 7f5a4d45b640 1 -- start start 2024-09-11T00:06:33.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.936+0000 7f5a4d45b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a150 0x7f5a481a8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.936+0000 7f5a4d45b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a530 0x7f5a481a8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.938+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a150 0x7f5a481a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:33.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.938+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a150 0x7f5a481a8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:51798/0 (socket says 172.21.15.19:51798) 2024-09-11T00:06:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.940+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a530 0x7f5a481a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.940+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a530 0x7f5a481a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38586/0 (socket says 172.21.15.19:38586) 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.940+0000 7f5a4d45b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4811c0a0 0x7f5a481ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.940+0000 7f5a4d45b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48121c10 con 0x7f5a4810a530 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.940+0000 7f5a4d45b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48121a90 con 0x7f5a4811c0a0 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.940+0000 7f5a4d45b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48121d90 con 0x7f5a4810a150 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.940+0000 7f5a46ffd640 1 -- 172.21.15.19:0/2873925805 learned_addr learned my addr 172.21.15.19:0/2873925805 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.941+0000 7f5a467fc640 1 -- 172.21.15.19:0/2873925805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a150 msgr2=0x7f5a481a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.941+0000 7f5a467fc640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a150 0x7f5a481a8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.941+0000 7f5a467fc640 1 -- 172.21.15.19:0/2873925805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4811c0a0 msgr2=0x7f5a481ada00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.941+0000 7f5a467fc640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4811c0a0 0x7f5a481ada00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.941+0000 7f5a467fc640 1 -- 172.21.15.19:0/2873925805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481ae1d0 con 0x7f5a4810a530 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.941+0000 7f5a467fc640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a530 0x7f5a481a8660 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ca30 tx=0x7f5a3800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.942+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a150 0x7f5a481a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-11T00:06:33.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.943+0000 7f5a2ffff640 1 -- 172.21.15.19:0/2873925805 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38007b20 con 0x7f5a4810a530 2024-09-11T00:06:33.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.943+0000 7f5a2ffff640 1 -- 172.21.15.19:0/2873925805 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a380054d0 con 0x7f5a4810a530 2024-09-11T00:06:33.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.943+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481ae4c0 con 0x7f5a4810a530 2024-09-11T00:06:33.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.943+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a481b4c00 con 0x7f5a4810a530 2024-09-11T00:06:33.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.943+0000 7f5a2ffff640 1 -- 172.21.15.19:0/2873925805 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800f450 con 0x7f5a4810a530 2024-09-11T00:06:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.947+0000 7f5a4f830740 1 Processor -- start 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.947+0000 7f5a4f830740 1 -- start start 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc95a480 0x5604bc95a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95ada0 0x5604bc9667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc966d30 0x5604bc969120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a4f830740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5604bc8d0e50 con 0x5604bc95a480 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a4f830740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5604bc8c0280 con 0x5604bc95ada0 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a4f830740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604bc8c4090 con 0x5604bc966d30 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc95a480 0x5604bc95a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc95a480 0x5604bc95a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38596/0 (socket says 172.21.15.19:38596) 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.948+0000 7f5a477fe640 1 -- 172.21.15.19:0/2479445995 learned_addr learned my addr 172.21.15.19:0/2479445995 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.949+0000 7f5a477fe640 1 -- 172.21.15.19:0/2479445995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc966d30 msgr2=0x5604bc969120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.949+0000 7f5a477fe640 1 --2- 172.21.15.19:0/2479445995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc966d30 0x5604bc969120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.949+0000 7f5a477fe640 1 -- 172.21.15.19:0/2479445995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95ada0 msgr2=0x5604bc9667f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.949+0000 7f5a477fe640 1 --2- 172.21.15.19:0/2479445995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95ada0 0x5604bc9667f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.949+0000 7f5a477fe640 1 -- 172.21.15.19:0/2479445995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bc61e650 con 0x5604bc95a480 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.949+0000 7f5a477fe640 1 --2- 172.21.15.19:0/2479445995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc95a480 0x5604bc95a860 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002bf70 tx=0x7f5a4002d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4ad25021431e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.951+0000 7f5a2d7fa640 1 -- 172.21.15.19:0/2479445995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4002dcb0 con 0x5604bc95a480 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.951+0000 7f5a2d7fa640 1 -- 172.21.15.19:0/2479445995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a40039070 con 0x5604bc95a480 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.951+0000 7f5a2d7fa640 1 -- 172.21.15.19:0/2479445995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40033750 con 0x5604bc95a480 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a4f830740 1 -- 172.21.15.19:0/2479445995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc95a480 msgr2=0x5604bc95a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a4f830740 1 --2- 172.21.15.19:0/2479445995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc95a480 0x5604bc95a860 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002bf70 tx=0x7f5a4002d4e0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a2ffff640 1 -- 172.21.15.19:0/2873925805 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f5a38004eb0 con 0x7f5a4810a530 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a4f830740 1 -- 172.21.15.19:0/2479445995 shutdown_connections 2024-09-11T00:06:33.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a4f830740 1 --2- 172.21.15.19:0/2479445995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc966d30 0x5604bc969120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a4f830740 1 --2- 172.21.15.19:0/2479445995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95ada0 0x5604bc9667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a4f830740 1 --2- 172.21.15.19:0/2479445995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc95a480 0x5604bc95a860 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.952+0000 7f5a4f830740 1 -- 172.21.15.19:0/2479445995 >> 172.21.15.19:0/2479445995 conn(0x5604bc9582b0 msgr2=0x5604bc959450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.954+0000 7f5a4f830740 1 -- 172.21.15.19:0/2479445995 shutdown_connections 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.954+0000 7f5a4f830740 1 -- 172.21.15.19:0/2479445995 wait complete. 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.954+0000 7f5a2ffff640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5a300b5560 0x7f5a300b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.954+0000 7f5a2ffff640 1 -- 172.21.15.19:0/2873925805 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5a380e5ef0 con 0x7f5a4810a530 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.954+0000 7f5a4f830740 1 -- start start 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.955+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5a300b5560 0x7f5a300b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.955+0000 7f5a4f830740 1 Processor -- start 2024-09-11T00:06:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.959+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc9665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.959+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc963a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.959+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc963fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.959+0000 7f5a4f830740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5604bc721700 con 0x5604bc966d30 2024-09-11T00:06:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.959+0000 7f5a4f830740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5604bc85b110 con 0x5604bc95a480 2024-09-11T00:06:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.959+0000 7f5a4f830740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604bc9699b0 con 0x5604bc95ada0 2024-09-11T00:06:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.959+0000 7f5a4f830740 10 client.0 _ll_register_callbacks cb 0x5604bc874990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc9665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc963fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc9665d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:37230/0 (socket says 172.21.15.19:37230) 2024-09-11T00:06:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a46ffd640 1 -- 172.21.15.19:0/727321014 learned_addr learned my addr 172.21.15.19:0/727321014 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a477fe640 1 -- 172.21.15.19:0/727321014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 msgr2=0x5604bc963a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a477fe640 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc963a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a477fe640 1 -- 172.21.15.19:0/727321014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 msgr2=0x5604bc9665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a477fe640 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc9665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a477fe640 1 -- 172.21.15.19:0/727321014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604bc888c40 con 0x5604bc966d30 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.960+0000 7f5a477fe640 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc963fe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002f010 tx=0x7f5a40003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91084a86aa8abeb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.961+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc9665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.961+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5a300b5560 0x7f5a300b7a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c005c40 tx=0x7f5a3c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:33.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.964+0000 7f5a2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:06:33.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.967+0000 7f5a2aff5640 1 -- 172.21.15.19:0/727321014 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a400347b0 con 0x5604bc966d30 2024-09-11T00:06:33.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.967+0000 7f5a2aff5640 1 -- 172.21.15.19:0/727321014 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5a40034950 con 0x5604bc966d30 2024-09-11T00:06:33.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.967+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a40039070 con 0x5604bc966d30 2024-09-11T00:06:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.971+0000 7f5a2aff5640 1 -- 172.21.15.19:0/727321014 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5a40004040 con 0x5604bc966d30 2024-09-11T00:06:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.971+0000 7f5a4f830740 10 client.16008 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.971+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5604bc975340 con 0x5604bc966d30 2024-09-11T00:06:33.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.982+0000 7f5a2aff5640 1 -- 172.21.15.19:0/727321014 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a40039070 con 0x5604bc966d30 2024-09-11T00:06:33.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.982+0000 7f5a2aff5640 1 -- 172.21.15.19:0/727321014 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f5a40033070 con 0x5604bc966d30 2024-09-11T00:06:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.984+0000 7f5a4f830740 10 client.16008 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.984+0000 7f5a4f830740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.984+0000 7f5a4f830740 20 client.16008 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.984+0000 7f5a4f830740 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9767a0 0x5604bc978b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.984+0000 7f5a4f830740 4 client.16008 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.984+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604bc8d2da0 con 0x5604bc9767a0 2024-09-11T00:06:33.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.988+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9767a0 0x5604bc978b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:33.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.995+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9767a0 0x5604bc978b90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbdebaa14807806 server_cookie=c56f9c8caf62811f in_seq=0 out_seq=0 2024-09-11T00:06:33.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:33.998+0000 7f5a2aff5640 10 client.16008 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:34.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.002+0000 7f5a2aff5640 1 -- 172.21.15.19:0/727321014 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604bc8d2da0 con 0x5604bc9767a0 2024-09-11T00:06:34.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.002+0000 7f5a2aff5640 10 client.16008 handle_command_reply: tid=0 2024-09-11T00:06:34.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.005+0000 7f5a4f830740 1 client.16008 shutdown 2024-09-11T00:06:34.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.007+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 msgr2=0x5604bc963fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:34.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.007+0000 7f5a4f830740 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc963fe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002f010 tx=0x7f5a40003f20 comp rx=0 tx=0).stop 2024-09-11T00:06:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.016+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 shutdown_connections 2024-09-11T00:06:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.016+0000 7f5a4f830740 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9767a0 0x5604bc978b90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.016+0000 7f5a4f830740 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc963fe0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.016+0000 7f5a4f830740 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc963a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.016+0000 7f5a4f830740 1 --2- 172.21.15.19:0/727321014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc9665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.016+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 >> 172.21.15.19:0/727321014 conn(0x5604bc9582b0 msgr2=0x5604bc95de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:34.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.017+0000 7f5a2aff5640 0 client.16008 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:34.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.022+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 shutdown_connections 2024-09-11T00:06:34.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.022+0000 7f5a4f830740 1 -- 172.21.15.19:0/727321014 wait complete. 2024-09-11T00:06:34.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.022+0000 7f5a4f830740 20 client.16008 trim_cache size 0 max 16384 2024-09-11T00:06:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.069+0000 7f5a4f830740 1 Processor -- start 2024-09-11T00:06:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.069+0000 7f5a4f830740 1 -- start start 2024-09-11T00:06:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.070+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc972c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.070+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc9593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.070+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc9622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:34.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.071+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc972c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:34.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.071+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc972c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:37236/0 (socket says 172.21.15.19:37236) 2024-09-11T00:06:34.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.071+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc9593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:34.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.071+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc9593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:51812/0 (socket says 172.21.15.19:51812) 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.074+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc9622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.074+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc9622c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38628/0 (socket says 172.21.15.19:38628) 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.074+0000 7f5a4f830740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48080250 con 0x5604bc966d30 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.074+0000 7f5a4f830740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4807db00 con 0x5604bc95a480 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.074+0000 7f5a4f830740 1 -- 172.21.15.19:0/3316173807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4810a930 con 0x5604bc95ada0 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.074+0000 7f5a46ffd640 1 -- 172.21.15.19:0/3316173807 learned_addr learned my addr 172.21.15.19:0/3316173807 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.076+0000 7f5a477fe640 1 -- 172.21.15.19:0/3316173807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 msgr2=0x5604bc9593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.076+0000 7f5a477fe640 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc9593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.076+0000 7f5a477fe640 1 -- 172.21.15.19:0/3316173807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 msgr2=0x5604bc972c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.076+0000 7f5a477fe640 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc972c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.076+0000 7f5a477fe640 1 -- 172.21.15.19:0/3316173807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bc969a30 con 0x5604bc966d30 2024-09-11T00:06:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.077+0000 7f5a477fe640 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc9622c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a400022f0 tx=0x7f5a4002db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f154640bf2eea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:34.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.080+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc972c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.080+0000 7f5a2cff9640 1 -- 172.21.15.19:0/3316173807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40007000 con 0x5604bc966d30 2024-09-11T00:06:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.081+0000 7f5a2cff9640 1 -- 172.21.15.19:0/3316173807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a40056070 con 0x5604bc966d30 2024-09-11T00:06:34.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.081+0000 7f5a2cff9640 1 -- 172.21.15.19:0/3316173807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a400041e0 con 0x5604bc966d30 2024-09-11T00:06:34.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.085+0000 7f5a4f830740 1 -- 172.21.15.19:0/3316173807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 msgr2=0x5604bc9622c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:34.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.085+0000 7f5a4f830740 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc9622c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a400022f0 tx=0x7f5a4002db10 comp rx=0 tx=0).stop 2024-09-11T00:06:34.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.088+0000 7f5a4f830740 1 -- 172.21.15.19:0/3316173807 shutdown_connections 2024-09-11T00:06:34.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.088+0000 7f5a4f830740 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc9622c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.088+0000 7f5a4f830740 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc9593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.088+0000 7f5a4f830740 1 --2- 172.21.15.19:0/3316173807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc972c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.088+0000 7f5a4f830740 1 -- 172.21.15.19:0/3316173807 >> 172.21.15.19:0/3316173807 conn(0x5604bc9582b0 msgr2=0x5604bc963990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:34.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.093+0000 7f5a4f830740 1 -- 172.21.15.19:0/3316173807 shutdown_connections 2024-09-11T00:06:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.095+0000 7f5a4f830740 1 -- 172.21.15.19:0/3316173807 wait complete. 2024-09-11T00:06:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.096+0000 7f5a4f830740 1 -- start start 2024-09-11T00:06:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.096+0000 7f5a4f830740 1 Processor -- start 2024-09-11T00:06:34.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.097+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc96ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.097+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc96f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.097+0000 7f5a4f830740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc969ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.097+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc96ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.097+0000 7f5a46ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc96ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:37250/0 (socket says 172.21.15.19:37250) 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.098+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc96f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.098+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc969ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.098+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc969ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38636/0 (socket says 172.21.15.19:38636) 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.098+0000 7f5a46ffd640 1 -- 172.21.15.19:0/771661748 learned_addr learned my addr 172.21.15.19:0/771661748 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.098+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4807bfe0 con 0x5604bc966d30 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.098+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4807d430 con 0x5604bc95a480 2024-09-11T00:06:34.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.098+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4807c690 con 0x5604bc95ada0 2024-09-11T00:06:34.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.099+0000 7f5a4f830740 10 client.0 _ll_register_callbacks cb 0x7f5a4002bdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.100+0000 7f5a477fe640 1 -- 172.21.15.19:0/771661748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 msgr2=0x5604bc96f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.100+0000 7f5a477fe640 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc96f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.100+0000 7f5a477fe640 1 -- 172.21.15.19:0/771661748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 msgr2=0x5604bc96ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.100+0000 7f5a477fe640 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc96ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.100+0000 7f5a477fe640 1 -- 172.21.15.19:0/771661748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604bc96f8d0 con 0x5604bc966d30 2024-09-11T00:06:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.101+0000 7f5a477fe640 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc969ca0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a400022f0 tx=0x7f5a400346c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536622a35f4109e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.102+0000 7f5a2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:06:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.102+0000 7f5a2aff5640 1 -- 172.21.15.19:0/771661748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40051c40 con 0x5604bc966d30 2024-09-11T00:06:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.102+0000 7f5a2aff5640 1 -- 172.21.15.19:0/771661748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5a400041e0 con 0x5604bc966d30 2024-09-11T00:06:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.102+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a40056070 con 0x5604bc966d30 2024-09-11T00:06:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.102+0000 7f5a2aff5640 1 -- 172.21.15.19:0/771661748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5a40034a90 con 0x5604bc966d30 2024-09-11T00:06:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.105+0000 7f5a4f830740 10 client.16014 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.105+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5604bc9e38d0 con 0x5604bc966d30 2024-09-11T00:06:34.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.106+0000 7f5a2aff5640 1 -- 172.21.15.19:0/771661748 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a40039070 con 0x5604bc966d30 2024-09-11T00:06:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.107+0000 7f5a2aff5640 1 -- 172.21.15.19:0/771661748 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f5a40064070 con 0x5604bc966d30 2024-09-11T00:06:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.110+0000 7f5a4f830740 10 client.16014 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.110+0000 7f5a4f830740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:06:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.110+0000 7f5a4f830740 20 client.16014 populate_metadata read hostname 'smithi019' 2024-09-11T00:06:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.110+0000 7f5a4f830740 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9e3f20 0x5604bc9e6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.110+0000 7f5a4f830740 4 client.16014 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:06:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.110+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5a40056070 con 0x5604bc9e3f20 2024-09-11T00:06:34.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.111+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9e3f20 0x5604bc9e6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.120+0000 7f5a46ffd640 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9e3f20 0x5604bc9e6340 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdca16a7e605e824 server_cookie=92a2ff544bc86de2 in_seq=0 out_seq=0 2024-09-11T00:06:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.122+0000 7f5a2aff5640 10 client.16014 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.122+0000 7f5a2aff5640 1 -- 172.21.15.19:0/771661748 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x7f5a40056070 con 0x5604bc9e3f20 2024-09-11T00:06:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.123+0000 7f5a2aff5640 10 client.16014 handle_command_reply: tid=0 2024-09-11T00:06:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.123+0000 7f5a4f830740 1 client.16014 shutdown 2024-09-11T00:06:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.129+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 msgr2=0x5604bc969ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.129+0000 7f5a4f830740 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc969ca0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a400022f0 tx=0x7f5a400346c0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.130+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 shutdown_connections 2024-09-11T00:06:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.130+0000 7f5a4f830740 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5604bc9e3f20 0x5604bc9e6340 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.130+0000 7f5a4f830740 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604bc966d30 0x5604bc969ca0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.130+0000 7f5a4f830740 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604bc95ada0 0x5604bc96f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.130+0000 7f5a4f830740 1 --2- 172.21.15.19:0/771661748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604bc95a480 0x5604bc96ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.130+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 >> 172.21.15.19:0/771661748 conn(0x5604bc9582b0 msgr2=0x5604bc965050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.131+0000 7f5a2aff5640 0 client.16014 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:06:34.141 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:06:34.141 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:06:34.141 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "b25bf178-3e8c-4709-8b4b-03638eecafc8", 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:34.142 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:34.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:34.144 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:34.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:06:34.146 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:06:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.138+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 shutdown_connections 2024-09-11T00:06:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.138+0000 7f5a4f830740 1 -- 172.21.15.19:0/771661748 wait complete. 2024-09-11T00:06:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.138+0000 7f5a4f830740 20 client.16014 trim_cache size 0 max 16384 2024-09-11T00:06:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.139+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5a300b5560 msgr2=0x7f5a300b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.139+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5a300b5560 0x7f5a300b7a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c005c40 tx=0x7f5a3c031400 comp rx=0 tx=0).stop 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a530 msgr2=0x7f5a481a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a530 0x7f5a481a8660 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ca30 tx=0x7f5a3800cef0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 shutdown_connections 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4811c0a0 0x7f5a481ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5a300b5560 0x7f5a300b7a20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a4810a530 0x7f5a481a8660 secure :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ca30 tx=0x7f5a3800cef0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 --2- 172.21.15.19:0/2873925805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a4810a150 0x7f5a481a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.140+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 >> 172.21.15.19:0/2873925805 conn(0x7f5a4806dfc0 msgr2=0x7f5a4811c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.145+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 shutdown_connections 2024-09-11T00:06:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:06:34.146+0000 7f5a4d45b640 1 -- 172.21.15.19:0/2873925805 wait complete. 2024-09-11T00:06:34.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:33 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:33 smithi019 ceph-mon[30859]: pgmap v446: 97 pgs: 97 active+clean; 615 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.9 MiB/s wr, 427 op/s 2024-09-11T00:06:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:33 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:33 smithi131 ceph-mon[35491]: pgmap v446: 97 pgs: 97 active+clean; 615 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.9 MiB/s wr, 427 op/s 2024-09-11T00:06:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:33 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:33 smithi135 ceph-mon[35432]: pgmap v446: 97 pgs: 97 active+clean; 615 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.9 MiB/s wr, 427 op/s 2024-09-11T00:06:35.267 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:34 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:06:35.268 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:34 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:35.271 INFO:tasks.cephfs.filesystem:scrub status for tag:b25bf178-3e8c-4709-8b4b-03638eecafc8 - {'path': '/', 'tag': 'b25bf178-3e8c-4709-8b4b-03638eecafc8', 'options': 'recursive,force'} 2024-09-11T00:06:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:34 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:06:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:34 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:35.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:34 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:06:35.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:34 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:35 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:06:36.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:35 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:35 smithi019 ceph-mon[30859]: pgmap v447: 97 pgs: 97 active+clean; 603 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-09-11T00:06:36.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:35 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:06:36.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:35 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:35 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:06:36.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:35 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:35 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:06:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:35 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:35 smithi131 ceph-mon[35491]: pgmap v447: 97 pgs: 97 active+clean; 603 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-09-11T00:06:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:35 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:06:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:35 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:35 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:06:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:35 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:35 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:06:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:35 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:35 smithi135 ceph-mon[35432]: pgmap v447: 97 pgs: 97 active+clean; 603 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-09-11T00:06:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:35 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:06:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:35 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:35 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:06:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:35 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:38.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:37 smithi019 ceph-mon[30859]: pgmap v448: 97 pgs: 97 active+clean; 595 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 235 op/s 2024-09-11T00:06:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:37 smithi131 ceph-mon[35491]: pgmap v448: 97 pgs: 97 active+clean; 595 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 235 op/s 2024-09-11T00:06:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:37 smithi135 ceph-mon[35432]: pgmap v448: 97 pgs: 97 active+clean; 595 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 235 op/s 2024-09-11T00:06:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:39 smithi019 ceph-mon[30859]: pgmap v449: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 300 op/s 2024-09-11T00:06:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:39 smithi131 ceph-mon[35491]: pgmap v449: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 300 op/s 2024-09-11T00:06:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:39 smithi135 ceph-mon[35432]: pgmap v449: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 300 op/s 2024-09-11T00:06:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:41 smithi019 ceph-mon[30859]: pgmap v450: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2024-09-11T00:06:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:41 smithi131 ceph-mon[35491]: pgmap v450: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2024-09-11T00:06:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:41 smithi135 ceph-mon[35432]: pgmap v450: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2024-09-11T00:06:43.115 INFO:tasks.workunit.client.0.smithi019.stdout: 106 513897 61 344224 161 293076 241 2024-09-11T00:06:44.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:43 smithi019 ceph-mon[30859]: pgmap v451: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2024-09-11T00:06:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:43 smithi131 ceph-mon[35491]: pgmap v451: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2024-09-11T00:06:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:43 smithi135 ceph-mon[35432]: pgmap v451: 97 pgs: 97 active+clean; 594 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2024-09-11T00:06:46.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:45 smithi019 ceph-mon[30859]: pgmap v452: 97 pgs: 97 active+clean; 607 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 490 op/s 2024-09-11T00:06:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:45 smithi131 ceph-mon[35491]: pgmap v452: 97 pgs: 97 active+clean; 607 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 490 op/s 2024-09-11T00:06:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:45 smithi135 ceph-mon[35432]: pgmap v452: 97 pgs: 97 active+clean; 607 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 490 op/s 2024-09-11T00:06:48.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:47 smithi019 ceph-mon[30859]: pgmap v453: 97 pgs: 97 active+clean; 645 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.6 MiB/s wr, 768 op/s 2024-09-11T00:06:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:47 smithi131 ceph-mon[35491]: pgmap v453: 97 pgs: 97 active+clean; 645 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.6 MiB/s wr, 768 op/s 2024-09-11T00:06:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:47 smithi135 ceph-mon[35432]: pgmap v453: 97 pgs: 97 active+clean; 645 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.6 MiB/s wr, 768 op/s 2024-09-11T00:06:50.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:50 smithi019 ceph-mon[30859]: pgmap v454: 97 pgs: 97 active+clean; 661 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.7 MiB/s wr, 920 op/s 2024-09-11T00:06:50.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:50 smithi131 ceph-mon[35491]: pgmap v454: 97 pgs: 97 active+clean; 661 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.7 MiB/s wr, 920 op/s 2024-09-11T00:06:50.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:50 smithi135 ceph-mon[35432]: pgmap v454: 97 pgs: 97 active+clean; 661 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.7 MiB/s wr, 920 op/s 2024-09-11T00:06:52.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:52 smithi019 ceph-mon[30859]: pgmap v455: 97 pgs: 97 active+clean; 666 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 911 op/s 2024-09-11T00:06:52.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:52 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:52 smithi131 ceph-mon[35491]: pgmap v455: 97 pgs: 97 active+clean; 666 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 911 op/s 2024-09-11T00:06:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:52 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:52.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:52 smithi135 ceph-mon[35432]: pgmap v455: 97 pgs: 97 active+clean; 666 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 911 op/s 2024-09-11T00:06:52.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:52 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:06:53.115 INFO:tasks.workunit.client.0.smithi019.stdout: 106 3934 1 2697 2 1511 2 2024-09-11T00:06:54.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:54 smithi019 ceph-mon[30859]: pgmap v456: 97 pgs: 97 active+clean; 649 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 956 op/s 2024-09-11T00:06:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:54 smithi131 ceph-mon[35491]: pgmap v456: 97 pgs: 97 active+clean; 649 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 956 op/s 2024-09-11T00:06:54.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:54 smithi135 ceph-mon[35432]: pgmap v456: 97 pgs: 97 active+clean; 649 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 956 op/s 2024-09-11T00:06:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:56 smithi019 ceph-mon[30859]: pgmap v457: 97 pgs: 97 active+clean; 645 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.7 MiB/s wr, 923 op/s 2024-09-11T00:06:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:56 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:06:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:56 smithi131 ceph-mon[35491]: pgmap v457: 97 pgs: 97 active+clean; 645 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.7 MiB/s wr, 923 op/s 2024-09-11T00:06:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:56 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:06:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:56 smithi135 ceph-mon[35432]: pgmap v457: 97 pgs: 97 active+clean; 645 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.7 MiB/s wr, 923 op/s 2024-09-11T00:06:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:56 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:06:57.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:57 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:57.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:57 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:57.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:57 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:58 smithi131 ceph-mon[35491]: pgmap v458: 97 pgs: 97 active+clean; 639 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.8 MiB/s wr, 889 op/s 2024-09-11T00:06:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:06:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:06:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:06:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:06:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:58 smithi135 ceph-mon[35432]: pgmap v458: 97 pgs: 97 active+clean; 639 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.8 MiB/s wr, 889 op/s 2024-09-11T00:06:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:06:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:06:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:06:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:06:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:58 smithi019 ceph-mon[30859]: pgmap v458: 97 pgs: 97 active+clean; 639 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.8 MiB/s wr, 889 op/s 2024-09-11T00:06:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:06:58.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:06:58.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:06:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:07:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:00 smithi131 ceph-mon[35491]: pgmap v459: 97 pgs: 97 active+clean; 646 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 748 op/s 2024-09-11T00:07:00.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:00 smithi135 ceph-mon[35432]: pgmap v459: 97 pgs: 97 active+clean; 646 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 748 op/s 2024-09-11T00:07:00.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:00 smithi019 ceph-mon[30859]: pgmap v459: 97 pgs: 97 active+clean; 646 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 748 op/s 2024-09-11T00:07:02.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:02 smithi131 ceph-mon[35491]: pgmap v460: 97 pgs: 97 active+clean; 650 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 595 op/s 2024-09-11T00:07:02.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:02 smithi135 ceph-mon[35432]: pgmap v460: 97 pgs: 97 active+clean; 650 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 595 op/s 2024-09-11T00:07:02.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:02 smithi019 ceph-mon[30859]: pgmap v460: 97 pgs: 97 active+clean; 650 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 595 op/s 2024-09-11T00:07:03.115 INFO:tasks.workunit.client.0.smithi019.stdout: 108 11101 79 7288 72 8647 188 2024-09-11T00:07:04.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:04 smithi131 ceph-mon[35491]: pgmap v461: 97 pgs: 97 active+clean; 650 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 528 op/s 2024-09-11T00:07:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:04 smithi135 ceph-mon[35432]: pgmap v461: 97 pgs: 97 active+clean; 650 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 528 op/s 2024-09-11T00:07:04.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:04 smithi019 ceph-mon[30859]: pgmap v461: 97 pgs: 97 active+clean; 650 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 528 op/s 2024-09-11T00:07:05.272 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:07:05.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:05 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:07:05.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:05 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:07:05.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:05 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:07:05.548 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:06.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/953439057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 msgr2=0x7f3a5410cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/953439057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a5410cb10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009900 tx=0x7f3a4802a410 comp rx=0 tx=0).stop 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/953439057 shutdown_connections 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/953439057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410d0e0 0x7f3a5410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/953439057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a5410cb10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/953439057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54103b30 0x7f3a54103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/953439057 >> 172.21.15.19:0/953439057 conn(0x7f3a540fd700 msgr2=0x7f3a540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/953439057 shutdown_connections 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.083+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/953439057 wait complete. 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 Processor -- start 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 -- start start 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54103b30 0x7f3a54199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a54199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410d0e0 0x7f3a5419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54112d60 con 0x7f3a54104530 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54112be0 con 0x7f3a54103b30 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a5a3fc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54112ee0 con 0x7f3a5410d0e0 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a54199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.084+0000 7f3a537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a54199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58170/0 (socket says 172.21.15.19:58170) 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a537fe640 1 -- 172.21.15.19:0/1172859166 learned_addr learned my addr 172.21.15.19:0/1172859166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a53fff640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54103b30 0x7f3a54199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a537fe640 1 -- 172.21.15.19:0/1172859166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410d0e0 msgr2=0x7f3a5419eb10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a537fe640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410d0e0 0x7f3a5419eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a537fe640 1 -- 172.21.15.19:0/1172859166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54103b30 msgr2=0x7f3a54199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a537fe640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54103b30 0x7f3a54199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a537fe640 1 -- 172.21.15.19:0/1172859166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5419f2e0 con 0x7f3a54104530 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a537fe640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a54199770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006010 tx=0x7f3a480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a517fa640 1 -- 172.21.15.19:0/1172859166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4803f030 con 0x7f3a54104530 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a517fa640 1 -- 172.21.15.19:0/1172859166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a48003800 con 0x7f3a54104530 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5419f570 con 0x7f3a54104530 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a517fa640 1 -- 172.21.15.19:0/1172859166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48035070 con 0x7f3a54104530 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.085+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a541a5c90 con 0x7f3a54104530 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.088+0000 7f3a517fa640 1 -- 172.21.15.19:0/1172859166 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f3a48031b10 con 0x7f3a54104530 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 Processor -- start 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 -- start start 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a517fa640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a3c0b54d0 0x7f3a3c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 0x5587c1827480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c1833410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c1833950 0x5587c1835d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5587c179de50 con 0x5587c18279c0 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5587c178d280 con 0x5587c18270a0 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5587c1791090 con 0x5587c1833950 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a53fff640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a3c0b54d0 0x7f3a3c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a517fa640 1 -- 172.21.15.19:0/1172859166 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f3a48106970 con 0x7f3a54104530 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c1833410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c1833410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58182/0 (socket says 172.21.15.19:58182) 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a537fe640 1 -- 172.21.15.19:0/221728207 learned_addr learned my addr 172.21.15.19:0/221728207 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.089+0000 7f3a58999640 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 0x5587c1827480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a537fe640 1 -- 172.21.15.19:0/221728207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c1833950 msgr2=0x5587c1835d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a537fe640 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c1833950 0x5587c1835d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a537fe640 1 -- 172.21.15.19:0/221728207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 msgr2=0x5587c1827480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a537fe640 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 0x5587c1827480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a537fe640 1 -- 172.21.15.19:0/221728207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587c14eb650 con 0x5587c18279c0 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a53fff640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a3c0b54d0 0x7f3a3c0b7990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3a440058c0 tx=0x7f3a4400a4c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a537fe640 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c1833410 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3a48005ec0 tx=0x7f3a480ccca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e5c52894507655 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a3a7fc640 1 -- 172.21.15.19:0/221728207 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48049070 con 0x5587c18279c0 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a3a7fc640 1 -- 172.21.15.19:0/221728207 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a480cd510 con 0x5587c18279c0 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.090+0000 7f3a3a7fc640 1 -- 172.21.15.19:0/221728207 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a480d18f0 con 0x5587c18279c0 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/221728207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 msgr2=0x5587c1833410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c1833410 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3a48005ec0 tx=0x7f3a480ccca0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/221728207 shutdown_connections 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c1833950 0x5587c1835d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c1833410 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/221728207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 0x5587c1827480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/221728207 >> 172.21.15.19:0/221728207 conn(0x5587c1824ed0 msgr2=0x5587c1826070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/221728207 shutdown_connections 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/221728207 wait complete. 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.091+0000 7f3a5c7d1740 1 -- start start 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 1 Processor -- start 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 0x5587c1833280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18279c0 0x5587c18306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1830d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5587c15ee700 con 0x5587c1833950 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5587c1728110 con 0x5587c18270a0 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5587c1836390 con 0x5587c18279c0 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a5c7d1740 10 client.0 _ll_register_callbacks cb 0x5587c1741990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1830d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1830d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58188/0 (socket says 172.21.15.19:58188) 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 -- 172.21.15.19:0/1647069213 learned_addr learned my addr 172.21.15.19:0/1647069213 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a537fe640 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18279c0 0x5587c18306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 -- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18279c0 msgr2=0x5587c18306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18279c0 0x5587c18306d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 -- 172.21.15.19:0/1647069213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 msgr2=0x5587c1833280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 0x5587c1833280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 -- 172.21.15.19:0/1647069213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587c1755c40 con 0x5587c1833950 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a537fe640 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18279c0 0x5587c18306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a58999640 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1830d50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00f930 tx=0x7f3a4c00fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9d9792681e7bfd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.092+0000 7f3a337fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a337fe640 1 -- 172.21.15.19:0/1647069213 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c015070 con 0x5587c1833950 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a337fe640 1 -- 172.21.15.19:0/1647069213 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f3a4c00ecc0 con 0x5587c1833950 2024-09-11T00:07:06.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a480cd510 con 0x5587c1833950 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a337fe640 1 -- 172.21.15.19:0/1647069213 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a4c01a460 con 0x5587c1833950 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 10 client.16026 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5587c1841c90 con 0x5587c1833950 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a337fe640 1 -- 172.21.15.19:0/1647069213 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a480cd510 con 0x5587c1833950 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a337fe640 1 -- 172.21.15.19:0/1647069213 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f3a4c00f040 con 0x5587c1833950 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 10 client.16026 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 20 client.16026 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c1843140 0x5587c1845570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 4 client.16026 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.093+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587c179fda0 con 0x5587c1843140 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.094+0000 7f3a53fff640 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c1843140 0x5587c1845570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.094+0000 7f3a53fff640 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c1843140 0x5587c1845570 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d33340dac704396f server_cookie=66e3c2744a5a085 in_seq=0 out_seq=0 2024-09-11T00:07:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.094+0000 7f3a337fe640 10 client.16026 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.095+0000 7f3a337fe640 1 -- 172.21.15.19:0/1647069213 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5587c179fda0 con 0x5587c1843140 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.095+0000 7f3a337fe640 10 client.16026 handle_command_reply: tid=0 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 client.16026 shutdown 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 msgr2=0x5587c1830d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1830d50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00f930 tx=0x7f3a4c00fdf0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 shutdown_connections 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c1843140 0x5587c1845570 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1830d50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a337fe640 0 client.16026 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18279c0 0x5587c18306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/1647069213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18270a0 0x5587c1833280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 >> 172.21.15.19:0/1647069213 conn(0x5587c1824ed0 msgr2=0x5587c182aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 shutdown_connections 2024-09-11T00:07:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/1647069213 wait complete. 2024-09-11T00:07:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.096+0000 7f3a5c7d1740 20 client.16026 trim_cache size 0 max 16384 2024-09-11T00:07:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.123+0000 7f3a5c7d1740 1 Processor -- start 2024-09-11T00:07:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.123+0000 7f3a5c7d1740 1 -- start start 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c1830d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c183f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c1833950 0x5587c1832410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541b0dc0 con 0x5587c18279c0 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541ae660 con 0x5587c1833950 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541ac4b0 con 0x5587c18270a0 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c183f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c183f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58192/0 (socket says 172.21.15.19:58192) 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 -- 172.21.15.19:0/742290780 learned_addr learned my addr 172.21.15.19:0/742290780 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a53fff640 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c1830d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a58999640 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c1833950 0x5587c1832410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 -- 172.21.15.19:0/742290780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 msgr2=0x5587c1830d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c1830d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 -- 172.21.15.19:0/742290780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c1833950 msgr2=0x5587c1832410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c1833950 0x5587c1832410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 -- 172.21.15.19:0/742290780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587c1845bf0 con 0x5587c18279c0 2024-09-11T00:07:06.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.124+0000 7f3a537fe640 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c183f4f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3a48031440 tx=0x7f3a480cc680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20ce63d118e8875 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:06.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.125+0000 7f3a39ffb640 1 -- 172.21.15.19:0/742290780 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48049040 con 0x5587c18279c0 2024-09-11T00:07:06.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.125+0000 7f3a39ffb640 1 -- 172.21.15.19:0/742290780 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a480d63a0 con 0x5587c18279c0 2024-09-11T00:07:06.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.125+0000 7f3a39ffb640 1 -- 172.21.15.19:0/742290780 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48104360 con 0x5587c18279c0 2024-09-11T00:07:06.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.125+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/742290780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 msgr2=0x5587c183f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.125+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c183f4f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3a48031440 tx=0x7f3a480cc680 comp rx=0 tx=0).stop 2024-09-11T00:07:06.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/742290780 shutdown_connections 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c1833950 0x5587c1832410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c18279c0 0x5587c183f4f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/742290780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c1830d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/742290780 >> 172.21.15.19:0/742290780 conn(0x5587c1824ed0 msgr2=0x5587c1831d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/742290780 shutdown_connections 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/742290780 wait complete. 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 -- start start 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.126+0000 7f3a5c7d1740 1 Processor -- start 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c184b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18279c0 0x5587c184b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a5c7d1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1849e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541acb20 con 0x5587c1833950 2024-09-11T00:07:06.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541adf90 con 0x5587c18279c0 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a5c7d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541ad1f0 con 0x5587c18270a0 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a5c7d1740 10 client.0 _ll_register_callbacks cb 0x7f3a4c007890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1849e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1849e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58194/0 (socket says 172.21.15.19:58194) 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 -- 172.21.15.19:0/919658391 learned_addr learned my addr 172.21.15.19:0/919658391 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a53fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c184b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a537fe640 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18279c0 0x5587c184b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 -- 172.21.15.19:0/919658391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 msgr2=0x5587c184b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c184b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 -- 172.21.15.19:0/919658391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18279c0 msgr2=0x5587c184b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18279c0 0x5587c184b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 -- 172.21.15.19:0/919658391 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587c184a6a0 con 0x5587c1833950 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a537fe640 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18279c0 0x5587c184b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:06.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a58999640 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1849e70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c007e80 tx=0x7f3a4c004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf52958b3068c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.127+0000 7f3a337fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.128+0000 7f3a337fe640 1 -- 172.21.15.19:0/919658391 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c015070 con 0x5587c1833950 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.128+0000 7f3a337fe640 1 -- 172.21.15.19:0/919658391 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f3a4c004af0 con 0x5587c1833950 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.128+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a480d63a0 con 0x5587c1833950 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.128+0000 7f3a337fe640 1 -- 172.21.15.19:0/919658391 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a4c029040 con 0x5587c1833950 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.128+0000 7f3a5c7d1740 10 client.16032 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.128+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5587c18b4bf0 con 0x5587c1833950 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.128+0000 7f3a337fe640 1 -- 172.21.15.19:0/919658391 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a480d63a0 con 0x5587c1833950 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a337fe640 1 -- 172.21.15.19:0/919658391 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f3a4c00ef00 con 0x5587c1833950 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a5c7d1740 10 client.16032 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a5c7d1740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a5c7d1740 20 client.16032 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c18b5320 0x5587c18b7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a5c7d1740 4 client.16032 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:07:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5587c179b850 con 0x5587c18b5320 2024-09-11T00:07:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a53fff640 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c18b5320 0x5587c18b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a337fe640 10 client.16032 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.129+0000 7f3a53fff640 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c18b5320 0x5587c18b7740 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19326c6c960f385c server_cookie=18f3eee189c0ccee in_seq=0 out_seq=0 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a337fe640 1 -- 172.21.15.19:0/919658391 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x5587c179b850 con 0x5587c18b5320 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a337fe640 10 client.16032 handle_command_reply: tid=0 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 client.16032 shutdown 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 msgr2=0x5587c1849e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1849e70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c007e80 tx=0x7f3a4c004980 comp rx=0 tx=0).stop 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 shutdown_connections 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5587c18b5320 0x5587c18b7740 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587c1833950 0x5587c1849e70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587c18279c0 0x5587c184b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 --2- 172.21.15.19:0/919658391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587c18270a0 0x5587c184b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 >> 172.21.15.19:0/919658391 conn(0x5587c1824ed0 msgr2=0x5587c1825bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a337fe640 0 client.16032 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 shutdown_connections 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 1 -- 172.21.15.19:0/919658391 wait complete. 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.130+0000 7f3a5c7d1740 20 client.16032 trim_cache size 0 max 16384 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:07:06.136 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:06.137 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:06.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:06.139 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:07:06.140 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a3c0b54d0 msgr2=0x7f3a3c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a3c0b54d0 0x7f3a3c0b7990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3a440058c0 tx=0x7f3a4400a4c0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 msgr2=0x7f3a54199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a54199770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006010 tx=0x7f3a480042f0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 shutdown_connections 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410d0e0 0x7f3a5419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f3a3c0b54d0 0x7f3a3c0b7990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a54104530 0x7f3a54199770 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 --2- 172.21.15.19:0/1172859166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54103b30 0x7f3a54199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 >> 172.21.15.19:0/1172859166 conn(0x7f3a540fd700 msgr2=0x7f3a540fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:06.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 shutdown_connections 2024-09-11T00:07:06.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:06.131+0000 7f3a5a3fc640 1 -- 172.21.15.19:0/1172859166 wait complete. 2024-09-11T00:07:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:06 smithi019 ceph-mon[30859]: pgmap v462: 97 pgs: 97 active+clean; 655 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 434 op/s 2024-09-11T00:07:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:06 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:07:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:06 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:07:06.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:06 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:07:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:06 smithi131 ceph-mon[35491]: pgmap v462: 97 pgs: 97 active+clean; 655 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 434 op/s 2024-09-11T00:07:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:06 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:07:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:06 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:07:06.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:06 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:07:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:06 smithi135 ceph-mon[35432]: pgmap v462: 97 pgs: 97 active+clean; 655 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 434 op/s 2024-09-11T00:07:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:06 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:07:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:06 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:07:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:06 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:07:07.131 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:07:07.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:07:07.454 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 -- 172.21.15.19:0/3688055768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 msgr2=0x7fdc9010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 --2- 172.21.15.19:0/3688055768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc9010f550 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ca0 tx=0x7fdc8802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 -- 172.21.15.19:0/3688055768 shutdown_connections 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 --2- 172.21.15.19:0/3688055768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc9010f550 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 --2- 172.21.15.19:0/3688055768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc90104590 0x7fdc9010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 --2- 172.21.15.19:0/3688055768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc90103b90 0x7fdc90103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 -- 172.21.15.19:0/3688055768 >> 172.21.15.19:0/3688055768 conn(0x7fdc900fd700 msgr2=0x7fdc900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 -- 172.21.15.19:0/3688055768 shutdown_connections 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 -- 172.21.15.19:0/3688055768 wait complete. 2024-09-11T00:07:08.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.002+0000 7fdc9634c640 1 Processor -- start 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc9634c640 1 -- start start 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc9634c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc90103b90 0x7fdc90101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc9634c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc90104590 0x7fdc90101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc9634c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc90102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc9634c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdc90112da0 con 0x7fdc9010d140 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc9634c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdc90112c20 con 0x7fdc90103b90 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc9634c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc90112f20 con 0x7fdc90104590 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc948e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc90102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc90104590 0x7fdc90101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc948e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc90102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58202/0 (socket says 172.21.15.19:58202) 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc948e9640 1 -- 172.21.15.19:0/1162287248 learned_addr learned my addr 172.21.15.19:0/1162287248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.003+0000 7fdc8ffff640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc90103b90 0x7fdc90101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:08.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8f7fe640 1 -- 172.21.15.19:0/1162287248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc90103b90 msgr2=0x7fdc90101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8f7fe640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc90103b90 0x7fdc90101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8f7fe640 1 -- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 msgr2=0x7fdc90102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8f7fe640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc90102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8f7fe640 1 -- 172.21.15.19:0/1162287248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc901a76f0 con 0x7fdc90104590 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc948e9640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc90102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8f7fe640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc90104590 0x7fdc90101f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400b3f0 tx=0x7fdc8400b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8d7fa640 1 -- 172.21.15.19:0/1162287248 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84015020 con 0x7fdc90104590 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc901a79e0 con 0x7fdc90104590 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8d7fa640 1 -- 172.21.15.19:0/1162287248 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc84011ce0 con 0x7fdc90104590 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc8d7fa640 1 -- 172.21.15.19:0/1162287248 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84010d80 con 0x7fdc90104590 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.004+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc901a7f20 con 0x7fdc90104590 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.005+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc90103f70 con 0x7fdc90104590 2024-09-11T00:07:08.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.007+0000 7fdc8d7fa640 1 -- 172.21.15.19:0/1162287248 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fdc84011830 con 0x7fdc90104590 2024-09-11T00:07:08.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.008+0000 7fdc8d7fa640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdc780b5450 0x7fdc780b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:08.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.008+0000 7fdc8ffff640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdc780b5450 0x7fdc780b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:08.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.008+0000 7fdc8d7fa640 1 -- 172.21.15.19:0/1162287248 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fdc840e5ea0 con 0x7fdc90104590 2024-09-11T00:07:08.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.008+0000 7fdc8ffff640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdc780b5450 0x7fdc780b7910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005d00 tx=0x7fdc8000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:08.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.015+0000 7fdc8d7fa640 1 -- 172.21.15.19:0/1162287248 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdc8401f020 con 0x7fdc90104590 2024-09-11T00:07:08.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.250+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc90102d10 con 0x7fdc90104590 2024-09-11T00:07:08.251 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:08 smithi019 ceph-mon[30859]: pgmap v463: 97 pgs: 97 active+clean; 654 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 401 op/s 2024-09-11T00:07:08.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.251+0000 7fdc8d7fa640 1 -- 172.21.15.19:0/1162287248 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11916 (secure 0 0 0) 0x7fdc840aca40 con 0x7fdc90104590 2024-09-11T00:07:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:07:08.253 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":32,"btime":"2024-09-11T00:07:05:032481+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:07:04.671200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:07:08.253 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 32 2024-09-11T00:07:08.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdc780b5450 msgr2=0x7fdc780b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdc780b5450 0x7fdc780b7910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005d00 tx=0x7fdc8000b410 comp rx=0 tx=0).stop 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc90104590 msgr2=0x7fdc90101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc90104590 0x7fdc90101f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400b3f0 tx=0x7fdc8400b8b0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 shutdown_connections 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdc780b5450 0x7fdc780b7910 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9010d140 0x7fdc90102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc90104590 0x7fdc90101f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 --2- 172.21.15.19:0/1162287248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc90103b90 0x7fdc90101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 >> 172.21.15.19:0/1162287248 conn(0x7fdc900fd700 msgr2=0x7fdc900fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 shutdown_connections 2024-09-11T00:07:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:08.254+0000 7fdc9634c640 1 -- 172.21.15.19:0/1162287248 wait complete. 2024-09-11T00:07:08.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:08 smithi131 ceph-mon[35491]: pgmap v463: 97 pgs: 97 active+clean; 654 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 401 op/s 2024-09-11T00:07:08.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:08 smithi135 ceph-mon[35432]: pgmap v463: 97 pgs: 97 active+clean; 654 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 401 op/s 2024-09-11T00:07:09.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:07:09.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:09 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1162287248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:09.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:09 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1162287248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:09.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:09 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1162287248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:09.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 -- 172.21.15.19:0/1210048961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9941076e0 msgr2=0x7fe994107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 --2- 172.21.15.19:0/1210048961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9941076e0 0x7fe994107b20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009900 tx=0x7fe97c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 -- 172.21.15.19:0/1210048961 shutdown_connections 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 --2- 172.21.15.19:0/1210048961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe994108060 0x7fe99410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 --2- 172.21.15.19:0/1210048961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9941076e0 0x7fe994107b20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 --2- 172.21.15.19:0/1210048961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe994101cd0 0x7fe9941020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 -- 172.21.15.19:0/1210048961 >> 172.21.15.19:0/1210048961 conn(0x7fe9940fd700 msgr2=0x7fe9940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 -- 172.21.15.19:0/1210048961 shutdown_connections 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.823+0000 7fe999e13640 1 -- 172.21.15.19:0/1210048961 wait complete. 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 Processor -- start 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 -- start start 2024-09-11T00:07:09.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe994101cd0 0x7fe994199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9941076e0 0x7fe994199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe994108060 0x7fe99419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111cb0 con 0x7fe994101cd0 2024-09-11T00:07:09.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111b30 con 0x7fe9941076e0 2024-09-11T00:07:09.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.824+0000 7fe999e13640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111e30 con 0x7fe994108060 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe994101cd0 0x7fe994199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe994101cd0 0x7fe994199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58220/0 (socket says 172.21.15.19:58220) 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 -- 172.21.15.19:0/3729130386 learned_addr learned my addr 172.21.15.19:0/3729130386 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe993fff640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe994108060 0x7fe99419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe98bfff640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9941076e0 0x7fe994199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 -- 172.21.15.19:0/3729130386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe994108060 msgr2=0x7fe99419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe994108060 0x7fe99419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 -- 172.21.15.19:0/3729130386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9941076e0 msgr2=0x7fe994199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9941076e0 0x7fe994199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 -- 172.21.15.19:0/3729130386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99419f3d0 con 0x7fe994101cd0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9937fe640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe994101cd0 0x7fe994199320 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe98400ea60 tx=0x7fe98400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9917fa640 1 -- 172.21.15.19:0/3729130386 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98400cde0 con 0x7fe994101cd0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9917fa640 1 -- 172.21.15.19:0/3729130386 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9840035f0 con 0x7fe994101cd0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99419f6c0 con 0x7fe994101cd0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe9917fa640 1 -- 172.21.15.19:0/3729130386 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984010690 con 0x7fe994101cd0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.825+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9941a5f50 con 0x7fe994101cd0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe9917fa640 1 -- 172.21.15.19:0/3729130386 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fe984004000 con 0x7fe994101cd0 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 Processor -- start 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 -- start start 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed23c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed26580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cd6ec89ea0 con 0x55cd6ed24190 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cd6ec792d0 con 0x55cd6ed134d0 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.828+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cd6ec7d0e0 con 0x55cd6ed13df0 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe9937fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed23c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed26580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe993fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed26580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58228/0 (socket says 172.21.15.19:58228) 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 -- 172.21.15.19:0/2724954559 learned_addr learned my addr 172.21.15.19:0/2724954559 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe9917fa640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9800b54d0 0x7fe9800b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 -- 172.21.15.19:0/2724954559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 msgr2=0x55cd6ed23c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed23c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 -- 172.21.15.19:0/2724954559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 msgr2=0x55cd6ed138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 -- 172.21.15.19:0/2724954559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd6e9d7650 con 0x55cd6ed24190 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe993fff640 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe993fff640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9800b54d0 0x7fe9800b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe9917fa640 1 -- 172.21.15.19:0/3729130386 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe9840e6170 con 0x7fe994101cd0 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed26580 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe97c033000 tx=0x7fe97c032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d4771ed6620e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.829+0000 7fe989ffb640 1 -- 172.21.15.19:0/2724954559 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c035040 con 0x55cd6ed24190 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe989ffb640 1 -- 172.21.15.19:0/2724954559 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe97c004030 con 0x55cd6ed24190 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe989ffb640 1 -- 172.21.15.19:0/2724954559 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0054f0 con 0x55cd6ed24190 2024-09-11T00:07:09.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2724954559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 msgr2=0x55cd6ed26580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed26580 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe97c033000 tx=0x7fe97c032b20 comp rx=0 tx=0).stop 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe993fff640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9800b54d0 0x7fe9800b7990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe98c005fd0 tx=0x7fe98c004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2724954559 shutdown_connections 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed26580 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed23c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2724954559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.830+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2724954559 >> 172.21.15.19:0/2724954559 conn(0x55cd6ed11300 msgr2=0x55cd6ed124a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.831+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2724954559 shutdown_connections 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.831+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2724954559 wait complete. 2024-09-11T00:07:09.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.831+0000 7fe99c1e8740 1 -- start start 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.831+0000 7fe99c1e8740 1 Processor -- start 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.831+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed23a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed21480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cd6eada700 con 0x55cd6ed24190 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cd6ec14160 con 0x55cd6ed134d0 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cd6ed26de0 con 0x55cd6ed13df0 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe99c1e8740 10 client.0 _ll_register_callbacks cb 0x55cd6ec2d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe993fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed21480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38846/0 (socket says 172.21.15.19:38846) 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 -- 172.21.15.19:0/2021952864 learned_addr learned my addr 172.21.15.19:0/2021952864 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe9937fe640 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed23a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 -- 172.21.15.19:0/2021952864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 msgr2=0x55cd6ed23a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed23a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 -- 172.21.15.19:0/2021952864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 msgr2=0x55cd6ed21480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed21480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 -- 172.21.15.19:0/2021952864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd6ec41c90 con 0x55cd6ed13df0 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe993fff640 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed21480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe97c005940 tx=0x7fe97c005050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be787e6eb78a29a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.832+0000 7fe972ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe972ffd640 1 -- 172.21.15.19:0/2021952864 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c035070 con 0x55cd6ed13df0 2024-09-11T00:07:09.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe972ffd640 1 -- 172.21.15.19:0/2021952864 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe97c0043f0 con 0x55cd6ed13df0 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe97c004030 con 0x55cd6ed13df0 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe972ffd640 1 -- 172.21.15.19:0/2021952864 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe97c005270 con 0x55cd6ed13df0 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 10 client.25645 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cd6ed32710 con 0x55cd6ed13df0 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe972ffd640 1 -- 172.21.15.19:0/2021952864 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe97c004030 con 0x55cd6ed13df0 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe972ffd640 1 -- 172.21.15.19:0/2021952864 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fe97c004a20 con 0x55cd6ed13df0 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 10 client.25645 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 10 client.25645 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 20 client.25645 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6ed33a60 0x55cd6ed35e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 4 client.25645 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:09.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd6ec8bdf0 con 0x55cd6ed33a60 2024-09-11T00:07:09.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.833+0000 7fe9937fe640 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6ed33a60 0x55cd6ed35e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.834+0000 7fe9937fe640 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6ed33a60 0x55cd6ed35e50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e927a1faad6c2cc server_cookie=451b17a456ef0ee3 in_seq=0 out_seq=0 2024-09-11T00:07:09.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.834+0000 7fe972ffd640 10 client.25645 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:07:09.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.836+0000 7fe972ffd640 1 -- 172.21.15.19:0/2021952864 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd6ec8bdf0 con 0x55cd6ed33a60 2024-09-11T00:07:09.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.836+0000 7fe972ffd640 10 client.25645 handle_command_reply: tid=0 2024-09-11T00:07:09.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 client.25645 shutdown 2024-09-11T00:07:09.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 msgr2=0x55cd6ed20ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe97c005940 tx=0x7fe97c005050 comp rx=0 tx=0).stop 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 shutdown_connections 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6ed33a60 0x55cd6ed35e50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed24190 0x55cd6ed21480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20ea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe972ffd640 0 client.25645 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2021952864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed134d0 0x55cd6ed23a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 >> 172.21.15.19:0/2021952864 conn(0x55cd6ed11300 msgr2=0x55cd6ed16e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 shutdown_connections 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2021952864 wait complete. 2024-09-11T00:07:09.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.837+0000 7fe99c1e8740 20 client.25645 trim_cache size 0 max 16384 2024-09-11T00:07:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 Processor -- start 2024-09-11T00:07:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 -- start start 2024-09-11T00:07:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed134d0 0x55cd6ed30040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed1f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941aec70 con 0x55cd6ed134d0 2024-09-11T00:07:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ac510 con 0x55cd6ed24190 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941aa380 con 0x55cd6ed13df0 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe9937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed134d0 0x55cd6ed30040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe9937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed134d0 0x55cd6ed30040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58244/0 (socket says 172.21.15.19:58244) 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe9937fe640 1 -- 172.21.15.19:0/2049196891 learned_addr learned my addr 172.21.15.19:0/2049196891 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.851+0000 7fe993fff640 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed1f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe98bfff640 1 -- 172.21.15.19:0/2049196891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 msgr2=0x55cd6ed1f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed1f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe98bfff640 1 -- 172.21.15.19:0/2049196891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed134d0 msgr2=0x55cd6ed30040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed134d0 0x55cd6ed30040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe98bfff640 1 -- 172.21.15.19:0/2049196891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd6ed1f3a0 con 0x55cd6ed13df0 2024-09-11T00:07:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe9937fe640 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed134d0 0x55cd6ed30040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe98bfff640 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe97c02a910 tx=0x7fe97c031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e3746b58529b19c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe9897fa640 1 -- 172.21.15.19:0/2049196891 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c035040 con 0x55cd6ed13df0 2024-09-11T00:07:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe9897fa640 1 -- 172.21.15.19:0/2049196891 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe97c003640 con 0x55cd6ed13df0 2024-09-11T00:07:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.852+0000 7fe9897fa640 1 -- 172.21.15.19:0/2049196891 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0317a0 con 0x55cd6ed13df0 2024-09-11T00:07:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2049196891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 msgr2=0x55cd6ed20390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe97c02a910 tx=0x7fe97c031400 comp rx=0 tx=0).stop 2024-09-11T00:07:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2049196891 shutdown_connections 2024-09-11T00:07:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed1f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed13df0 0x55cd6ed20390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/2049196891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed134d0 0x55cd6ed30040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2049196891 >> 172.21.15.19:0/2049196891 conn(0x55cd6ed11300 msgr2=0x55cd6ed25f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2049196891 shutdown_connections 2024-09-11T00:07:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 -- 172.21.15.19:0/2049196891 wait complete. 2024-09-11T00:07:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.853+0000 7fe99c1e8740 1 -- start start 2024-09-11T00:07:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 1 Processor -- start 2024-09-11T00:07:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed134d0 0x55cd6ed2c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed13df0 0x55cd6ed2c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed29070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941aa9d0 con 0x55cd6ed13df0 2024-09-11T00:07:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941abe40 con 0x55cd6ed24190 2024-09-11T00:07:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ab0a0 con 0x55cd6ed134d0 2024-09-11T00:07:09.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe99c1e8740 10 client.0 _ll_register_callbacks cb 0x7fe98c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:09.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed13df0 0x55cd6ed2c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed13df0 0x55cd6ed2c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58252/0 (socket says 172.21.15.19:58252) 2024-09-11T00:07:09.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe98bfff640 1 -- 172.21.15.19:0/3192536978 learned_addr learned my addr 172.21.15.19:0/3192536978 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe9937fe640 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed134d0 0x55cd6ed2c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.854+0000 7fe993fff640 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed29070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe9937fe640 1 -- 172.21.15.19:0/3192536978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 msgr2=0x55cd6ed29070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe9937fe640 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed29070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe9937fe640 1 -- 172.21.15.19:0/3192536978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed13df0 msgr2=0x55cd6ed2c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe9937fe640 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed13df0 0x55cd6ed2c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe9937fe640 1 -- 172.21.15.19:0/3192536978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd6ed298a0 con 0x55cd6ed134d0 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe9937fe640 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed134d0 0x55cd6ed2c330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c760 tx=0x7fe984009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ee4e672703023d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe972ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:07:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe972ffd640 1 -- 172.21.15.19:0/3192536978 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840a8510 con 0x55cd6ed134d0 2024-09-11T00:07:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe972ffd640 1 -- 172.21.15.19:0/3192536978 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fe9840e3bc0 con 0x55cd6ed134d0 2024-09-11T00:07:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe97c003640 con 0x55cd6ed134d0 2024-09-11T00:07:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe972ffd640 1 -- 172.21.15.19:0/3192536978 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe9840abde0 con 0x55cd6ed134d0 2024-09-11T00:07:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe99c1e8740 10 client.25651 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.855+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cd6eda11b0 con 0x55cd6ed134d0 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe972ffd640 1 -- 172.21.15.19:0/3192536978 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe97c003640 con 0x55cd6ed134d0 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe972ffd640 1 -- 172.21.15.19:0/3192536978 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fe9840a88e0 con 0x55cd6ed134d0 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe99c1e8740 10 client.25651 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe99c1e8740 10 client.25651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe99c1e8740 20 client.25651 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6eda1910 0x55cd6eda3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe99c1e8740 4 client.25651 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd6ec878a0 con 0x55cd6eda1910 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe98bfff640 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6eda1910 0x55cd6eda3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe98bfff640 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6eda1910 0x55cd6eda3d30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65a5c353b4dfe125 server_cookie=a3bc0f7b104b1fb2 in_seq=0 out_seq=0 2024-09-11T00:07:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.856+0000 7fe972ffd640 10 client.25651 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:07:09.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe972ffd640 1 -- 172.21.15.19:0/3192536978 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd6ec878a0 con 0x55cd6eda1910 2024-09-11T00:07:09.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe972ffd640 10 client.25651 handle_command_reply: tid=0 2024-09-11T00:07:09.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 client.25651 shutdown 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed134d0 msgr2=0x55cd6ed2c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed134d0 0x55cd6ed2c330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c760 tx=0x7fe984009310 comp rx=0 tx=0).stop 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 shutdown_connections 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd6eda1910 0x55cd6eda3d30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd6ed24190 0x55cd6ed29070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd6ed13df0 0x55cd6ed2c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe972ffd640 0 client.25651 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 --2- 172.21.15.19:0/3192536978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd6ed134d0 0x55cd6ed2c330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 >> 172.21.15.19:0/3192536978 conn(0x55cd6ed11300 msgr2=0x55cd6ed1f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 shutdown_connections 2024-09-11T00:07:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 1 -- 172.21.15.19:0/3192536978 wait complete. 2024-09-11T00:07:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.861+0000 7fe99c1e8740 20 client.25651 trim_cache size 0 max 16384 2024-09-11T00:07:09.870 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:07:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9800b54d0 msgr2=0x7fe9800b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9800b54d0 0x7fe9800b7990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe98c005fd0 tx=0x7fe98c004a40 comp rx=0 tx=0).stop 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe994101cd0 msgr2=0x7fe994199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe994101cd0 0x7fe994199320 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe98400ea60 tx=0x7fe98400ef20 comp rx=0 tx=0).stop 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 shutdown_connections 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe994108060 0x7fe99419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9941076e0 0x7fe994199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9800b54d0 0x7fe9800b7990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 --2- 172.21.15.19:0/3729130386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe994101cd0 0x7fe994199320 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 >> 172.21.15.19:0/3729130386 conn(0x7fe9940fd700 msgr2=0x7fe99406b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 shutdown_connections 2024-09-11T00:07:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:09.862+0000 7fe999e13640 1 -- 172.21.15.19:0/3729130386 wait complete. 2024-09-11T00:07:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:10 smithi135 ceph-mon[35432]: pgmap v464: 97 pgs: 97 active+clean; 659 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 324 op/s 2024-09-11T00:07:10.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:10 smithi019 ceph-mon[30859]: pgmap v464: 97 pgs: 97 active+clean; 659 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 324 op/s 2024-09-11T00:07:10.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:10 smithi131 ceph-mon[35491]: pgmap v464: 97 pgs: 97 active+clean; 659 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 324 op/s 2024-09-11T00:07:10.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:07:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 -- 172.21.15.19:0/264585390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc103b30 msgr2=0x7effbc103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 --2- 172.21.15.19:0/264585390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc103b30 0x7effbc103f10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7effac009900 tx=0x7effac02a410 comp rx=0 tx=0).stop 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 -- 172.21.15.19:0/264585390 shutdown_connections 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 --2- 172.21.15.19:0/264585390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc10d0e0 0x7effbc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 --2- 172.21.15.19:0/264585390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effbc104530 0x7effbc10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 --2- 172.21.15.19:0/264585390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc103b30 0x7effbc103f10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 -- 172.21.15.19:0/264585390 >> 172.21.15.19:0/264585390 conn(0x7effbc0fd700 msgr2=0x7effbc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 -- 172.21.15.19:0/264585390 shutdown_connections 2024-09-11T00:07:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.531+0000 7effc1d85640 1 -- 172.21.15.19:0/264585390 wait complete. 2024-09-11T00:07:11.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 Processor -- start 2024-09-11T00:07:11.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 -- start start 2024-09-11T00:07:11.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc103b30 0x7effbc19b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc104530 0x7effbc19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effbc10d0e0 0x7effbc1a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7effbc112d60 con 0x7effbc104530 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effbc112be0 con 0x7effbc10d0e0 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effc1d85640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effbc112ee0 con 0x7effbc103b30 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.532+0000 7effbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc104530 0x7effbc19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc103b30 0x7effbc19b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc104530 0x7effbc19b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50866/0 (socket says 172.21.15.19:50866) 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 -- 172.21.15.19:0/77694537 learned_addr learned my addr 172.21.15.19:0/77694537 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbbfff640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effbc10d0e0 0x7effbc1a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 -- 172.21.15.19:0/77694537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc103b30 msgr2=0x7effbc19b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc103b30 0x7effbc19b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 -- 172.21.15.19:0/77694537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effbc10d0e0 msgr2=0x7effbc1a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effbc10d0e0 0x7effbc1a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 -- 172.21.15.19:0/77694537 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc1a1560 con 0x7effbc104530 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effbaffd640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc104530 0x7effbc19b9f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7effb000d950 tx=0x7effb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effb8ff9640 1 -- 172.21.15.19:0/77694537 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0017070 con 0x7effbc104530 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effbc1a1850 con 0x7effbc104530 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.533+0000 7effb8ff9640 1 -- 172.21.15.19:0/77694537 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb0009c30 con 0x7effbc104530 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.534+0000 7effb8ff9640 1 -- 172.21.15.19:0/77694537 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb000f620 con 0x7effbc104530 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.534+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effbc1a7f10 con 0x7effbc104530 2024-09-11T00:07:11.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.536+0000 7effb8ff9640 1 -- 172.21.15.19:0/77694537 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7effb0010460 con 0x7effbc104530 2024-09-11T00:07:11.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.537+0000 7effb8ff9640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7effa40b5450 0x7effa40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.537+0000 7effbb7fe640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7effa40b5450 0x7effa40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.537+0000 7effb8ff9640 1 -- 172.21.15.19:0/77694537 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7effb00e5b80 con 0x7effbc104530 2024-09-11T00:07:11.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.537+0000 7effbb7fe640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7effa40b5450 0x7effa40b7910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7effac031440 tx=0x7effac005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:11.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 Processor -- start 2024-09-11T00:07:11.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 -- start start 2024-09-11T00:07:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abf4d0 0x563f58abf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58acb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58ace170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563f58a35ea0 con 0x563f58abfdf0 2024-09-11T00:07:11.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563f58a252d0 con 0x563f58acbd80 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effc415a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f58a290e0 con 0x563f58abf4d0 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58acb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.538+0000 7effbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58acb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50872/0 (socket says 172.21.15.19:50872) 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbaffd640 1 -- 172.21.15.19:0/2977329923 learned_addr learned my addr 172.21.15.19:0/2977329923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbb7fe640 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abf4d0 0x563f58abf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbbfff640 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58ace170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbaffd640 1 -- 172.21.15.19:0/2977329923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abf4d0 msgr2=0x563f58abf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbaffd640 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abf4d0 0x563f58abf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbaffd640 1 -- 172.21.15.19:0/2977329923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 msgr2=0x563f58ace170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbaffd640 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58ace170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbaffd640 1 -- 172.21.15.19:0/2977329923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f58783650 con 0x563f58abfdf0 2024-09-11T00:07:11.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbbfff640 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58ace170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbb7fe640 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abf4d0 0x563f58abf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effbaffd640 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58acb840 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7effb00a86a0 tx=0x7effb00ab970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5caedb5448a496 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effa1ffb640 1 -- 172.21.15.19:0/2977329923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0020070 con 0x563f58abfdf0 2024-09-11T00:07:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effa1ffb640 1 -- 172.21.15.19:0/2977329923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb00b0b00 con 0x563f58abfdf0 2024-09-11T00:07:11.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.539+0000 7effa1ffb640 1 -- 172.21.15.19:0/2977329923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb00a7a20 con 0x563f58abfdf0 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.540+0000 7effc415a740 1 -- 172.21.15.19:0/2977329923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 msgr2=0x563f58acb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.540+0000 7effc415a740 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58acb840 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7effb00a86a0 tx=0x7effb00ab970 comp rx=0 tx=0).stop 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- 172.21.15.19:0/2977329923 shutdown_connections 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58ace170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58acb840 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 --2- 172.21.15.19:0/2977329923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abf4d0 0x563f58abf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- 172.21.15.19:0/2977329923 >> 172.21.15.19:0/2977329923 conn(0x563f58abd300 msgr2=0x563f58abe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- 172.21.15.19:0/2977329923 shutdown_connections 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- 172.21.15.19:0/2977329923 wait complete. 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- start start 2024-09-11T00:07:11.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 Processor -- start 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 0x563f58acb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58ac8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58acbd80 0x563f58ac9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563f58886700 con 0x563f58abfdf0 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563f589c0160 con 0x563f58abf4d0 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.541+0000 7effc415a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f58ace940 con 0x563f58acbd80 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effc415a740 10 client.0 _ll_register_callbacks cb 0x563f589d99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58ac8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58ac8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50874/0 (socket says 172.21.15.19:50874) 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 -- 172.21.15.19:0/3660355583 learned_addr learned my addr 172.21.15.19:0/3660355583 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbbfff640 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58acbd80 0x563f58ac9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbb7fe640 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 0x563f58acb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 -- 172.21.15.19:0/3660355583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58acbd80 msgr2=0x563f58ac9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58acbd80 0x563f58ac9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 -- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 msgr2=0x563f58acb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 0x563f58acb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 -- 172.21.15.19:0/3660355583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f589edc90 con 0x563f58abfdf0 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effbaffd640 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58ac8be0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7effb000dfe0 tx=0x7effb00a8570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb43cb4a730c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7eff9affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7eff9affd640 1 -- 172.21.15.19:0/3660355583 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0020070 con 0x563f58abfdf0 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7eff9affd640 1 -- 172.21.15.19:0/3660355583 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7effb0097190 con 0x563f58abfdf0 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.542+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effb00b0b00 con 0x563f58abfdf0 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7eff9affd640 1 -- 172.21.15.19:0/3660355583 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7effb0010ae0 con 0x563f58abfdf0 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 10 client.16068 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f58ada390 con 0x563f58abfdf0 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7eff9affd640 1 -- 172.21.15.19:0/3660355583 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb00b0b00 con 0x563f58abfdf0 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7eff9affd640 1 -- 172.21.15.19:0/3660355583 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7effb00aada0 con 0x563f58abfdf0 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 10 client.16068 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 10 client.16068 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 20 client.16068 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58adb6e0 0x563f58addad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 4 client.16068 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f58a37df0 con 0x563f58adb6e0 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.543+0000 7effbb7fe640 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58adb6e0 0x563f58addad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.544+0000 7eff9affd640 10 client.16068 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:07:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.544+0000 7effbb7fe640 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58adb6e0 0x563f58addad0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c22aa84cf4772344 server_cookie=fe188b97828ab711 in_seq=0 out_seq=0 2024-09-11T00:07:11.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7eff9affd640 1 -- 172.21.15.19:0/3660355583 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f58a37df0 con 0x563f58adb6e0 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7eff9affd640 10 client.16068 handle_command_reply: tid=0 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 client.16068 shutdown 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 msgr2=0x563f58ac8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58ac8be0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7effb000dfe0 tx=0x7effb00a8570 comp rx=0 tx=0).stop 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 shutdown_connections 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58adb6e0 0x563f58addad0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58acbd80 0x563f58ac9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abfdf0 0x563f58ac8be0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 --2- 172.21.15.19:0/3660355583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 0x563f58acb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 >> 172.21.15.19:0/3660355583 conn(0x563f58abd300 msgr2=0x563f58ac2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7eff9affd640 0 client.16068 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 shutdown_connections 2024-09-11T00:07:11.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 1 -- 172.21.15.19:0/3660355583 wait complete. 2024-09-11T00:07:11.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.545+0000 7effc415a740 20 client.16068 trim_cache size 0 max 16384 2024-09-11T00:07:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 Processor -- start 2024-09-11T00:07:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 -- start start 2024-09-11T00:07:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 0x563f58ac80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58abe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58acbd80 0x563f58abe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1b3160 con 0x563f58acbd80 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1b0a00 con 0x563f58abf4d0 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effc415a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1ae850 con 0x563f58abfdf0 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58acbd80 0x563f58abe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58acbd80 0x563f58abe890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50890/0 (socket says 172.21.15.19:50890) 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 -- 172.21.15.19:0/1328610341 learned_addr learned my addr 172.21.15.19:0/1328610341 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbaffd640 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58abe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 -- 172.21.15.19:0/1328610341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 msgr2=0x563f58abe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58abe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 -- 172.21.15.19:0/1328610341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 msgr2=0x563f58ac80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 0x563f58ac80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 -- 172.21.15.19:0/1328610341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f58abd0e0 con 0x563f58acbd80 2024-09-11T00:07:11.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.559+0000 7effbbfff640 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58acbd80 0x563f58abe890 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7effb4003aa0 tx=0x7effb4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f2809365e87287 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effa17fa640 1 -- 172.21.15.19:0/1328610341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4021070 con 0x563f58acbd80 2024-09-11T00:07:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effa17fa640 1 -- 172.21.15.19:0/1328610341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb401c910 con 0x563f58acbd80 2024-09-11T00:07:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effa17fa640 1 -- 172.21.15.19:0/1328610341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4010990 con 0x563f58acbd80 2024-09-11T00:07:11.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 -- 172.21.15.19:0/1328610341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58acbd80 msgr2=0x563f58abe890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58acbd80 0x563f58abe890 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7effb4003aa0 tx=0x7effb4009f90 comp rx=0 tx=0).stop 2024-09-11T00:07:11.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 -- 172.21.15.19:0/1328610341 shutdown_connections 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58acbd80 0x563f58abe890 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58abe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 --2- 172.21.15.19:0/1328610341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58abf4d0 0x563f58ac80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 -- 172.21.15.19:0/1328610341 >> 172.21.15.19:0/1328610341 conn(0x563f58abd300 msgr2=0x563f58ac3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 -- 172.21.15.19:0/1328610341 shutdown_connections 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.560+0000 7effc415a740 1 -- 172.21.15.19:0/1328610341 wait complete. 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 -- start start 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 Processor -- start 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abf4d0 0x563f58ae0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58adc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58adc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1aeec0 con 0x563f58abf4d0 2024-09-11T00:07:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1b0330 con 0x563f58acbd80 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1af590 con 0x563f58abfdf0 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effc415a740 10 client.0 _ll_register_callbacks cb 0x7effac040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effbb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abf4d0 0x563f58ae0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effbb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abf4d0 0x563f58ae0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50904/0 (socket says 172.21.15.19:50904) 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effbb7fe640 1 -- 172.21.15.19:0/3812227334 learned_addr learned my addr 172.21.15.19:0/3812227334 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.561+0000 7effbaffd640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58adc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbbfff640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58adc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbb7fe640 1 -- 172.21.15.19:0/3812227334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 msgr2=0x563f58adc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbb7fe640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58adc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbb7fe640 1 -- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 msgr2=0x563f58adc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbb7fe640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58adc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbb7fe640 1 -- 172.21.15.19:0/3812227334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f58add1d0 con 0x563f58abf4d0 2024-09-11T00:07:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbaffd640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58adc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effbb7fe640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abf4d0 0x563f58ae0f00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7effac02a930 tx=0x7effac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b15a159c5d3ca94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7eff9affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7eff9affd640 1 -- 172.21.15.19:0/3812227334 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac057060 con 0x563f58abf4d0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7eff9affd640 1 -- 172.21.15.19:0/3812227334 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7effac004040 con 0x563f58abf4d0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effb401c910 con 0x563f58abf4d0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7eff9affd640 1 -- 172.21.15.19:0/3812227334 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7effac035040 con 0x563f58abf4d0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effc415a740 10 client.16074 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.562+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f58b482e0 con 0x563f58abf4d0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7eff9affd640 1 -- 172.21.15.19:0/3812227334 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb401c910 con 0x563f58abf4d0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7eff9affd640 1 -- 172.21.15.19:0/3812227334 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7effac03c440 con 0x563f58abf4d0 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7effc415a740 10 client.16074 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7effc415a740 10 client.16074 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:07:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7effc415a740 20 client.16074 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7effc415a740 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58b48a10 0x563f58b4ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7effc415a740 4 client.16074 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f58a338a0 con 0x563f58b48a10 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.563+0000 7effbaffd640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58b48a10 0x563f58b4ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7eff9affd640 10 client.16074 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effbaffd640 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58b48a10 0x563f58b4ae30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d55df496c15877d server_cookie=cdd5dafceee427c2 in_seq=0 out_seq=0 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7eff9affd640 1 -- 172.21.15.19:0/3812227334 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f58a338a0 con 0x563f58b48a10 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7eff9affd640 10 client.16074 handle_command_reply: tid=0 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 client.16074 shutdown 2024-09-11T00:07:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abf4d0 msgr2=0x563f58ae0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abf4d0 0x563f58ae0f00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7effac02a930 tx=0x7effac009260 comp rx=0 tx=0).stop 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 shutdown_connections 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x563f58b48a10 0x563f58b4ae30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f58acbd80 0x563f58adc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f58abfdf0 0x563f58adc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 --2- 172.21.15.19:0/3812227334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f58abf4d0 0x563f58ae0f00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7eff9affd640 0 client.16074 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 >> 172.21.15.19:0/3812227334 conn(0x563f58abd300 msgr2=0x563f58abe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 shutdown_connections 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 1 -- 172.21.15.19:0/3812227334 wait complete. 2024-09-11T00:07:11.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.564+0000 7effc415a740 20 client.16074 trim_cache size 0 max 16384 2024-09-11T00:07:11.572 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:07:11.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7effa40b5450 msgr2=0x7effa40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7effa40b5450 0x7effa40b7910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7effac031440 tx=0x7effac005b50 comp rx=0 tx=0).stop 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc104530 msgr2=0x7effbc19b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc104530 0x7effbc19b9f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7effb000d950 tx=0x7effb000de10 comp rx=0 tx=0).stop 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 shutdown_connections 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effbc10d0e0 0x7effbc1a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7effa40b5450 0x7effa40b7910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effbc104530 0x7effbc19b9f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 --2- 172.21.15.19:0/77694537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc103b30 0x7effbc19b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 >> 172.21.15.19:0/77694537 conn(0x7effbc0fd700 msgr2=0x7effbc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 shutdown_connections 2024-09-11T00:07:11.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:11.565+0000 7effc1d85640 1 -- 172.21.15.19:0/77694537 wait complete. 2024-09-11T00:07:12.352 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:12 smithi131 ceph-mon[35491]: pgmap v465: 97 pgs: 97 active+clean; 659 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 183 op/s 2024-09-11T00:07:12.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:12 smithi135 ceph-mon[35432]: pgmap v465: 97 pgs: 97 active+clean; 659 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 183 op/s 2024-09-11T00:07:12.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:12 smithi019 ceph-mon[30859]: pgmap v465: 97 pgs: 97 active+clean; 659 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 183 op/s 2024-09-11T00:07:12.960 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:07:13.115 INFO:tasks.workunit.client.0.smithi019.stdout: 112 402309 210 272266 316 234293 659 2024-09-11T00:07:13.868 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:14.368 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:14 smithi019 ceph-mon[30859]: pgmap v466: 97 pgs: 97 active+clean; 663 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 173 op/s 2024-09-11T00:07:14.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:14 smithi135 ceph-mon[35432]: pgmap v466: 97 pgs: 97 active+clean; 663 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 173 op/s 2024-09-11T00:07:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:14 smithi131 ceph-mon[35491]: pgmap v466: 97 pgs: 97 active+clean; 663 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 173 op/s 2024-09-11T00:07:14.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 -- 172.21.15.19:0/1948621399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 msgr2=0x7fd5b010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/1948621399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 0x7fd5b010f950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009ca0 tx=0x7fd5a802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 -- 172.21.15.19:0/1948621399 shutdown_connections 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/1948621399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 0x7fd5b010f950 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/1948621399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 0x7fd5b0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/1948621399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b0102dc0 0x7fd5b01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 -- 172.21.15.19:0/1948621399 >> 172.21.15.19:0/1948621399 conn(0x7fd5b00fe870 msgr2=0x7fd5b0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 -- 172.21.15.19:0/1948621399 shutdown_connections 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.673+0000 7fd5b6c38640 1 -- 172.21.15.19:0/1948621399 wait complete. 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 Processor -- start 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 -- start start 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b0102dc0 0x7fd5b0199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 0x7fd5b0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 0x7fd5b019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0112e60 con 0x7fd5b0109150 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0112ce0 con 0x7fd5b01087d0 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.674+0000 7fd5b6c38640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0112fe0 con 0x7fd5b0102dc0 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 0x7fd5b0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 0x7fd5b0199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:58814/0 (socket says 172.21.15.19:58814) 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 -- 172.21.15.19:0/3684808900 learned_addr learned my addr 172.21.15.19:0/3684808900 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5b51d5640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 0x7fd5b019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b0102dc0 0x7fd5b0199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 -- 172.21.15.19:0/3684808900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b0102dc0 msgr2=0x7fd5b0199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b0102dc0 0x7fd5b0199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 -- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 msgr2=0x7fd5b019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 0x7fd5b019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 -- 172.21.15.19:0/3684808900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b019f2c0 con 0x7fd5b01087d0 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5affff640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 0x7fd5b0199750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00e9f0 tx=0x7fd59c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5adffb640 1 -- 172.21.15.19:0/3684808900 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00cd80 con 0x7fd5b01087d0 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.675+0000 7fd5adffb640 1 -- 172.21.15.19:0/3684808900 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd59c0108e0 con 0x7fd5b01087d0 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.676+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b019f5b0 con 0x7fd5b01087d0 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.676+0000 7fd5adffb640 1 -- 172.21.15.19:0/3684808900 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c018980 con 0x7fd5b01087d0 2024-09-11T00:07:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.676+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b01a5e40 con 0x7fd5b01087d0 2024-09-11T00:07:14.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.679+0000 7fd5adffb640 1 -- 172.21.15.19:0/3684808900 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fd59c010430 con 0x7fd5b01087d0 2024-09-11T00:07:14.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.679+0000 7fd5b900d740 1 Processor -- start 2024-09-11T00:07:14.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.679+0000 7fd5b900d740 1 -- start start 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5adffb640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5a00b54d0 0x7fd5a00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558f4d0 0x55e6f558f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f559b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b900d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e6f5505ea0 con 0x55e6f559bd80 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b900d740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e6f54f52d0 con 0x55e6f558fdf0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b900d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e6f54f90e0 con 0x55e6f558f4d0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5adffb640 1 -- 172.21.15.19:0/3684808900 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd59c0e61e0 con 0x7fd5b01087d0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b51d5640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5a00b54d0 0x7fd5a00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b49d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558f4d0 0x55e6f558f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b49d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558f4d0 0x55e6f558f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60484/0 (socket says 172.21.15.19:60484) 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2701391621 learned_addr learned my addr 172.21.15.19:0/2701391621 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5b51d5640 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.680+0000 7fd5affff640 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f559b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2701391621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 msgr2=0x55e6f559b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f559b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2701391621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 msgr2=0x55e6f559e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2701391621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f5253650 con 0x55e6f558f4d0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5affff640 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f559b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5b51d5640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5a00b54d0 0x7fd5a00b7990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8006010 tx=0x7fd5a80099b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558f4d0 0x55e6f558f8b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009cf0 tx=0x7fd5a4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=860cd9d0532ebb2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd59affd640 1 -- 172.21.15.19:0/2701391621 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4004030 con 0x55e6f558f4d0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd59affd640 1 -- 172.21.15.19:0/2701391621 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5a40041d0 con 0x55e6f558f4d0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.681+0000 7fd59affd640 1 -- 172.21.15.19:0/2701391621 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4019680 con 0x55e6f558f4d0 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 -- 172.21.15.19:0/2701391621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558f4d0 msgr2=0x55e6f558f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558f4d0 0x55e6f558f8b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009cf0 tx=0x7fd5a4011810 comp rx=0 tx=0).stop 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 -- 172.21.15.19:0/2701391621 shutdown_connections 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f559b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2701391621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558f4d0 0x55e6f558f8b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 -- 172.21.15.19:0/2701391621 >> 172.21.15.19:0/2701391621 conn(0x55e6f558d300 msgr2=0x55e6f558e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 -- 172.21.15.19:0/2701391621 shutdown_connections 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 -- 172.21.15.19:0/2701391621 wait complete. 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.682+0000 7fd5b900d740 1 -- start start 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 1 Processor -- start 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f559b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f5598a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f559bd80 0x55e6f5599040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e6f5356700 con 0x55e6f558f4d0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e6f5490160 con 0x55e6f558fdf0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e6f559ea00 con 0x55e6f559bd80 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b900d740 10 client.0 _ll_register_callbacks cb 0x55e6f54a99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b49d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f559b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b51d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f559bd80 0x55e6f5599040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b49d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f559b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50934/0 (socket says 172.21.15.19:50934) 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5b49d4640 1 -- 172.21.15.19:0/3397734845 learned_addr learned my addr 172.21.15.19:0/3397734845 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.683+0000 7fd5affff640 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f5598a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b49d4640 1 -- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f559bd80 msgr2=0x55e6f5599040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f559bd80 0x55e6f5599040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b49d4640 1 -- 172.21.15.19:0/3397734845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 msgr2=0x55e6f5598a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f5598a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b49d4640 1 -- 172.21.15.19:0/3397734845 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f54bdc90 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b51d5640 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f559bd80 0x55e6f5599040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f559b630 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4000c00 tx=0x7fd5a4003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8e8a1445ded59c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd58ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd58ffff640 1 -- 172.21.15.19:0/3397734845 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4027070 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd58ffff640 1 -- 172.21.15.19:0/3397734845 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd5a4004380 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a40041d0 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd58ffff640 1 -- 172.21.15.19:0/3397734845 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd5a4033050 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b900d740 10 client.16086 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.684+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e6f55aa2f0 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd58ffff640 1 -- 172.21.15.19:0/3397734845 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5a40041d0 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd58ffff640 1 -- 172.21.15.19:0/3397734845 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fd5a4004ad0 con 0x55e6f558f4d0 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd5b900d740 10 client.16086 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd5b900d740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd5b900d740 20 client.16086 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd5b900d740 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f55ab6a0 0x55e6f55ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd5b900d740 4 client.16086 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6f5507df0 con 0x55e6f55ab6a0 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.685+0000 7fd5affff640 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f55ab6a0 0x55e6f55ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.686+0000 7fd5affff640 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f55ab6a0 0x55e6f55ada90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3cf385663f777f server_cookie=61ae172a522edc94 in_seq=0 out_seq=0 2024-09-11T00:07:14.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.686+0000 7fd58ffff640 10 client.16086 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd58ffff640 1 -- 172.21.15.19:0/3397734845 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6f5507df0 con 0x55e6f55ab6a0 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd58ffff640 10 client.16086 handle_command_reply: tid=0 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 client.16086 shutdown 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 msgr2=0x55e6f559b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f559b630 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4000c00 tx=0x7fd5a4003b70 comp rx=0 tx=0).stop 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 shutdown_connections 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f559bd80 0x55e6f5599040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558fdf0 0x55e6f5598a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f55ab6a0 0x55e6f55ada90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd58ffff640 0 client.16086 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 --2- 172.21.15.19:0/3397734845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f559b630 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 >> 172.21.15.19:0/3397734845 conn(0x55e6f558d300 msgr2=0x55e6f5592ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 shutdown_connections 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 1 -- 172.21.15.19:0/3397734845 wait complete. 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.687+0000 7fd5b900d740 20 client.16086 trim_cache size 0 max 16384 2024-09-11T00:07:14.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 Processor -- start 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 -- start start 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f55a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f558c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f559bd80 0x55e6f559d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01b0ec0 con 0x55e6f558f4d0 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01ae760 con 0x55e6f559bd80 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b900d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01ac5b0 con 0x55e6f558fdf0 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f55a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f55a7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50942/0 (socket says 172.21.15.19:50942) 2024-09-11T00:07:14.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2624767081 learned_addr learned my addr 172.21.15.19:0/2624767081 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:14.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b51d5640 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f559bd80 0x55e6f559d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5affff640 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f558c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2624767081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 msgr2=0x55e6f558c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f558c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2624767081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f559bd80 msgr2=0x55e6f559d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f559bd80 0x55e6f559d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.702+0000 7fd5b49d4640 1 -- 172.21.15.19:0/2624767081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f5593780 con 0x55e6f558f4d0 2024-09-11T00:07:14.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.703+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f55a7c30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4001eb0 tx=0x7fd5a4003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfea644a6cfe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.703+0000 7fd59a7fc640 1 -- 172.21.15.19:0/2624767081 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4027070 con 0x55e6f558f4d0 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.703+0000 7fd59a7fc640 1 -- 172.21.15.19:0/2624767081 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5a4023db0 con 0x55e6f558f4d0 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.703+0000 7fd59a7fc640 1 -- 172.21.15.19:0/2624767081 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4005200 con 0x55e6f558f4d0 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 -- 172.21.15.19:0/2624767081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 msgr2=0x55e6f55a7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f55a7c30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4001eb0 tx=0x7fd5a4003b00 comp rx=0 tx=0).stop 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 -- 172.21.15.19:0/2624767081 shutdown_connections 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f559bd80 0x55e6f559d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f558c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2624767081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f558f4d0 0x55e6f55a7c30 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 -- 172.21.15.19:0/2624767081 >> 172.21.15.19:0/2624767081 conn(0x55e6f558d300 msgr2=0x55e6f558bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 -- 172.21.15.19:0/2624767081 shutdown_connections 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 -- 172.21.15.19:0/2624767081 wait complete. 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 -- start start 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.704+0000 7fd5b900d740 1 Processor -- start 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558f4d0 0x55e6f55a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f55a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b900d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b900d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01acc20 con 0x55e6f559bd80 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b900d740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01ae090 con 0x55e6f558f4d0 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b900d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01ad2f0 con 0x55e6f558fdf0 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b900d740 10 client.0 _ll_register_callbacks cb 0x7fd5a4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f55a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b51d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f55a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60520/0 (socket says 172.21.15.19:60520) 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 -- 172.21.15.19:0/2989919889 learned_addr learned my addr 172.21.15.19:0/2989919889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b49d4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558f4d0 0x55e6f55a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 -- 172.21.15.19:0/2989919889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558f4d0 msgr2=0x55e6f55a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558f4d0 0x55e6f55a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 -- 172.21.15.19:0/2989919889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 msgr2=0x55e6f559eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5affff640 1 -- 172.21.15.19:0/2989919889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f559f6d0 con 0x55e6f558fdf0 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.705+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558f4d0 0x55e6f55a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5affff640 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f55a46d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0a8d40 tx=0x7fd59c0a87d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a791d1770e592a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd58ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd58ffff640 1 -- 172.21.15.19:0/2989919889 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0e3c10 con 0x55e6f558fdf0 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd58ffff640 1 -- 172.21.15.19:0/2989919889 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fd59c0e3db0 con 0x55e6f558fdf0 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a4023db0 con 0x55e6f558fdf0 2024-09-11T00:07:14.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd58ffff640 1 -- 172.21.15.19:0/2989919889 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd59c0ab9d0 con 0x55e6f558fdf0 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 10 client.25687 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e6f561d600 con 0x55e6f558fdf0 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd58ffff640 1 -- 172.21.15.19:0/2989919889 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5a4023db0 con 0x55e6f558fdf0 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd58ffff640 1 -- 172.21.15.19:0/2989919889 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fd59c0a8150 con 0x55e6f558fdf0 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 10 client.25687 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 10 client.25687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 20 client.25687 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f561dd60 0x55e6f5620180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 4 client.25687 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:07:14.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.706+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6f55038a0 con 0x55e6f561dd60 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f561dd60 0x55e6f5620180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd5b49d4640 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f561dd60 0x55e6f5620180 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9193be20af01f7c3 server_cookie=8ec1c6e26ccbc2f3 in_seq=0 out_seq=0 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd58ffff640 10 client.25687 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd58ffff640 1 -- 172.21.15.19:0/2989919889 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6f55038a0 con 0x55e6f561dd60 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd58ffff640 10 client.25687 handle_command_reply: tid=0 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd5b900d740 1 client.25687 shutdown 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 msgr2=0x55e6f55a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.707+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f55a46d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0a8d40 tx=0x7fd59c0a87d0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 shutdown_connections 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e6f561dd60 0x55e6f5620180 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6f559bd80 0x55e6f559eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6f558fdf0 0x55e6f55a46d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 --2- 172.21.15.19:0/2989919889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6f558f4d0 0x55e6f55a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 >> 172.21.15.19:0/2989919889 conn(0x55e6f558d300 msgr2=0x55e6f558c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd58ffff640 0 client.25687 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 shutdown_connections 2024-09-11T00:07:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 1 -- 172.21.15.19:0/2989919889 wait complete. 2024-09-11T00:07:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b900d740 20 client.25687 trim_cache size 0 max 16384 2024-09-11T00:07:14.714 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5a00b54d0 msgr2=0x7fd5a00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.708+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5a00b54d0 0x7fd5a00b7990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8006010 tx=0x7fd5a80099b0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 msgr2=0x7fd5b0199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 0x7fd5b0199750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00e9f0 tx=0x7fd59c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 shutdown_connections 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd5a00b54d0 0x7fd5a00b7990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0109150 0x7fd5b019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5b01087d0 0x7fd5b0199750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 --2- 172.21.15.19:0/3684808900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5b0102dc0 0x7fd5b0199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 >> 172.21.15.19:0/3684808900 conn(0x7fd5b00fe870 msgr2=0x7fd5b0100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 shutdown_connections 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:14.709+0000 7fd5b6c38640 1 -- 172.21.15.19:0/3684808900 wait complete. 2024-09-11T00:07:16.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:16 smithi135 ceph-mon[35432]: pgmap v467: 97 pgs: 97 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-09-11T00:07:16.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:16 smithi019 ceph-mon[30859]: pgmap v467: 97 pgs: 97 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-09-11T00:07:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:16 smithi131 ceph-mon[35491]: pgmap v467: 97 pgs: 97 active+clean; 664 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-09-11T00:07:16.593 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:07:16.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:07:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 -- 172.21.15.19:0/3679670135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a010d100 msgr2=0x7f17a010f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 --2- 172.21.15.19:0/3679670135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a010d100 0x7f17a010f570 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1798009ca0 tx=0x7f179802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 -- 172.21.15.19:0/3679670135 shutdown_connections 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 --2- 172.21.15.19:0/3679670135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a010d100 0x7f17a010f570 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 --2- 172.21.15.19:0/3679670135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17a0104550 0x7f17a010cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 --2- 172.21.15.19:0/3679670135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a0103b50 0x7f17a0103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 -- 172.21.15.19:0/3679670135 >> 172.21.15.19:0/3679670135 conn(0x7f17a00fd700 msgr2=0x7f17a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 -- 172.21.15.19:0/3679670135 shutdown_connections 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.630+0000 7f17a8286640 1 -- 172.21.15.19:0/3679670135 wait complete. 2024-09-11T00:07:17.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 Processor -- start 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 -- start start 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a0103b50 0x7f17a019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17a0104550 0x7f17a019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a010d100 0x7f17a01a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17a0112d80 con 0x7f17a0103b50 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f17a0112c00 con 0x7f17a0104550 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a8286640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17a0112f00 con 0x7f17a010d100 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a6022640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a0103b50 0x7f17a019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a6022640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a0103b50 0x7f17a019b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50970/0 (socket says 172.21.15.19:50970) 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a6022640 1 -- 172.21.15.19:0/2750808057 learned_addr learned my addr 172.21.15.19:0/2750808057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a6823640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a010d100 0x7f17a01a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.631+0000 7f17a5821640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17a0104550 0x7f17a019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a6022640 1 -- 172.21.15.19:0/2750808057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a010d100 msgr2=0x7f17a01a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a6022640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a010d100 0x7f17a01a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a6022640 1 -- 172.21.15.19:0/2750808057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17a0104550 msgr2=0x7f17a019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a6022640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17a0104550 0x7f17a019b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a6022640 1 -- 172.21.15.19:0/2750808057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a01a14e0 con 0x7f17a0103b50 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a6022640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a0103b50 0x7f17a019b430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f179c00e9f0 tx=0x7f179c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17977fe640 1 -- 172.21.15.19:0/2750808057 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c00cd80 con 0x7f17a0103b50 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a01a17d0 con 0x7f17a0103b50 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17977fe640 1 -- 172.21.15.19:0/2750808057 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f179c0054d0 con 0x7f17a0103b50 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17977fe640 1 -- 172.21.15.19:0/2750808057 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c010690 con 0x7f17a0103b50 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.632+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a01a7e90 con 0x7f17a0103b50 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.635+0000 7f17977fe640 1 -- 172.21.15.19:0/2750808057 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f179c004e90 con 0x7f17a0103b50 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17977fe640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f178c0b5450 0x7f178c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 Processor -- start 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17a5821640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f178c0b5450 0x7f178c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17977fe640 1 -- 172.21.15.19:0/2750808057 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f179c0e63d0 con 0x7f17a0103b50 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 -- start start 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449b1790 0x55f8449b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f84491be60 con 0x55f8449a5800 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f84490b290 con 0x55f8449b1790 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17aa65b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f84490f0a0 con 0x55f8449a4ee0 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17a5821640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f178c0b5450 0x7f178c0b7910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f17a010e800 tx=0x7f179000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17a5821640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17a6022640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17a6022640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60554/0 (socket says 172.21.15.19:60554) 2024-09-11T00:07:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.636+0000 7f17a6022640 1 -- 172.21.15.19:0/3108666195 learned_addr learned my addr 172.21.15.19:0/3108666195 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a6823640 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449b1790 0x55f8449b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a6022640 1 -- 172.21.15.19:0/3108666195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449b1790 msgr2=0x55f8449b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a6022640 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449b1790 0x55f8449b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a6022640 1 -- 172.21.15.19:0/3108666195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 msgr2=0x55f8449b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a6022640 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a6022640 1 -- 172.21.15.19:0/3108666195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f844669930 con 0x55f8449a4ee0 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a5821640 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f17a6022640 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a52c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f179c0ac570 tx=0x7f179c0ac640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1118de16ab0cea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f1794de6640 1 -- 172.21.15.19:0/3108666195 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0b1070 con 0x55f8449a4ee0 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f1794de6640 1 -- 172.21.15.19:0/3108666195 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f179c0ac380 con 0x55f8449a4ee0 2024-09-11T00:07:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.637+0000 7f1794de6640 1 -- 172.21.15.19:0/3108666195 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0b5e00 con 0x55f8449a4ee0 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 -- 172.21.15.19:0/3108666195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 msgr2=0x55f8449a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a52c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f179c0ac570 tx=0x7f179c0ac640 comp rx=0 tx=0).stop 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 -- 172.21.15.19:0/3108666195 shutdown_connections 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449b1790 0x55f8449b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3108666195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a52c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 -- 172.21.15.19:0/3108666195 >> 172.21.15.19:0/3108666195 conn(0x55f8449a2d10 msgr2=0x55f8449a3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 -- 172.21.15.19:0/3108666195 shutdown_connections 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 -- 172.21.15.19:0/3108666195 wait complete. 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.638+0000 7f17aa65b740 1 -- start start 2024-09-11T00:07:17.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 1 Processor -- start 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449b1790 0x55f8449af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f84476c890 con 0x55f8449a5800 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f8448a5d40 con 0x55f8449a4ee0 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f8449b4440 con 0x55f8449b1790 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17aa65b740 10 client.0 _ll_register_callbacks cb 0x55f844909c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50986/0 (socket says 172.21.15.19:50986) 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 -- 172.21.15.19:0/3870880349 learned_addr learned my addr 172.21.15.19:0/3870880349 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a6823640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449b1790 0x55f8449af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a6022640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 -- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449b1790 msgr2=0x55f8449af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449b1790 0x55f8449af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 -- 172.21.15.19:0/3870880349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 msgr2=0x55f8449ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a5821640 1 -- 172.21.15.19:0/3870880349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8449bd820 con 0x55f8449a5800 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a6823640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449b1790 0x55f8449af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.639+0000 7f17a6022640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f17a5821640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449aec70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1790011740 tx=0x7f1790004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec569770a0914ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f1789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f1789ffb640 1 -- 172.21.15.19:0/3870880349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790005220 con 0x55f8449a5800 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f179c0ac380 con 0x55f8449a5800 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f1789ffb640 1 -- 172.21.15.19:0/3870880349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f17900053c0 con 0x55f8449a5800 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f1789ffb640 1 -- 172.21.15.19:0/3870880349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f17900055c0 con 0x55f8449a5800 2024-09-11T00:07:17.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f17aa65b740 10 client.16104 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f8449c0230 con 0x55f8449a5800 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.640+0000 7f1789ffb640 1 -- 172.21.15.19:0/3870880349 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f179c0ac380 con 0x55f8449a5800 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f1789ffb640 1 -- 172.21.15.19:0/3870880349 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f179001e970 con 0x55f8449a5800 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f17aa65b740 10 client.16104 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f17aa65b740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f17aa65b740 20 client.16104 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f8449c1640 0x55f8449c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f17aa65b740 4 client.16104 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f84491ddb0 con 0x55f8449c1640 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.641+0000 7f17a6022640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f8449c1640 0x55f8449c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.642+0000 7f17a6022640 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f8449c1640 0x55f8449c3a50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fbb2e4834cb3f21 server_cookie=e2c4ff3c5b90713 in_seq=0 out_seq=0 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.642+0000 7f1789ffb640 10 client.16104 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.642+0000 7f1789ffb640 1 -- 172.21.15.19:0/3870880349 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f84491ddb0 con 0x55f8449c1640 2024-09-11T00:07:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f1789ffb640 10 client.16104 handle_command_reply: tid=0 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 client.16104 shutdown 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 msgr2=0x55f8449aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449aec70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1790011740 tx=0x7f1790004730 comp rx=0 tx=0).stop 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 shutdown_connections 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449b1790 0x55f8449af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f8449c1640 0x55f8449c3a50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449a5800 0x55f8449aec70 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 --2- 172.21.15.19:0/3870880349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 >> 172.21.15.19:0/3870880349 conn(0x55f8449a2d10 msgr2=0x55f8449a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f1789ffb640 0 client.16104 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 shutdown_connections 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 1 -- 172.21.15.19:0/3870880349 wait complete. 2024-09-11T00:07:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.643+0000 7f17aa65b740 20 client.16104 trim_cache size 0 max 16384 2024-09-11T00:07:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 Processor -- start 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 -- start start 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a5800 0x55f8449a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f8449b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17a01b3090 con 0x55f8449b1790 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f17a01b0930 con 0x55f8449a5800 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17aa65b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17a01ae780 con 0x55f8449a4ee0 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17a6022640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17a6823640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f8449b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17a6022640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60572/0 (socket says 172.21.15.19:60572) 2024-09-11T00:07:17.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.662+0000 7f17a6022640 1 -- 172.21.15.19:0/2137455792 learned_addr learned my addr 172.21.15.19:0/2137455792 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:17.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a5821640 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a5800 0x55f8449a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a6823640 1 -- 172.21.15.19:0/2137455792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 msgr2=0x55f8449a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a6823640 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a6823640 1 -- 172.21.15.19:0/2137455792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a5800 msgr2=0x55f8449a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a6823640 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a5800 0x55f8449a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a6823640 1 -- 172.21.15.19:0/2137455792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8449a3790 con 0x55f8449b1790 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a5821640 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a5800 0x55f8449a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f17a6823640 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f8449b0470 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1798006010 tx=0x7f1798009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c13bb64d6c0855 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f178bfff640 1 -- 172.21.15.19:0/2137455792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798031550 con 0x55f8449b1790 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f178bfff640 1 -- 172.21.15.19:0/2137455792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f179804b070 con 0x55f8449b1790 2024-09-11T00:07:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.663+0000 7f178bfff640 1 -- 172.21.15.19:0/2137455792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798004650 con 0x55f8449b1790 2024-09-11T00:07:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 -- 172.21.15.19:0/2137455792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 msgr2=0x55f8449b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f8449b0470 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1798006010 tx=0x7f1798009a20 comp rx=0 tx=0).stop 2024-09-11T00:07:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 -- 172.21.15.19:0/2137455792 shutdown_connections 2024-09-11T00:07:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f8449b0470 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a5800 0x55f8449a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 --2- 172.21.15.19:0/2137455792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a4ee0 0x55f8449a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 -- 172.21.15.19:0/2137455792 >> 172.21.15.19:0/2137455792 conn(0x55f8449a2d10 msgr2=0x55f8449afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 -- 172.21.15.19:0/2137455792 shutdown_connections 2024-09-11T00:07:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.664+0000 7f17aa65b740 1 -- 172.21.15.19:0/2137455792 wait complete. 2024-09-11T00:07:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.665+0000 7f17aa65b740 1 -- start start 2024-09-11T00:07:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.665+0000 7f17aa65b740 1 Processor -- start 2024-09-11T00:07:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a5800 0x55f8449b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17aa65b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f844a2d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17aa65b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17a01aedf0 con 0x55f8449b1790 2024-09-11T00:07:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17aa65b740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f17a01b0260 con 0x55f8449a4ee0 2024-09-11T00:07:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17aa65b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17a01af4c0 con 0x55f8449a5800 2024-09-11T00:07:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17aa65b740 10 client.0 _ll_register_callbacks cb 0x7f1790010be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a5821640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a5800 0x55f8449b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6823640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f844a2d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:58898/0 (socket says 172.21.15.19:58898) 2024-09-11T00:07:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 -- 172.21.15.19:0/123952960 learned_addr learned my addr 172.21.15.19:0/123952960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a5821640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a5800 0x55f8449b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60582/0 (socket says 172.21.15.19:60582) 2024-09-11T00:07:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 -- 172.21.15.19:0/123952960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a5800 msgr2=0x55f8449b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a5800 0x55f8449b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 -- 172.21.15.19:0/123952960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 msgr2=0x55f844a2d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f844a2d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.666+0000 7f17a6022640 1 -- 172.21.15.19:0/123952960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f844a2daf0 con 0x55f8449a4ee0 2024-09-11T00:07:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f17a6022640 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449b5d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f179c009380 tx=0x7f179c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=384754c144fe4176 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f1789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:07:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f1789ffb640 1 -- 172.21.15.19:0/123952960 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c097070 con 0x55f8449a4ee0 2024-09-11T00:07:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f1789ffb640 1 -- 172.21.15.19:0/123952960 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f179c0a8ae0 con 0x55f8449a4ee0 2024-09-11T00:07:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f179804b070 con 0x55f8449a4ee0 2024-09-11T00:07:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f1789ffb640 1 -- 172.21.15.19:0/123952960 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f179c0b1040 con 0x55f8449a4ee0 2024-09-11T00:07:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f17aa65b740 10 client.25496 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f844a2ee30 con 0x55f8449a4ee0 2024-09-11T00:07:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.667+0000 7f1789ffb640 1 -- 172.21.15.19:0/123952960 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f179804b070 con 0x55f8449a4ee0 2024-09-11T00:07:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f1789ffb640 1 -- 172.21.15.19:0/123952960 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f179c0b5970 con 0x55f8449a4ee0 2024-09-11T00:07:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17aa65b740 10 client.25496 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17aa65b740 10 client.25496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17aa65b740 20 client.25496 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17aa65b740 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f844a2f110 0x55f844a31500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17aa65b740 4 client.25496 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:07:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f844919860 con 0x55f844a2f110 2024-09-11T00:07:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17a5821640 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f844a2f110 0x55f844a31500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f1789ffb640 10 client.25496 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.668+0000 7f17a5821640 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f844a2f110 0x55f844a31500 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0523330c7f84557 server_cookie=922b7f2702a617c0 in_seq=0 out_seq=0 2024-09-11T00:07:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f1789ffb640 1 -- 172.21.15.19:0/123952960 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f844919860 con 0x55f844a2f110 2024-09-11T00:07:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f1789ffb640 10 client.25496 handle_command_reply: tid=0 2024-09-11T00:07:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 client.25496 shutdown 2024-09-11T00:07:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 msgr2=0x55f8449b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449b5d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f179c009380 tx=0x7f179c009310 comp rx=0 tx=0).stop 2024-09-11T00:07:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 shutdown_connections 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f844a2f110 0x55f844a31500 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f8449b1790 0x55f844a2d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f1789ffb640 0 client.25496 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8449a5800 0x55f8449b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 --2- 172.21.15.19:0/123952960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8449a4ee0 0x55f8449b5d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.670+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 >> 172.21.15.19:0/123952960 conn(0x55f8449a2d10 msgr2=0x55f8449b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.671+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 shutdown_connections 2024-09-11T00:07:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.671+0000 7f17aa65b740 1 -- 172.21.15.19:0/123952960 wait complete. 2024-09-11T00:07:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.671+0000 7f17aa65b740 20 client.25496 trim_cache size 0 max 16384 2024-09-11T00:07:17.685 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:07:17.685 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:07:17.685 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "d94c8430-0fd4-4004-964d-b1fff360fdfe", 2024-09-11T00:07:17.686 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:07:17.686 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:07:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f178c0b5450 msgr2=0x7f178c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f178c0b5450 0x7f178c0b7910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f17a010e800 tx=0x7f179000b390 comp rx=0 tx=0).stop 2024-09-11T00:07:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a0103b50 msgr2=0x7f17a019b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a0103b50 0x7f17a019b430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f179c00e9f0 tx=0x7f179c00edf0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 shutdown_connections 2024-09-11T00:07:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17a010d100 0x7f17a01a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17a0104550 0x7f17a019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f178c0b5450 0x7f178c0b7910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 --2- 172.21.15.19:0/2750808057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a0103b50 0x7f17a019b430 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 >> 172.21.15.19:0/2750808057 conn(0x7f17a00fd700 msgr2=0x7f17a010f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 shutdown_connections 2024-09-11T00:07:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:17.672+0000 7f17a8286640 1 -- 172.21.15.19:0/2750808057 wait complete. 2024-09-11T00:07:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:18 smithi135 ceph-mon[35432]: pgmap v468: 97 pgs: 97 active+clean; 676 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 225 op/s 2024-09-11T00:07:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:18 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:07:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:18 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:18 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:07:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:18 smithi019 ceph-mon[30859]: pgmap v468: 97 pgs: 97 active+clean; 676 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 225 op/s 2024-09-11T00:07:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:18 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:07:18.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:18 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:18.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:18 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:07:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:18 smithi131 ceph-mon[35491]: pgmap v468: 97 pgs: 97 active+clean; 676 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 225 op/s 2024-09-11T00:07:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:18 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:07:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:18 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:18 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:07:18.735 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:07:19.021 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:19.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:19 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:07:19.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:19 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:19 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:07:19.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:19 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.322 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:19 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:07:19.322 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:19 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:19 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:07:19.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:19 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:19 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:07:19.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:19 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:19 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:07:19.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:19 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:19 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:07:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:19 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:19 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:07:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:19 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:19 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:07:19.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:19 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 -- 172.21.15.19:0/3811700320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940102170 msgr2=0x7f494010eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 --2- 172.21.15.19:0/3811700320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940102170 0x7f494010eec0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f492c009900 tx=0x7f492c02a480 comp rx=0 tx=0).stop 2024-09-11T00:07:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 -- 172.21.15.19:0/3811700320 shutdown_connections 2024-09-11T00:07:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 --2- 172.21.15.19:0/3811700320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f494010f400 0x7f49401117f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 --2- 172.21.15.19:0/3811700320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940102170 0x7f494010eec0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 --2- 172.21.15.19:0/3811700320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4940101850 0x7f4940101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 -- 172.21.15.19:0/3811700320 >> 172.21.15.19:0/3811700320 conn(0x7f49400fd700 msgr2=0x7f49400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 -- 172.21.15.19:0/3811700320 shutdown_connections 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.565+0000 7f4946bb3640 1 -- 172.21.15.19:0/3811700320 wait complete. 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 Processor -- start 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 -- start start 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940101850 0x7f494019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4940102170 0x7f494019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f494010f400 0x7f49401a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4940114f40 con 0x7f4940101850 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4940114dc0 con 0x7f494010f400 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4946bb3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49401150c0 con 0x7f4940102170 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f493ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4940102170 0x7f494019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f494494f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940101850 0x7f494019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f493ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4940102170 0x7f494019ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60594/0 (socket says 172.21.15.19:60594) 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f493ffff640 1 -- 172.21.15.19:0/2823567557 learned_addr learned my addr 172.21.15.19:0/2823567557 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.566+0000 7f4945150640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f494010f400 0x7f49401a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493ffff640 1 -- 172.21.15.19:0/2823567557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f494010f400 msgr2=0x7f49401a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493ffff640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f494010f400 0x7f49401a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493ffff640 1 -- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940101850 msgr2=0x7f494019b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493ffff640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940101850 0x7f494019b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493ffff640 1 -- 172.21.15.19:0/2823567557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49401a15a0 con 0x7f4940102170 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493ffff640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4940102170 0x7f494019ba30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f492c005940 tx=0x7f492c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493dffb640 1 -- 172.21.15.19:0/2823567557 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c03f030 con 0x7f4940102170 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49401a1830 con 0x7f4940102170 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493dffb640 1 -- 172.21.15.19:0/2823567557 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f492c003aa0 con 0x7f4940102170 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.567+0000 7f493dffb640 1 -- 172.21.15.19:0/2823567557 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c035070 con 0x7f4940102170 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.568+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49401a7f50 con 0x7f4940102170 2024-09-11T00:07:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 Processor -- start 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 -- start start 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f493dffb640 1 -- 172.21.15.19:0/2823567557 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f492c03bce0 con 0x7f4940102170 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4eea480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea9c0 0x559ff4ef6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559ff4e60e50 con 0x559ff4eea0a0 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559ff4e50280 con 0x559ff4ef6950 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.570+0000 7f4948f88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559ff4e54090 con 0x559ff4eea9c0 2024-09-11T00:07:19.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4eea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4eea480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51038/0 (socket says 172.21.15.19:51038) 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 -- 172.21.15.19:0/157759964 learned_addr learned my addr 172.21.15.19:0/157759964 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f493ffff640 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 -- 172.21.15.19:0/157759964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea9c0 msgr2=0x559ff4ef6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea9c0 0x559ff4ef6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 -- 172.21.15.19:0/157759964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 msgr2=0x559ff4ef8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.571+0000 7f4945150640 1 -- 172.21.15.19:0/157759964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff4bae650 con 0x559ff4eea0a0 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.572+0000 7f4945150640 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4eea480 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4938009f50 tx=0x7f49380118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69479a1a128f8dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.572+0000 7f493dffb640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49300b5450 0x7f49300b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.572+0000 7f492affd640 1 -- 172.21.15.19:0/157759964 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938004b20 con 0x559ff4eea0a0 2024-09-11T00:07:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.572+0000 7f492affd640 1 -- 172.21.15.19:0/157759964 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4938004cc0 con 0x559ff4eea0a0 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.572+0000 7f492affd640 1 -- 172.21.15.19:0/157759964 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49380053e0 con 0x559ff4eea0a0 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.572+0000 7f493dffb640 1 -- 172.21.15.19:0/2823567557 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f492c106890 con 0x7f4940102170 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f494494f640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49300b5450 0x7f49300b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f4948f88740 1 -- 172.21.15.19:0/157759964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 msgr2=0x559ff4eea480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f4948f88740 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4eea480 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4938009f50 tx=0x7f49380118d0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f4948f88740 1 -- 172.21.15.19:0/157759964 shutdown_connections 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f4948f88740 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f4948f88740 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea9c0 0x559ff4ef6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f4948f88740 1 --2- 172.21.15.19:0/157759964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4eea480 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.573+0000 7f4948f88740 1 -- 172.21.15.19:0/157759964 >> 172.21.15.19:0/157759964 conn(0x559ff4ee7ed0 msgr2=0x559ff4ee9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.574+0000 7f494494f640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49300b5450 0x7f49300b7910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559ff4ee8db0 tx=0x7f493400b7d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.574+0000 7f4948f88740 1 -- 172.21.15.19:0/157759964 shutdown_connections 2024-09-11T00:07:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.574+0000 7f4948f88740 1 -- 172.21.15.19:0/157759964 wait complete. 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.574+0000 7f4948f88740 1 -- start start 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.574+0000 7f4948f88740 1 Processor -- start 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4948f88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4948f88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea9c0 0x559ff4ef3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4948f88740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4948f88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559ff4cb1700 con 0x559ff4eea9c0 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4948f88740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559ff4deb110 con 0x559ff4ef6950 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4948f88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559ff4f01de0 con 0x559ff4eea0a0 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4948f88740 10 client.0 _ll_register_callbacks cb 0x559ff4e04990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f494494f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f493ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea9c0 0x559ff4ef3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f494494f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60618/0 (socket says 172.21.15.19:60618) 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f494494f640 1 -- 172.21.15.19:0/4067473432 learned_addr learned my addr 172.21.15.19:0/4067473432 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.575+0000 7f4945150640 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f494494f640 1 -- 172.21.15.19:0/4067473432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 msgr2=0x559ff4ef3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f494494f640 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f494494f640 1 -- 172.21.15.19:0/4067473432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea9c0 msgr2=0x559ff4ef3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f494494f640 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea9c0 0x559ff4ef3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f494494f640 1 -- 172.21.15.19:0/4067473432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ff4e18c40 con 0x559ff4eea0a0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f493ffff640 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea9c0 0x559ff4ef3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f494494f640 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef62e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f49340116c0 tx=0x7f493400b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf576e58acc09440 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f491ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f491ffff640 1 -- 172.21.15.19:0/4067473432 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493401e830 con 0x559ff4eea0a0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f491ffff640 1 -- 172.21.15.19:0/4067473432 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f493401e9d0 con 0x559ff4eea0a0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.576+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4938004cc0 con 0x559ff4eea0a0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f491ffff640 1 -- 172.21.15.19:0/4067473432 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f493401ebd0 con 0x559ff4eea0a0 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 10 client.25714 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559ff4f0d7d0 con 0x559ff4eea0a0 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f491ffff640 1 -- 172.21.15.19:0/4067473432 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4938004cc0 con 0x559ff4eea0a0 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f491ffff640 1 -- 172.21.15.19:0/4067473432 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f4934026490 con 0x559ff4eea0a0 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 10 client.25714 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 10 client.25714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 20 client.25714 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f11420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 4 client.25714 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ff4e62da0 con 0x559ff4f0ef80 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.577+0000 7f493ffff640 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f11420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.578+0000 7f491ffff640 10 client.25714 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.578+0000 7f493ffff640 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f11420 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6fc49917e958172 server_cookie=410056d7768a686b in_seq=0 out_seq=0 2024-09-11T00:07:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f491ffff640 1 -- 172.21.15.19:0/4067473432 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ff4e62da0 con 0x559ff4f0ef80 2024-09-11T00:07:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f491ffff640 10 client.25714 handle_command_reply: tid=0 2024-09-11T00:07:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 client.25714 shutdown 2024-09-11T00:07:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 msgr2=0x559ff4ef62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef62e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f49340116c0 tx=0x7f493400b410 comp rx=0 tx=0).stop 2024-09-11T00:07:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 shutdown_connections 2024-09-11T00:07:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4ef6950 0x559ff4ef3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f11420 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea9c0 0x559ff4ef3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f491ffff640 0 client.25714 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 --2- 172.21.15.19:0/4067473432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef62e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.579+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 >> 172.21.15.19:0/4067473432 conn(0x559ff4ee7ed0 msgr2=0x559ff4eeda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.580+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 shutdown_connections 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.580+0000 7f4948f88740 1 -- 172.21.15.19:0/4067473432 wait complete. 2024-09-11T00:07:19.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.580+0000 7f4948f88740 20 client.25714 trim_cache size 0 max 16384 2024-09-11T00:07:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 Processor -- start 2024-09-11T00:07:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 -- start start 2024-09-11T00:07:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4f0afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4ef2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4ef6950 0x559ff4ef1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49401aece0 con 0x559ff4eea0a0 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49401ac580 con 0x559ff4eea9c0 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4948f88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49401aa3d0 con 0x559ff4ef6950 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f494494f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4f0afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f494494f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4f0afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51062/0 (socket says 172.21.15.19:51062) 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f494494f640 1 -- 172.21.15.19:0/2230878406 learned_addr learned my addr 172.21.15.19:0/2230878406 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f4945150640 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4ef6950 0x559ff4ef1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.599+0000 7f493ffff640 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4ef2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f494494f640 1 -- 172.21.15.19:0/2230878406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4ef6950 msgr2=0x559ff4ef1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f494494f640 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4ef6950 0x559ff4ef1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f494494f640 1 -- 172.21.15.19:0/2230878406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 msgr2=0x559ff4ef2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f494494f640 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4ef2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f494494f640 1 -- 172.21.15.19:0/2230878406 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff4ef4170 con 0x559ff4eea0a0 2024-09-11T00:07:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f493ffff640 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4ef2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f494494f640 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4f0afd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f49340268e0 tx=0x7f493400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27389fb7d019bd12 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f492a7fc640 1 -- 172.21.15.19:0/2230878406 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934026cd0 con 0x559ff4eea0a0 2024-09-11T00:07:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f492a7fc640 1 -- 172.21.15.19:0/2230878406 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4934037040 con 0x559ff4eea0a0 2024-09-11T00:07:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.600+0000 7f492a7fc640 1 -- 172.21.15.19:0/2230878406 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934030810 con 0x559ff4eea0a0 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 -- 172.21.15.19:0/2230878406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 msgr2=0x559ff4f0afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4f0afd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f49340268e0 tx=0x7f493400be10 comp rx=0 tx=0).stop 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 -- 172.21.15.19:0/2230878406 shutdown_connections 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4ef6950 0x559ff4ef1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4ef2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 --2- 172.21.15.19:0/2230878406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4eea0a0 0x559ff4f0afd0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 -- 172.21.15.19:0/2230878406 >> 172.21.15.19:0/2230878406 conn(0x559ff4ee7ed0 msgr2=0x559ff4eee9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 -- 172.21.15.19:0/2230878406 shutdown_connections 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 -- 172.21.15.19:0/2230878406 wait complete. 2024-09-11T00:07:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.601+0000 7f4948f88740 1 -- start start 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 1 Processor -- start 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4f07030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4ef6950 0x559ff4f077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49401aaa40 con 0x559ff4ef6950 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49401abeb0 con 0x559ff4eea9c0 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49401ab110 con 0x559ff4eea0a0 2024-09-11T00:07:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4948f88740 10 client.0 _ll_register_callbacks cb 0x7f4934010ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f494494f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f494494f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60644/0 (socket says 172.21.15.19:60644) 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f494494f640 1 -- 172.21.15.19:0/975676751 learned_addr learned my addr 172.21.15.19:0/975676751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f493ffff640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4f07030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.602+0000 7f4945150640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4ef6950 0x559ff4f077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f494494f640 1 -- 172.21.15.19:0/975676751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 msgr2=0x559ff4f07030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f494494f640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4f07030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f494494f640 1 -- 172.21.15.19:0/975676751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4ef6950 msgr2=0x559ff4f077c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f494494f640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4ef6950 0x559ff4f077c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f494494f640 1 -- 172.21.15.19:0/975676751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ff4eea7f0 con 0x559ff4eea0a0 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f493ffff640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4f07030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f494494f640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef1390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49340116c0 tx=0x7f493400bb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=512961c322fe6537 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f491ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:07:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f491ffff640 1 -- 172.21.15.19:0/975676751 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934026ad0 con 0x559ff4eea0a0 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f491ffff640 1 -- 172.21.15.19:0/975676751 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f4934026c70 con 0x559ff4eea0a0 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4934037040 con 0x559ff4eea0a0 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f491ffff640 1 -- 172.21.15.19:0/975676751 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f493401e630 con 0x559ff4eea0a0 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f4948f88740 10 client.25720 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.603+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559ff4f7c070 con 0x559ff4eea0a0 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f491ffff640 1 -- 172.21.15.19:0/975676751 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4934037040 con 0x559ff4eea0a0 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f491ffff640 1 -- 172.21.15.19:0/975676751 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f4934030b60 con 0x559ff4eea0a0 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f4948f88740 10 client.25720 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f4948f88740 10 client.25720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f4948f88740 20 client.25720 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f4948f88740 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f7e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f4948f88740 4 client.25720 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:07:19.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559ff4e5e850 con 0x559ff4f0ef80 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f493ffff640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f7e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f491ffff640 10 client.25720 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.604+0000 7f493ffff640 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f7e740 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c754c87581196f6b server_cookie=a66ba6a23165c8b9 in_seq=0 out_seq=0 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f491ffff640 1 -- 172.21.15.19:0/975676751 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x559ff4e5e850 con 0x559ff4f0ef80 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f491ffff640 10 client.25720 handle_command_reply: tid=0 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 client.25720 shutdown 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 msgr2=0x559ff4ef1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef1390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49340116c0 tx=0x7f493400bb00 comp rx=0 tx=0).stop 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 shutdown_connections 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559ff4f0ef80 0x559ff4f7e740 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ff4ef6950 0x559ff4f077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ff4eea9c0 0x559ff4f07030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f491ffff640 0 client.25720 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 --2- 172.21.15.19:0/975676751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ff4eea0a0 0x559ff4ef1390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 >> 172.21.15.19:0/975676751 conn(0x559ff4ee7ed0 msgr2=0x559ff4ef1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 shutdown_connections 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 1 -- 172.21.15.19:0/975676751 wait complete. 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.605+0000 7f4948f88740 20 client.25720 trim_cache size 0 max 16384 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:07:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "d94c8430-0fd4-4004-964d-b1fff360fdfe", 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:07:19.617 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49300b5450 msgr2=0x7f49300b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49300b5450 0x7f49300b7910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559ff4ee8db0 tx=0x7f493400b7d0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4940102170 msgr2=0x7f494019ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4940102170 0x7f494019ba30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f492c005940 tx=0x7f492c004270 comp rx=0 tx=0).stop 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 shutdown_connections 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f494010f400 0x7f49401a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4940102170 0x7f494019ba30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49300b5450 0x7f49300b7910 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 --2- 172.21.15.19:0/2823567557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4940101850 0x7f494019b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 >> 172.21.15.19:0/2823567557 conn(0x7f49400fd700 msgr2=0x7f49400ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 shutdown_connections 2024-09-11T00:07:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:19.606+0000 7f4946bb3640 1 -- 172.21.15.19:0/2823567557 wait complete. 2024-09-11T00:07:20.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:20 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:07:20.203 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:20 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:20.203 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:20 smithi019 ceph-mon[30859]: pgmap v469: 97 pgs: 97 active+clean; 674 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 258 op/s 2024-09-11T00:07:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:20 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:07:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:20 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:20 smithi135 ceph-mon[35432]: pgmap v469: 97 pgs: 97 active+clean; 674 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 258 op/s 2024-09-11T00:07:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:20 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:07:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:20 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:20 smithi131 ceph-mon[35491]: pgmap v469: 97 pgs: 97 active+clean; 674 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 258 op/s 2024-09-11T00:07:20.694 INFO:tasks.cephfs.filesystem:scrub status for tag:d94c8430-0fd4-4004-964d-b1fff360fdfe - {'path': '/', 'tag': 'd94c8430-0fd4-4004-964d-b1fff360fdfe', 'options': 'recursive,force'} 2024-09-11T00:07:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:22 smithi135 ceph-mon[35432]: pgmap v470: 97 pgs: 97 active+clean; 673 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 280 op/s 2024-09-11T00:07:22.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:22 smithi019 ceph-mon[30859]: pgmap v470: 97 pgs: 97 active+clean; 673 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 280 op/s 2024-09-11T00:07:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:22 smithi131 ceph-mon[35491]: pgmap v470: 97 pgs: 97 active+clean; 673 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 280 op/s 2024-09-11T00:07:23.115 INFO:tasks.workunit.client.0.smithi019.stdout: 114 407446 149 279202 222 235397 604 2024-09-11T00:07:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:24 smithi135 ceph-mon[35432]: pgmap v471: 97 pgs: 97 active+clean; 676 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 355 op/s 2024-09-11T00:07:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:24 smithi019 ceph-mon[30859]: pgmap v471: 97 pgs: 97 active+clean; 676 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 355 op/s 2024-09-11T00:07:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:24 smithi131 ceph-mon[35491]: pgmap v471: 97 pgs: 97 active+clean; 676 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 355 op/s 2024-09-11T00:07:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:26 smithi135 ceph-mon[35432]: pgmap v472: 97 pgs: 97 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 380 op/s 2024-09-11T00:07:26.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:26 smithi019 ceph-mon[30859]: pgmap v472: 97 pgs: 97 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 380 op/s 2024-09-11T00:07:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:26 smithi131 ceph-mon[35491]: pgmap v472: 97 pgs: 97 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 380 op/s 2024-09-11T00:07:28.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:28 smithi135 ceph-mon[35432]: pgmap v473: 97 pgs: 97 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 478 op/s 2024-09-11T00:07:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:28 smithi019 ceph-mon[30859]: pgmap v473: 97 pgs: 97 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 478 op/s 2024-09-11T00:07:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:28 smithi131 ceph-mon[35491]: pgmap v473: 97 pgs: 97 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 478 op/s 2024-09-11T00:07:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:30 smithi135 ceph-mon[35432]: pgmap v474: 97 pgs: 97 active+clean; 680 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 439 op/s 2024-09-11T00:07:30.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:30 smithi019 ceph-mon[30859]: pgmap v474: 97 pgs: 97 active+clean; 680 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 439 op/s 2024-09-11T00:07:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:30 smithi131 ceph-mon[35491]: pgmap v474: 97 pgs: 97 active+clean; 680 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 439 op/s 2024-09-11T00:07:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:32 smithi135 ceph-mon[35432]: pgmap v475: 97 pgs: 97 active+clean; 686 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 490 op/s 2024-09-11T00:07:32.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:32 smithi019 ceph-mon[30859]: pgmap v475: 97 pgs: 97 active+clean; 686 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 490 op/s 2024-09-11T00:07:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:32 smithi131 ceph-mon[35491]: pgmap v475: 97 pgs: 97 active+clean; 686 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 490 op/s 2024-09-11T00:07:33.115 INFO:tasks.workunit.client.0.smithi019.stdout: 114 282 2 187 0 191 5 2024-09-11T00:07:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:34 smithi135 ceph-mon[35432]: pgmap v476: 97 pgs: 97 active+clean; 689 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 549 op/s 2024-09-11T00:07:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:34 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:34 smithi019 ceph-mon[30859]: pgmap v476: 97 pgs: 97 active+clean; 689 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 549 op/s 2024-09-11T00:07:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:34 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:34.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:34 smithi131 ceph-mon[35491]: pgmap v476: 97 pgs: 97 active+clean; 689 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 549 op/s 2024-09-11T00:07:34.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:34 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:07:36.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:36 smithi135 ceph-mon[35432]: pgmap v477: 97 pgs: 97 active+clean; 690 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.3 MiB/s wr, 478 op/s 2024-09-11T00:07:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:36 smithi019 ceph-mon[30859]: pgmap v477: 97 pgs: 97 active+clean; 690 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.3 MiB/s wr, 478 op/s 2024-09-11T00:07:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:36 smithi131 ceph-mon[35491]: pgmap v477: 97 pgs: 97 active+clean; 690 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.3 MiB/s wr, 478 op/s 2024-09-11T00:07:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:38 smithi135 ceph-mon[35432]: pgmap v478: 97 pgs: 97 active+clean; 694 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 543 op/s 2024-09-11T00:07:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:38 smithi019 ceph-mon[30859]: pgmap v478: 97 pgs: 97 active+clean; 694 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 543 op/s 2024-09-11T00:07:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:38 smithi131 ceph-mon[35491]: pgmap v478: 97 pgs: 97 active+clean; 694 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 543 op/s 2024-09-11T00:07:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:40 smithi135 ceph-mon[35432]: pgmap v479: 97 pgs: 97 active+clean; 695 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-09-11T00:07:40.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:40 smithi019 ceph-mon[30859]: pgmap v479: 97 pgs: 97 active+clean; 695 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-09-11T00:07:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:40 smithi131 ceph-mon[35491]: pgmap v479: 97 pgs: 97 active+clean; 695 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-09-11T00:07:42.352 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:42 smithi131 ceph-mon[35491]: pgmap v480: 97 pgs: 97 active+clean; 697 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.5 MiB/s wr, 394 op/s 2024-09-11T00:07:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:42 smithi135 ceph-mon[35432]: pgmap v480: 97 pgs: 97 active+clean; 697 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.5 MiB/s wr, 394 op/s 2024-09-11T00:07:42.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:42 smithi019 ceph-mon[30859]: pgmap v480: 97 pgs: 97 active+clean; 697 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.5 MiB/s wr, 394 op/s 2024-09-11T00:07:43.115 INFO:tasks.workunit.client.0.smithi019.stdout: 116 7139 141 5433 52 6949 264 2024-09-11T00:07:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:44 smithi135 ceph-mon[35432]: pgmap v481: 97 pgs: 97 active+clean; 703 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 352 op/s 2024-09-11T00:07:44.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:44 smithi019 ceph-mon[30859]: pgmap v481: 97 pgs: 97 active+clean; 703 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 352 op/s 2024-09-11T00:07:44.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:44 smithi131 ceph-mon[35491]: pgmap v481: 97 pgs: 97 active+clean; 703 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 352 op/s 2024-09-11T00:07:45.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:45 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:07:45.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:45 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:07:45.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:45 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:07:45.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:45 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:07:45.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:45 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:07:45.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:45 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:07:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:46 smithi135 ceph-mon[35432]: pgmap v482: 97 pgs: 97 active+clean; 704 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 1.3 MiB/s wr, 268 op/s 2024-09-11T00:07:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:46 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:07:46.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:46 smithi019 ceph-mon[30859]: pgmap v482: 97 pgs: 97 active+clean; 704 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 1.3 MiB/s wr, 268 op/s 2024-09-11T00:07:46.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:46 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:07:46.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:46 smithi131 ceph-mon[35491]: pgmap v482: 97 pgs: 97 active+clean; 704 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 1.3 MiB/s wr, 268 op/s 2024-09-11T00:07:46.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:46 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:07:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:48 smithi135 ceph-mon[35432]: pgmap v483: 97 pgs: 97 active+clean; 703 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.3 MiB/s wr, 287 op/s 2024-09-11T00:07:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:48 smithi019 ceph-mon[30859]: pgmap v483: 97 pgs: 97 active+clean; 703 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.3 MiB/s wr, 287 op/s 2024-09-11T00:07:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:48 smithi131 ceph-mon[35491]: pgmap v483: 97 pgs: 97 active+clean; 703 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.3 MiB/s wr, 287 op/s 2024-09-11T00:07:50.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:50 smithi135 ceph-mon[35432]: pgmap v484: 97 pgs: 97 active+clean; 710 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 211 op/s 2024-09-11T00:07:50.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:50 smithi019 ceph-mon[30859]: pgmap v484: 97 pgs: 97 active+clean; 710 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 211 op/s 2024-09-11T00:07:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:50 smithi131 ceph-mon[35491]: pgmap v484: 97 pgs: 97 active+clean; 710 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 211 op/s 2024-09-11T00:07:50.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:07:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/4108437929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 msgr2=0x7f5d9810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/4108437929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d9810f5d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009900 tx=0x7f5d8802a410 comp rx=0 tx=0).stop 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/4108437929 shutdown_connections 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/4108437929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d9810f5d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/4108437929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d981045b0 0x7f5d9810cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/4108437929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d98103bb0 0x7f5d98103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/4108437929 >> 172.21.15.19:0/4108437929 conn(0x7f5d980fd7c0 msgr2=0x7f5d980ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/4108437929 shutdown_connections 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.505+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/4108437929 wait complete. 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 Processor -- start 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 -- start start 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d98103bb0 0x7f5d98101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d981045b0 0x7f5d98101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d981024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d98112e30 con 0x7f5d9810d160 2024-09-11T00:07:51.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d98112cb0 con 0x7f5d981045b0 2024-09-11T00:07:51.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.506+0000 7f5d9d4a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d98112fb0 con 0x7f5d98103bb0 2024-09-11T00:07:51.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d981024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d98103bb0 0x7f5d98101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d981024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36872/0 (socket says 172.21.15.19:36872) 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d977fe640 1 -- 172.21.15.19:0/3707115586 learned_addr learned my addr 172.21.15.19:0/3707115586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d98103bb0 0x7f5d98101a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50382/0 (socket says 172.21.15.19:50382) 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d967fc640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d981045b0 0x7f5d98101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 -- 172.21.15.19:0/3707115586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d981045b0 msgr2=0x7f5d98101f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d981045b0 0x7f5d98101f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 -- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 msgr2=0x7f5d981024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d981024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 -- 172.21.15.19:0/3707115586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d981a7620 con 0x7f5d98103bb0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d977fe640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d981024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d96ffd640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d98103bb0 0x7f5d98101a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000cce0 tx=0x7f5d9000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3707115586 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000f450 con 0x7f5d98103bb0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d981a7910 con 0x7f5d98103bb0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3707115586 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d9000faa0 con 0x7f5d98103bb0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3707115586 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90018a60 con 0x7f5d98103bb0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.507+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d981a7ea0 con 0x7f5d98103bb0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.510+0000 7f5d9f877740 1 Processor -- start 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.510+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3707115586 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f5d90018c20 con 0x7f5d98103bb0 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.510+0000 7f5d9f877740 1 -- start start 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492472c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x5649247387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x56492473b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d9f877740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5649246a2e50 con 0x56492472c480 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d9f877740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564924692280 con 0x564924738d30 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d9f877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564924696090 con 0x56492472cda0 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492472c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492472c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36876/0 (socket says 172.21.15.19:36876) 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 -- 172.21.15.19:0/1984443554 learned_addr learned my addr 172.21.15.19:0/1984443554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d96ffd640 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x5649247387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d967fc640 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x56492473b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 -- 172.21.15.19:0/1984443554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 msgr2=0x5649247387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x5649247387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 -- 172.21.15.19:0/1984443554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 msgr2=0x56492473b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x56492473b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 -- 172.21.15.19:0/1984443554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649243f0650 con 0x56492472c480 2024-09-11T00:07:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d967fc640 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x56492473b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d8ffff640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d840b5450 0x7f5d840b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.511+0000 7f5d977fe640 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492472c860 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5d8802a930 tx=0x7f5d88009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149895738895a4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d96ffd640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d840b5450 0x7f5d840b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d8d7fa640 1 -- 172.21.15.19:0/1984443554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88040070 con 0x56492472c480 2024-09-11T00:07:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d8d7fa640 1 -- 172.21.15.19:0/1984443554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d88003830 con 0x56492472c480 2024-09-11T00:07:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d8d7fa640 1 -- 172.21.15.19:0/1984443554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88035040 con 0x56492472c480 2024-09-11T00:07:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d8ffff640 1 -- 172.21.15.19:0/3707115586 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5d900e62c0 con 0x7f5d98103bb0 2024-09-11T00:07:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d9f877740 1 -- 172.21.15.19:0/1984443554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 msgr2=0x56492472c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492472c860 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5d8802a930 tx=0x7f5d88009670 comp rx=0 tx=0).stop 2024-09-11T00:07:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.512+0000 7f5d96ffd640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d840b5450 0x7f5d840b7910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d900e3b40 tx=0x7f5d900e9e10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- 172.21.15.19:0/1984443554 shutdown_connections 2024-09-11T00:07:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x56492473b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x5649247387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1984443554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492472c860 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- 172.21.15.19:0/1984443554 >> 172.21.15.19:0/1984443554 conn(0x56492472a2b0 msgr2=0x56492472b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- 172.21.15.19:0/1984443554 shutdown_connections 2024-09-11T00:07:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- 172.21.15.19:0/1984443554 wait complete. 2024-09-11T00:07:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- start start 2024-09-11T00:07:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 Processor -- start 2024-09-11T00:07:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924738660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x564924735ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x564924736130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5649244f3700 con 0x56492472c480 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56492462d110 con 0x564924738d30 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56492473b950 con 0x56492472cda0 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d9f877740 10 client.0 _ll_register_callbacks cb 0x564924646990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924738660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924738660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36878/0 (socket says 172.21.15.19:36878) 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d977fe640 1 -- 172.21.15.19:0/1002155759 learned_addr learned my addr 172.21.15.19:0/1002155759 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.513+0000 7f5d967fc640 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x564924735ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d977fe640 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x564924736130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d977fe640 1 -- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 msgr2=0x564924735ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d977fe640 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x564924735ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d977fe640 1 -- 172.21.15.19:0/1002155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 msgr2=0x564924736130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d977fe640 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x564924736130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d977fe640 1 -- 172.21.15.19:0/1002155759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492465ac40 con 0x56492472c480 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d977fe640 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924738660 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5d88031440 tx=0x7f5d88009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c364bc12875f2dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/1002155759 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88052060 con 0x56492472c480 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/1002155759 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5d88031970 con 0x56492472c480 2024-09-11T00:07:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d88003830 con 0x56492472c480 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/1002155759 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5d88048070 con 0x56492472c480 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d9f877740 10 client.16137 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.514+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564924747260 con 0x56492472c480 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/1002155759 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d88003830 con 0x56492472c480 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/1002155759 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f5d8803cbf0 con 0x56492472c480 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d9f877740 10 client.16137 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d9f877740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d9f877740 20 client.16137 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247485b0 0x56492474a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d9f877740 4 client.16137 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649246a4da0 con 0x5649247485b0 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d967fc640 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247485b0 0x56492474a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d967fc640 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247485b0 0x56492474a9a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed0f5a5561ada284 server_cookie=43a156541bd13c40 in_seq=0 out_seq=0 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.515+0000 7f5d7e7fc640 10 client.16137 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/1002155759 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5649246a4da0 con 0x5649247485b0 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d7e7fc640 10 client.16137 handle_command_reply: tid=0 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 client.16137 shutdown 2024-09-11T00:07:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 msgr2=0x564924738660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924738660 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5d88031440 tx=0x7f5d88009260 comp rx=0 tx=0).stop 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 shutdown_connections 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564924738d30 0x564924736130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56492472cda0 0x564924735ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247485b0 0x56492474a9a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d7e7fc640 0 client.16137 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 --2- 172.21.15.19:0/1002155759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924738660 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.516+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 >> 172.21.15.19:0/1002155759 conn(0x56492472a2b0 msgr2=0x56492472fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.517+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 shutdown_connections 2024-09-11T00:07:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.517+0000 7f5d9f877740 1 -- 172.21.15.19:0/1002155759 wait complete. 2024-09-11T00:07:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.517+0000 7f5d9f877740 20 client.16137 trim_cache size 0 max 16384 2024-09-11T00:07:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.534+0000 7f5d9f877740 1 Processor -- start 2024-09-11T00:07:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.534+0000 7f5d9f877740 1 -- start start 2024-09-11T00:07:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924744c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492472ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x56492473a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d9f877740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d981b2e80 con 0x56492472c480 2024-09-11T00:07:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d9f877740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d981b0720 con 0x56492472cda0 2024-09-11T00:07:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d9f877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d981ae570 con 0x564924738d30 2024-09-11T00:07:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924744c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924744c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36894/0 (socket says 172.21.15.19:36894) 2024-09-11T00:07:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 -- 172.21.15.19:0/3254059337 learned_addr learned my addr 172.21.15.19:0/3254059337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x56492473a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d967fc640 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492472ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 -- 172.21.15.19:0/3254059337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 msgr2=0x56492473a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x56492473a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 -- 172.21.15.19:0/3254059337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 msgr2=0x56492472ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492472ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 -- 172.21.15.19:0/3254059337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564924725940 con 0x56492472c480 2024-09-11T00:07:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d967fc640 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492472ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.535+0000 7f5d977fe640 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924744c20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5d8802ac00 tx=0x7f5d8802ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9434752eaf230e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3254059337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88052050 con 0x56492472c480 2024-09-11T00:07:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3254059337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d88057e50 con 0x56492472c480 2024-09-11T00:07:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d8cff9640 1 -- 172.21.15.19:0/3254059337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88040070 con 0x56492472c480 2024-09-11T00:07:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 -- 172.21.15.19:0/3254059337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 msgr2=0x564924744c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924744c20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5d8802ac00 tx=0x7f5d8802ab90 comp rx=0 tx=0).stop 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 -- 172.21.15.19:0/3254059337 shutdown_connections 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x56492473a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492472ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 --2- 172.21.15.19:0/3254059337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x564924744c20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 -- 172.21.15.19:0/3254059337 >> 172.21.15.19:0/3254059337 conn(0x56492472a2b0 msgr2=0x56492472b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.536+0000 7f5d9f877740 1 -- 172.21.15.19:0/3254059337 shutdown_connections 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 -- 172.21.15.19:0/3254059337 wait complete. 2024-09-11T00:07:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 -- start start 2024-09-11T00:07:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 Processor -- start 2024-09-11T00:07:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492474a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492474a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x5649247b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d981aebe0 con 0x56492472c480 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d981b0050 con 0x56492472cda0 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d981af2b0 con 0x564924738d30 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d9f877740 10 client.0 _ll_register_callbacks cb 0x7f5d900e9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492474a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492474a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36908/0 (socket says 172.21.15.19:36908) 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.537+0000 7f5d977fe640 1 -- 172.21.15.19:0/423412263 learned_addr learned my addr 172.21.15.19:0/423412263 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d977fe640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x5649247b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d967fc640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492474a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d977fe640 1 -- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 msgr2=0x5649247b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d977fe640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x5649247b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d977fe640 1 -- 172.21.15.19:0/423412263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 msgr2=0x56492474a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d977fe640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492474a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d977fe640 1 -- 172.21.15.19:0/423412263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649247b46f0 con 0x56492472c480 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d967fc640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492474a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d977fe640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492474a0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5d88057480 tx=0x7f5d88031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c678c7912d0d45a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/423412263 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88052050 con 0x56492472c480 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/423412263 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f5d88057ba0 con 0x56492472c480 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d88057e50 con 0x56492472c480 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/423412263 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5d88040040 con 0x56492472c480 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d9f877740 10 client.16143 fetch_fsmap learned FSMap version 32 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.538+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649247b5970 con 0x56492472c480 2024-09-11T00:07:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/423412263 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d88057e50 con 0x56492472c480 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/423412263 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f5d8803c880 con 0x56492472c480 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d9f877740 10 client.16143 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d9f877740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d9f877740 20 client.16143 populate_metadata read hostname 'smithi019' 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d9f877740 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247b5da0 0x5649247b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d9f877740 4 client.16143 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5649246a0850 con 0x5649247b5da0 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d967fc640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247b5da0 0x5649247b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d7e7fc640 10 client.16143 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.539+0000 7f5d967fc640 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247b5da0 0x5649247b8190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=111a2af3d58b99ba server_cookie=645803a08b4ddd11 in_seq=0 out_seq=0 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d7e7fc640 1 -- 172.21.15.19:0/423412263 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x5649246a0850 con 0x5649247b5da0 2024-09-11T00:07:51.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d7e7fc640 10 client.16143 handle_command_reply: tid=0 2024-09-11T00:07:51.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 client.16143 shutdown 2024-09-11T00:07:51.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 msgr2=0x56492474a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492474a0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5d88057480 tx=0x7f5d88031770 comp rx=0 tx=0).stop 2024-09-11T00:07:51.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 shutdown_connections 2024-09-11T00:07:51.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564924738d30 0x5649247b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56492472cda0 0x56492474a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5649247b5da0 0x5649247b8190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d7e7fc640 0 client.16143 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:07:51.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 --2- 172.21.15.19:0/423412263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56492472c480 0x56492474a0a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 >> 172.21.15.19:0/423412263 conn(0x56492472a2b0 msgr2=0x5649247370e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:51.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 shutdown_connections 2024-09-11T00:07:51.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 1 -- 172.21.15.19:0/423412263 wait complete. 2024-09-11T00:07:51.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.540+0000 7f5d9f877740 20 client.16143 trim_cache size 0 max 16384 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:51.558 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:51.560 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:51.561 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:51.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:51.561 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:07:51.561 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:07:51.561 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:51.561 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:51.562 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:51.563 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:07:51.564 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:07:51.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d840b5450 msgr2=0x7f5d840b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d840b5450 0x7f5d840b7910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d900e3b40 tx=0x7f5d900e9e10 comp rx=0 tx=0).stop 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d98103bb0 msgr2=0x7f5d98101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d98103bb0 0x7f5d98101a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000cce0 tx=0x7f5d9000a620 comp rx=0 tx=0).stop 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 shutdown_connections 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f5d840b5450 0x7f5d840b7910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9810d160 0x7f5d981024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d981045b0 0x7f5d98101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 --2- 172.21.15.19:0/3707115586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d98103bb0 0x7f5d98101a30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:51.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 >> 172.21.15.19:0/3707115586 conn(0x7f5d980fd7c0 msgr2=0x7f5d980fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:51.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 shutdown_connections 2024-09-11T00:07:51.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:51.541+0000 7f5d9d4a2640 1 -- 172.21.15.19:0/3707115586 wait complete. 2024-09-11T00:07:52.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:52 smithi135 ceph-mon[35432]: pgmap v485: 97 pgs: 97 active+clean; 706 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-09-11T00:07:52.447 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:52 smithi019 ceph-mon[30859]: pgmap v485: 97 pgs: 97 active+clean; 706 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-09-11T00:07:52.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:52 smithi131 ceph-mon[35491]: pgmap v485: 97 pgs: 97 active+clean; 706 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-09-11T00:07:52.936 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:07:52.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:07:53.116 INFO:tasks.workunit.client.0.smithi019.stdout: 116 377290 227 256510 234 228339 691 2024-09-11T00:07:54.330 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:54.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:54 smithi135 ceph-mon[35432]: pgmap v486: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 228 op/s 2024-09-11T00:07:54.455 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:54 smithi019 ceph-mon[30859]: pgmap v486: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 228 op/s 2024-09-11T00:07:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:54 smithi131 ceph-mon[35491]: pgmap v486: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 228 op/s 2024-09-11T00:07:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 -- 172.21.15.19:0/1824361848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 msgr2=0x7fcc8810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/1824361848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 0x7fcc8810e820 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009be0 tx=0x7fcc8002a6c0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 -- 172.21.15.19:0/1824361848 shutdown_connections 2024-09-11T00:07:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/1824361848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 0x7fcc8810e820 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/1824361848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 0x7fcc88107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/1824361848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101c90 0x7fcc88102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 -- 172.21.15.19:0/1824361848 >> 172.21.15.19:0/1824361848 conn(0x7fcc880fd700 msgr2=0x7fcc880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.032+0000 7fcc8ff82640 1 -- 172.21.15.19:0/1824361848 shutdown_connections 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.033+0000 7fcc8ff82640 1 -- 172.21.15.19:0/1824361848 wait complete. 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 Processor -- start 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 -- start start 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101c90 0x7fcc8819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 0x7fcc8819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 0x7fcc8819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88111ca0 con 0x7fcc88108020 2024-09-11T00:07:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88111b20 con 0x7fcc88101c90 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8ff82640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88111e20 con 0x7fcc881076a0 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8d51d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 0x7fcc8819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8d51d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 0x7fcc8819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50446/0 (socket says 172.21.15.19:50446) 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8d51d640 1 -- 172.21.15.19:0/3107742977 learned_addr learned my addr 172.21.15.19:0/3107742977 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8e51f640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 0x7fcc8819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.034+0000 7fcc8dd1e640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101c90 0x7fcc8819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc8d51d640 1 -- 172.21.15.19:0/3107742977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101c90 msgr2=0x7fcc8819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc8d51d640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101c90 0x7fcc8819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc8d51d640 1 -- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 msgr2=0x7fcc8819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc8d51d640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 0x7fcc8819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc8d51d640 1 -- 172.21.15.19:0/3107742977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc881a5430 con 0x7fcc881076a0 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc8d51d640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 0x7fcc8819a590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800d950 tx=0x7fcc7800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc7effd640 1 -- 172.21.15.19:0/3107742977 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800bcb0 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc7effd640 1 -- 172.21.15.19:0/3107742977 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc7800be50 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc7effd640 1 -- 172.21.15.19:0/3107742977 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78010460 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.035+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc88197ea0 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.036+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc88198360 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.037+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc88102f40 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.039+0000 7fcc7effd640 1 -- 172.21.15.19:0/3107742977 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fcc78004eb0 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.040+0000 7fcc7effd640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc740b5450 0x7fcc740b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.040+0000 7fcc8dd1e640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc740b5450 0x7fcc740b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.041+0000 7fcc7effd640 1 -- 172.21.15.19:0/3107742977 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fcc780e6600 con 0x7fcc881076a0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.041+0000 7fcc8dd1e640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc740b5450 0x7fcc740b7910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005d00 tx=0x7fcc8400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:55.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.044+0000 7fcc7effd640 1 -- 172.21.15.19:0/3107742977 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcc780ad1a0 con 0x7fcc881076a0 2024-09-11T00:07:55.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.305+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc8802e5c0 con 0x7fcc881076a0 2024-09-11T00:07:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.307+0000 7fcc7effd640 1 -- 172.21.15.19:0/3107742977 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11916 (secure 0 0 0) 0x7fcc780acaa0 con 0x7fcc881076a0 2024-09-11T00:07:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:07:55.309 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":32,"btime":"2024-09-11T00:07:05:032481+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:07:04.671200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24604,24605,24625]},"id":1}]} 2024-09-11T00:07:55.309 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 32 2024-09-11T00:07:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc740b5450 msgr2=0x7fcc740b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc740b5450 0x7fcc740b7910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005d00 tx=0x7fcc8400b410 comp rx=0 tx=0).stop 2024-09-11T00:07:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 msgr2=0x7fcc8819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 0x7fcc8819a590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800d950 tx=0x7fcc7800de10 comp rx=0 tx=0).stop 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 shutdown_connections 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc740b5450 0x7fcc740b7910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88108020 0x7fcc8819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc881076a0 0x7fcc8819a590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 --2- 172.21.15.19:0/3107742977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101c90 0x7fcc8819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 >> 172.21.15.19:0/3107742977 conn(0x7fcc880fd700 msgr2=0x7fcc880fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 shutdown_connections 2024-09-11T00:07:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:07:55.310+0000 7fcc8ff82640 1 -- 172.21.15.19:0/3107742977 wait complete. 2024-09-11T00:07:56.374 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:56 smithi019 ceph-mon[30859]: pgmap v487: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-09-11T00:07:56.374 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:56 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3107742977' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:56.377 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:07:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:56 smithi135 ceph-mon[35432]: pgmap v487: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-09-11T00:07:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:56 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3107742977' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:56 smithi131 ceph-mon[35491]: pgmap v487: 97 pgs: 97 active+clean; 683 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-09-11T00:07:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:56 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3107742977' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:58 smithi135 ceph-mon[35432]: pgmap v488: 97 pgs: 97 active+clean; 687 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-09-11T00:07:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:07:58 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:58 smithi019 ceph-mon[30859]: pgmap v488: 97 pgs: 97 active+clean; 687 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-09-11T00:07:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:07:58 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:58 smithi131 ceph-mon[35491]: pgmap v488: 97 pgs: 97 active+clean; 687 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-09-11T00:07:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:07:58 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.145 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:00 smithi019 ceph-mon[30859]: pgmap v489: 97 pgs: 97 active+clean; 696 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-11T00:08:00.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:00 smithi135 ceph-mon[35432]: pgmap v489: 97 pgs: 97 active+clean; 696 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-11T00:08:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:00 smithi131 ceph-mon[35491]: pgmap v489: 97 pgs: 97 active+clean; 696 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-11T00:08:00.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.885+0000 7f8de4899640 1 -- 172.21.15.19:0/3707045921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 msgr2=0x7f8de011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.885+0000 7f8de4899640 1 --2- 172.21.15.19:0/3707045921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de011e490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009900 tx=0x7f8dd402a4d0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.886+0000 7f8de4899640 1 -- 172.21.15.19:0/3707045921 shutdown_connections 2024-09-11T00:08:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.886+0000 7f8de4899640 1 --2- 172.21.15.19:0/3707045921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de011e490 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.886+0000 7f8de4899640 1 --2- 172.21.15.19:0/3707045921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8de010a530 0x7f8de010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.886+0000 7f8de4899640 1 --2- 172.21.15.19:0/3707045921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8de010a150 0x7f8de01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.886+0000 7f8de4899640 1 -- 172.21.15.19:0/3707045921 >> 172.21.15.19:0/3707045921 conn(0x7f8de006dfc0 msgr2=0x7f8de006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.904+0000 7f8de4899640 1 -- 172.21.15.19:0/3707045921 shutdown_connections 2024-09-11T00:08:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.904+0000 7f8de4899640 1 -- 172.21.15.19:0/3707045921 wait complete. 2024-09-11T00:08:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 Processor -- start 2024-09-11T00:08:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 -- start start 2024-09-11T00:08:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8de010a150 0x7f8de011b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8de010a530 0x7f8de011bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de0115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0112180 con 0x7f8de010a150 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0112000 con 0x7f8de010a530 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.905+0000 7f8de4899640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0112300 con 0x7f8de011c0a0 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.908+0000 7f8dded9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de0115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.908+0000 7f8dded9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de0115a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50466/0 (socket says 172.21.15.19:50466) 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.908+0000 7f8dded9d640 1 -- 172.21.15.19:0/2791110147 learned_addr learned my addr 172.21.15.19:0/2791110147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.908+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8de010a530 0x7f8de011bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.911+0000 7f8dde59c640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8de010a150 0x7f8de011b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.911+0000 7f8dded9d640 1 -- 172.21.15.19:0/2791110147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8de010a530 msgr2=0x7f8de011bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.911+0000 7f8dded9d640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8de010a530 0x7f8de011bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.911+0000 7f8dded9d640 1 -- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8de010a150 msgr2=0x7f8de011b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.911+0000 7f8dded9d640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8de010a150 0x7f8de011b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.911+0000 7f8dded9d640 1 -- 172.21.15.19:0/2791110147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de01162e0 con 0x7f8de011c0a0 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.912+0000 7f8dded9d640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de0115a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8dd402aa40 tx=0x7f8dd4031bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.913+0000 7f8dcf7fe640 1 -- 172.21.15.19:0/2791110147 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4040030 con 0x7f8de011c0a0 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.913+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de0116570 con 0x7f8de011c0a0 2024-09-11T00:08:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.913+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de01bd270 con 0x7f8de011c0a0 2024-09-11T00:08:00.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.913+0000 7f8dcf7fe640 1 -- 172.21.15.19:0/2791110147 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd403c8f0 con 0x7f8de011c0a0 2024-09-11T00:08:00.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.913+0000 7f8dcf7fe640 1 -- 172.21.15.19:0/2791110147 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40448c0 con 0x7f8de011c0a0 2024-09-11T00:08:00.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.921+0000 7f8de6c6e740 1 Processor -- start 2024-09-11T00:08:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.930+0000 7f8dcf7fe640 1 -- 172.21.15.19:0/2791110147 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f8dd403c440 con 0x7f8de011c0a0 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.931+0000 7f8dcf7fe640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8dc80b5650 0x7f8dc80b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.931+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8dc80b5650 0x7f8dc80b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.931+0000 7f8dcf7fe640 1 -- 172.21.15.19:0/2791110147 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8dd41067c0 con 0x7f8de011c0a0 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.932+0000 7f8de6c6e740 1 -- start start 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.932+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b764d0 0x564001b768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.932+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b76df0 0x564001b82840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.932+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b82d80 0x564001b85170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.932+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564001aecea0 con 0x564001b764d0 2024-09-11T00:08:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.932+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564001adc2d0 con 0x564001b76df0 2024-09-11T00:08:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.932+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564001ae00e0 con 0x564001b82d80 2024-09-11T00:08:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b76df0 0x564001b82840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b76df0 0x564001b82840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54122/0 (socket says 172.21.15.19:54122) 2024-09-11T00:08:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 -- 172.21.15.19:0/3350803476 learned_addr learned my addr 172.21.15.19:0/3350803476 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dded9d640 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b82d80 0x564001b85170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 -- 172.21.15.19:0/3350803476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b82d80 msgr2=0x564001b85170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b82d80 0x564001b85170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 -- 172.21.15.19:0/3350803476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b764d0 msgr2=0x564001b768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b764d0 0x564001b768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 -- 172.21.15.19:0/3350803476 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56400183a650 con 0x564001b76df0 2024-09-11T00:08:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.938+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b76df0 0x564001b82840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800cfc0 tx=0x7f8dd8018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1135df288ac48e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.939+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8dc80b5650 0x7f8dc80b7b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009fd0 tx=0x7f8dd800cbe0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.940+0000 7f8dccff9640 1 -- 172.21.15.19:0/3350803476 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8020020 con 0x564001b76df0 2024-09-11T00:08:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.940+0000 7f8dccff9640 1 -- 172.21.15.19:0/3350803476 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd8016040 con 0x564001b76df0 2024-09-11T00:08:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.941+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3350803476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b76df0 msgr2=0x564001b82840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.941+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b76df0 0x564001b82840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800cfc0 tx=0x7f8dd8018000 comp rx=0 tx=0).stop 2024-09-11T00:08:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.942+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3350803476 shutdown_connections 2024-09-11T00:08:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.942+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b82d80 0x564001b85170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.942+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b76df0 0x564001b82840 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800cfc0 tx=0x7f8dd8018000 comp rx=0 tx=0).stop 2024-09-11T00:08:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.942+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3350803476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b764d0 0x564001b768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.942+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3350803476 >> 172.21.15.19:0/3350803476 conn(0x564001b74300 msgr2=0x564001b754a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.944+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3350803476 shutdown_connections 2024-09-11T00:08:00.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.948+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3350803476 wait complete. 2024-09-11T00:08:00.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.948+0000 7f8de6c6e740 1 -- start start 2024-09-11T00:08:00.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.948+0000 7f8de6c6e740 1 Processor -- start 2024-09-11T00:08:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.949+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b764d0 0x564001b827d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.949+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b82d80 0x564001b7fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.949+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b80310 0x564001b8ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.949+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56400193d700 con 0x564001b82d80 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.949+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564001a77160 con 0x564001b764d0 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.949+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564001b859f0 con 0x564001b80310 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.949+0000 7f8de6c6e740 10 client.0 _ll_register_callbacks cb 0x564001a909e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.950+0000 7f8dde59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b764d0 0x564001b827d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.950+0000 7f8dde59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b764d0 0x564001b827d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54134/0 (socket says 172.21.15.19:54134) 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.950+0000 7f8dde59c640 1 -- 172.21.15.19:0/3926461948 learned_addr learned my addr 172.21.15.19:0/3926461948 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.950+0000 7f8dded9d640 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b80310 0x564001b8ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.950+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b82d80 0x564001b7fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.951+0000 7f8dde59c640 1 -- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b80310 msgr2=0x564001b8ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.951+0000 7f8dde59c640 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b80310 0x564001b8ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.951+0000 7f8dde59c640 1 -- 172.21.15.19:0/3926461948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b82d80 msgr2=0x564001b7fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.951+0000 7f8dde59c640 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b82d80 0x564001b7fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.951+0000 7f8dde59c640 1 -- 172.21.15.19:0/3926461948 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564001aa4c90 con 0x564001b764d0 2024-09-11T00:08:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.956+0000 7f8dde59c640 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b764d0 0x564001b827d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0011690 tx=0x7f8dd0011b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f2c5781b3acf23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.956+0000 7f8dc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:08:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.960+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/3926461948 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd001f060 con 0x564001b764d0 2024-09-11T00:08:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.960+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd8016040 con 0x564001b764d0 2024-09-11T00:08:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.960+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/3926461948 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8dd000fac0 con 0x564001b764d0 2024-09-11T00:08:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.970+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/3926461948 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8dd0011e90 con 0x564001b764d0 2024-09-11T00:08:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.974+0000 7f8de6c6e740 10 client.25541 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.974+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564001b919a0 con 0x564001b764d0 2024-09-11T00:08:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/3926461948 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd8016040 con 0x564001b764d0 2024-09-11T00:08:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/3926461948 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f8dd001a440 con 0x564001b764d0 2024-09-11T00:08:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8de6c6e740 10 client.25541 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8de6c6e740 10 client.25541 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:08:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8de6c6e740 20 client.25541 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001b932b0 0x564001b956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8de6c6e740 4 client.25541 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.978+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564001aeedf0 con 0x564001b932b0 2024-09-11T00:08:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.980+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001b932b0 0x564001b956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.981+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001b932b0 0x564001b956f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8cd9f6c5c04ac19c server_cookie=2fd6cd203f0f5f9e in_seq=0 out_seq=0 2024-09-11T00:08:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.983+0000 7f8dc5ffb640 10 client.25541 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:08:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.984+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/3926461948 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564001aeedf0 con 0x564001b932b0 2024-09-11T00:08:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.984+0000 7f8dc5ffb640 10 client.25541 handle_command_reply: tid=0 2024-09-11T00:08:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.984+0000 7f8de6c6e740 1 client.25541 shutdown 2024-09-11T00:08:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.986+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b764d0 msgr2=0x564001b827d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.986+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b764d0 0x564001b827d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0011690 tx=0x7f8dd0011b50 comp rx=0 tx=0).stop 2024-09-11T00:08:00.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 shutdown_connections 2024-09-11T00:08:00.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001b932b0 0x564001b956f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b80310 0x564001b8ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b82d80 0x564001b7fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/3926461948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b764d0 0x564001b827d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 >> 172.21.15.19:0/3926461948 conn(0x564001b74300 msgr2=0x564001b79e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8dc5ffb640 0 client.25541 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 shutdown_connections 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 1 -- 172.21.15.19:0/3926461948 wait complete. 2024-09-11T00:08:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:00.994+0000 7f8de6c6e740 20 client.25541 trim_cache size 0 max 16384 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.028+0000 7f8de6c6e740 1 Processor -- start 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.028+0000 7f8de6c6e740 1 -- start start 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.028+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.028+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b8f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b7ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc0011070 con 0x564001b80310 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc000e910 con 0x564001b82d80 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8de6c6e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc000c760 con 0x564001b764d0 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8dded9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b7ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8dded9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b7ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:54150/0 (socket says 172.21.15.19:54150) 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8dded9d640 1 -- 172.21.15.19:0/4280835259 learned_addr learned my addr 172.21.15.19:0/4280835259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b8f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.029+0000 7f8dde59c640 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.030+0000 7f8dded9d640 1 -- 172.21.15.19:0/4280835259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 msgr2=0x564001b8ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.030+0000 7f8dded9d640 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.030+0000 7f8dded9d640 1 -- 172.21.15.19:0/4280835259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 msgr2=0x564001b8f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.030+0000 7f8dded9d640 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b8f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.030+0000 7f8dded9d640 1 -- 172.21.15.19:0/4280835259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564001b76c20 con 0x564001b82d80 2024-09-11T00:08:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.030+0000 7f8dded9d640 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b7ae30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005ab0 tx=0x7f8dd4005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4921b3e2e2cc7a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.034+0000 7f8dc7fff640 1 -- 172.21.15.19:0/4280835259 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd404a070 con 0x564001b82d80 2024-09-11T00:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.034+0000 7f8dc7fff640 1 -- 172.21.15.19:0/4280835259 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd40cc770 con 0x564001b82d80 2024-09-11T00:08:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.034+0000 7f8dc7fff640 1 -- 172.21.15.19:0/4280835259 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40d61f0 con 0x564001b82d80 2024-09-11T00:08:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.039+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4280835259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 msgr2=0x564001b7ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.039+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b7ae30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005ab0 tx=0x7f8dd4005b50 comp rx=0 tx=0).stop 2024-09-11T00:08:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.043+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4280835259 shutdown_connections 2024-09-11T00:08:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.043+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b7ae30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.043+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b8f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.043+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4280835259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.043+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4280835259 >> 172.21.15.19:0/4280835259 conn(0x564001b74300 msgr2=0x564001b952c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.048+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4280835259 shutdown_connections 2024-09-11T00:08:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.048+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4280835259 wait complete. 2024-09-11T00:08:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.048+0000 7f8de6c6e740 1 -- start start 2024-09-11T00:08:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.049+0000 7f8de6c6e740 1 Processor -- start 2024-09-11T00:08:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.051+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.052+0000 7f8de6c6e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b9ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.052+0000 7f8dde59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.052+0000 7f8dde59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50490/0 (socket says 172.21.15.19:50490) 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.052+0000 7f8dde59c640 1 -- 172.21.15.19:0/4023820744 learned_addr learned my addr 172.21.15.19:0/4023820744 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.052+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b9b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.052+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc000cdd0 con 0x564001b80310 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.052+0000 7f8dded9d640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b9b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.053+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc000e240 con 0x564001b82d80 2024-09-11T00:08:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.053+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc000d4a0 con 0x564001b764d0 2024-09-11T00:08:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.053+0000 7f8de6c6e740 10 client.0 _ll_register_callbacks cb 0x7f8dd00095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.053+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b9ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.054+0000 7f8dddd9b640 1 -- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 msgr2=0x564001b8b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.054+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.054+0000 7f8dddd9b640 1 -- 172.21.15.19:0/4023820744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 msgr2=0x564001b9b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.054+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b9b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.054+0000 7f8dddd9b640 1 -- 172.21.15.19:0/4023820744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564001b8a390 con 0x564001b80310 2024-09-11T00:08:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.054+0000 7f8dddd9b640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b9ae30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x564001b75c50 tx=0x7f8dd8009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d38934825cd6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.054+0000 7f8dc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:08:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.055+0000 7f8dde59c640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.055+0000 7f8dded9d640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b9b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.059+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/4023820744 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd803c020 con 0x564001b80310 2024-09-11T00:08:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.059+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd40cc770 con 0x564001b80310 2024-09-11T00:08:01.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.059+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/4023820744 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8dd801c430 con 0x564001b80310 2024-09-11T00:08:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.069+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/4023820744 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8dd8047050 con 0x564001b80310 2024-09-11T00:08:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.069+0000 7f8de6c6e740 10 client.16161 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.069+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564001c00450 con 0x564001b80310 2024-09-11T00:08:01.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.070+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/4023820744 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd40cc770 con 0x564001b80310 2024-09-11T00:08:01.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.070+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/4023820744 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f8dd8025450 con 0x564001b80310 2024-09-11T00:08:01.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.074+0000 7f8de6c6e740 10 client.16161 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:01.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.074+0000 7f8de6c6e740 10 client.16161 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:08:01.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.074+0000 7f8de6c6e740 20 client.16161 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:01.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.074+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001c00840 0x564001c02c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.074+0000 7f8de6c6e740 4 client.16161 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:08:01.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.074+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564001aea8a0 con 0x564001c00840 2024-09-11T00:08:01.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.078+0000 7f8dde59c640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001c00840 0x564001c02c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.088+0000 7f8dc5ffb640 10 client.16161 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:08:01.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.088+0000 7f8dde59c640 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001c00840 0x564001c02c60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad8d8d729a4f39cf server_cookie=5a2cc846fb7333c in_seq=0 out_seq=0 2024-09-11T00:08:01.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.091+0000 7f8dc5ffb640 1 -- 172.21.15.19:0/4023820744 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564001aea8a0 con 0x564001c00840 2024-09-11T00:08:01.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.091+0000 7f8dc5ffb640 10 client.16161 handle_command_reply: tid=0 2024-09-11T00:08:01.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.091+0000 7f8de6c6e740 1 client.16161 shutdown 2024-09-11T00:08:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.097+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 msgr2=0x564001b9ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.097+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b9ae30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x564001b75c50 tx=0x7f8dd8009740 comp rx=0 tx=0).stop 2024-09-11T00:08:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.101+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 shutdown_connections 2024-09-11T00:08:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.101+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x564001c00840 0x564001c02c60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.101+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564001b82d80 0x564001b9b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.101+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564001b80310 0x564001b9ae30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.101+0000 7f8de6c6e740 1 --2- 172.21.15.19:0/4023820744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564001b764d0 0x564001b8b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.101+0000 7f8dc5ffb640 0 client.16161 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:08:01.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.101+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 >> 172.21.15.19:0/4023820744 conn(0x564001b74300 msgr2=0x564001b7ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.105+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 shutdown_connections 2024-09-11T00:08:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.105+0000 7f8de6c6e740 1 -- 172.21.15.19:0/4023820744 wait complete. 2024-09-11T00:08:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.107+0000 7f8de6c6e740 20 client.16161 trim_cache size 0 max 16384 2024-09-11T00:08:01.109 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:08:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.111+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8dc80b5650 msgr2=0x7f8dc80b7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.111+0000 7f8de4899640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8dc80b5650 0x7f8dc80b7b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009fd0 tx=0x7f8dd800cbe0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.111+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 msgr2=0x7f8de0115a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.111+0000 7f8de4899640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de0115a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8dd402aa40 tx=0x7f8dd4031bb0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.114+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 shutdown_connections 2024-09-11T00:08:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.114+0000 7f8de4899640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de011c0a0 0x7f8de0115a20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.114+0000 7f8de4899640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8de010a530 0x7f8de011bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.114+0000 7f8de4899640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8dc80b5650 0x7f8dc80b7b10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.114+0000 7f8de4899640 1 --2- 172.21.15.19:0/2791110147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8de010a150 0x7f8de011b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.114+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 >> 172.21.15.19:0/2791110147 conn(0x7f8de006dfc0 msgr2=0x7f8de0071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.115+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 shutdown_connections 2024-09-11T00:08:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:01.115+0000 7f8de4899640 1 -- 172.21.15.19:0/2791110147 wait complete. 2024-09-11T00:08:02.147 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:02 smithi019 ceph-mon[30859]: pgmap v490: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 244 op/s 2024-09-11T00:08:02.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:02 smithi135 ceph-mon[35432]: pgmap v490: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 244 op/s 2024-09-11T00:08:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:02 smithi131 ceph-mon[35491]: pgmap v490: 97 pgs: 97 active+clean; 702 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 244 op/s 2024-09-11T00:08:02.556 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:08:03.116 INFO:tasks.workunit.client.0.smithi019.stdout: 121 1689767 266 1179508 316 999945 992 2024-09-11T00:08:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:04 smithi135 ceph-mon[35432]: pgmap v491: 97 pgs: 97 active+clean; 732 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 487 op/s 2024-09-11T00:08:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:08:04.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:04 smithi019 ceph-mon[30859]: pgmap v491: 97 pgs: 97 active+clean; 732 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 487 op/s 2024-09-11T00:08:04.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:04.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:04.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:08:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:04 smithi131 ceph-mon[35491]: pgmap v491: 97 pgs: 97 active+clean; 732 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 487 op/s 2024-09-11T00:08:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:08:05.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.148+0000 7f24ce7e8640 1 -- 172.21.15.19:0/3000757166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 msgr2=0x7f24c811e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.148+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/3000757166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 0x7f24c811e490 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f24c001acb0 tx=0x7f24c003b920 comp rx=0 tx=0).stop 2024-09-11T00:08:05.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.153+0000 7f24ce7e8640 1 -- 172.21.15.19:0/3000757166 shutdown_connections 2024-09-11T00:08:05.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.153+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/3000757166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 0x7f24c811e490 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.153+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/3000757166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 0x7f24c810a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.153+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/3000757166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c810a150 0x7f24c81111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.153+0000 7f24ce7e8640 1 -- 172.21.15.19:0/3000757166 >> 172.21.15.19:0/3000757166 conn(0x7f24c806cb30 msgr2=0x7f24c806cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.158+0000 7f24ce7e8640 1 -- 172.21.15.19:0/3000757166 shutdown_connections 2024-09-11T00:08:05.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.158+0000 7f24ce7e8640 1 -- 172.21.15.19:0/3000757166 wait complete. 2024-09-11T00:08:05.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.159+0000 7f24ce7e8640 1 Processor -- start 2024-09-11T00:08:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.164+0000 7f24ce7e8640 1 -- start start 2024-09-11T00:08:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.164+0000 7f24ce7e8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c810a150 0x7f24c8117960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.164+0000 7f24ce7e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 0x7f24c8117ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.164+0000 7f24ce7e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 0x7f24c81a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.164+0000 7f24ce7e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f24c81141f0 con 0x7f24c811c0a0 2024-09-11T00:08:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.164+0000 7f24ce7e8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24c8114070 con 0x7f24c810a150 2024-09-11T00:08:05.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.164+0000 7f24ce7e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24c8114370 con 0x7f24c810a530 2024-09-11T00:08:05.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.167+0000 7f24ccfe5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 0x7f24c8117ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.167+0000 7f24ccfe5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 0x7f24c8117ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55694/0 (socket says 172.21.15.19:55694) 2024-09-11T00:08:05.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.167+0000 7f24ccfe5640 1 -- 172.21.15.19:0/2576212071 learned_addr learned my addr 172.21.15.19:0/2576212071 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.167+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c810a150 0x7f24c8117960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.170+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 0x7f24c81a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24cdfe7640 1 -- 172.21.15.19:0/2576212071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 msgr2=0x7f24c8117ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 0x7f24c8117ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24cdfe7640 1 -- 172.21.15.19:0/2576212071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c810a150 msgr2=0x7f24c8117960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c810a150 0x7f24c8117960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24cdfe7640 1 -- 172.21.15.19:0/2576212071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c81a5890 con 0x7f24c811c0a0 2024-09-11T00:08:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c810a150 0x7f24c8117960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24ccfe5640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 0x7f24c8117ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.171+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 0x7f24c81a50c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f24c003be40 tx=0x7f24c0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.174+0000 7f24be7fc640 1 -- 172.21.15.19:0/2576212071 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0045030 con 0x7f24c811c0a0 2024-09-11T00:08:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.174+0000 7f24be7fc640 1 -- 172.21.15.19:0/2576212071 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24c004f070 con 0x7f24c811c0a0 2024-09-11T00:08:05.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.174+0000 7f24be7fc640 1 -- 172.21.15.19:0/2576212071 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0004680 con 0x7f24c811c0a0 2024-09-11T00:08:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.174+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c81a5b20 con 0x7f24c811c0a0 2024-09-11T00:08:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.174+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c81ac240 con 0x7f24c811c0a0 2024-09-11T00:08:05.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.184+0000 7f24d1e1f740 1 Processor -- start 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.191+0000 7f24d1e1f740 1 -- start start 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.191+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.191+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c1c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.191+0000 7f24be7fc640 1 -- 172.21.15.19:0/2576212071 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f24c004a450 con 0x7f24c811c0a0 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37620/0 (socket says 172.21.15.19:37620) 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24cd7e6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c1c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24cd7e6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c1c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:36488/0 (socket says 172.21.15.19:36488) 2024-09-11T00:08:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 -- 172.21.15.19:0/862400003 learned_addr learned my addr 172.21.15.19:0/862400003 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c1cb80 0x55e356c1ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e356b86ea0 con 0x55e356c102d0 2024-09-11T00:08:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e356b762d0 con 0x55e356c10bf0 2024-09-11T00:08:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e356b7a0e0 con 0x55e356c1cb80 2024-09-11T00:08:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 -- 172.21.15.19:0/862400003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c1cb80 msgr2=0x55e356c1ef70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c1cb80 0x55e356c1ef70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 -- 172.21.15.19:0/862400003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 msgr2=0x55e356c1c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c1c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.192+0000 7f24ccfe5640 1 -- 172.21.15.19:0/862400003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3568d4650 con 0x55e356c102d0 2024-09-11T00:08:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.193+0000 7f24ccfe5640 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c106b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009df0 tx=0x7f24b800e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c221f7ecffb34921 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.194+0000 7f24be7fc640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24b40b56d0 0x7f24b40b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.195+0000 7f24b37fe640 1 -- 172.21.15.19:0/862400003 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8017070 con 0x55e356c102d0 2024-09-11T00:08:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.195+0000 7f24b37fe640 1 -- 172.21.15.19:0/862400003 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24b8013920 con 0x55e356c102d0 2024-09-11T00:08:05.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.195+0000 7f24b37fe640 1 -- 172.21.15.19:0/862400003 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8012890 con 0x55e356c102d0 2024-09-11T00:08:05.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.195+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24b40b56d0 0x7f24b40b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.196+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 msgr2=0x55e356c106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.196+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c106b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009df0 tx=0x7f24b800e5a0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.196+0000 7f24be7fc640 1 -- 172.21.15.19:0/2576212071 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f24c0117f50 con 0x7f24c811c0a0 2024-09-11T00:08:05.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.199+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24b40b56d0 0x7f24b40b7b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55e356c0efe0 tx=0x7f24c4008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.203+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 shutdown_connections 2024-09-11T00:08:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.203+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c1cb80 0x55e356c1ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.203+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c1c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.203+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/862400003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c106b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.203+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 >> 172.21.15.19:0/862400003 conn(0x55e356c0e100 msgr2=0x55e356c0f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.208+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 shutdown_connections 2024-09-11T00:08:05.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.210+0000 7f24d1e1f740 1 -- 172.21.15.19:0/862400003 wait complete. 2024-09-11T00:08:05.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.210+0000 7f24d1e1f740 1 -- start start 2024-09-11T00:08:05.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.213+0000 7f24d1e1f740 1 Processor -- start 2024-09-11T00:08:05.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.217+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c102d0 0x55e356c1c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.217+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c19870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.217+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 0x55e356c19e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.217+0000 7f24ccfe5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c19870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.217+0000 7f24ccfe5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c19870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:36492/0 (socket says 172.21.15.19:36492) 2024-09-11T00:08:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.217+0000 7f24ccfe5640 1 -- 172.21.15.19:0/3897433874 learned_addr learned my addr 172.21.15.19:0/3897433874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e3569d7700 con 0x55e356c1cb80 2024-09-11T00:08:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e356b11160 con 0x55e356c10bf0 2024-09-11T00:08:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e356c1f800 con 0x55e356c102d0 2024-09-11T00:08:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 0x55e356c19e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24d1e1f740 10 client.0 _ll_register_callbacks cb 0x55e356b2a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24ccfe5640 1 -- 172.21.15.19:0/3897433874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c102d0 msgr2=0x55e356c1c420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:08:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24ccfe5640 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c102d0 0x55e356c1c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24ccfe5640 1 -- 172.21.15.19:0/3897433874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 msgr2=0x55e356c19e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24ccfe5640 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 0x55e356c19e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.218+0000 7f24ccfe5640 1 -- 172.21.15.19:0/3897433874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e356b3ec90 con 0x55e356c10bf0 2024-09-11T00:08:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.221+0000 7f24ccfe5640 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c19870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f24b8006e70 tx=0x7f24b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db9cb5baac78ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.224+0000 7f24b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:08:05.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.228+0000 7f24b0ff9640 1 -- 172.21.15.19:0/3897433874 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8017040 con 0x55e356c10bf0 2024-09-11T00:08:05.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.228+0000 7f24b0ff9640 1 -- 172.21.15.19:0/3897433874 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f24b8012920 con 0x55e356c10bf0 2024-09-11T00:08:05.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.229+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24b8013920 con 0x55e356c10bf0 2024-09-11T00:08:05.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.232+0000 7f24b0ff9640 1 -- 172.21.15.19:0/3897433874 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f24b8012b20 con 0x55e356c10bf0 2024-09-11T00:08:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.236+0000 7f24d1e1f740 10 client.25550 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.236+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e356c2b160 con 0x55e356c10bf0 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24b0ff9640 1 -- 172.21.15.19:0/3897433874 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24b8013920 con 0x55e356c10bf0 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24b0ff9640 1 -- 172.21.15.19:0/3897433874 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f24b8023020 con 0x55e356c10bf0 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24d1e1f740 10 client.25550 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24d1e1f740 10 client.25550 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24d1e1f740 20 client.25550 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c2c6f0 0x55e356c2ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24d1e1f740 4 client.25550 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.237+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e356b88df0 con 0x55e356c2c6f0 2024-09-11T00:08:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.245+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c2c6f0 0x55e356c2ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.255+0000 7f24b0ff9640 10 client.25550 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:08:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.255+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c2c6f0 0x55e356c2ebb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a1275677b6a42d0 server_cookie=1361bea79ed12873 in_seq=0 out_seq=0 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.256+0000 7f24b0ff9640 1 -- 172.21.15.19:0/3897433874 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e356b88df0 con 0x55e356c2c6f0 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.256+0000 7f24b0ff9640 10 client.25550 handle_command_reply: tid=0 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.256+0000 7f24d1e1f740 1 client.25550 shutdown 2024-09-11T00:08:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 msgr2=0x55e356c19870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c19870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f24b8006e70 tx=0x7f24b80046c0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 shutdown_connections 2024-09-11T00:08:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c2c6f0 0x55e356c2ebb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 0x55e356c19e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c10bf0 0x55e356c19870 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f24b8006e70 tx=0x7f24b80046c0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/3897433874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c102d0 0x55e356c1c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.263+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 >> 172.21.15.19:0/3897433874 conn(0x55e356c0e100 msgr2=0x55e356c13c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.264+0000 7f24b0ff9640 0 client.25550 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:08:05.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.264+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 shutdown_connections 2024-09-11T00:08:05.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.264+0000 7f24d1e1f740 1 -- 172.21.15.19:0/3897433874 wait complete. 2024-09-11T00:08:05.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.264+0000 7f24d1e1f740 20 client.25550 trim_cache size 0 max 16384 2024-09-11T00:08:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.300+0000 7f24d1e1f740 1 Processor -- start 2024-09-11T00:08:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.300+0000 7f24d1e1f740 1 -- start start 2024-09-11T00:08:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c0da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24cd7e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c0da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24cd7e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c0da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37644/0 (socket says 172.21.15.19:37644) 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24cd7e6640 1 -- 172.21.15.19:0/161459100 learned_addr learned my addr 172.21.15.19:0/161459100 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c1cb80 0x55e356c180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c15200 0x55e356c18630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac010fa0 con 0x55e356c102d0 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac00e840 con 0x55e356c1cb80 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.301+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac00c690 con 0x55e356c15200 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.302+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c15200 0x55e356c18630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.302+0000 7f24cd7e6640 1 -- 172.21.15.19:0/161459100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c15200 msgr2=0x55e356c18630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.302+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c15200 0x55e356c18630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.302+0000 7f24cd7e6640 1 -- 172.21.15.19:0/161459100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c1cb80 msgr2=0x55e356c180f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:05.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.302+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c1cb80 0x55e356c180f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.302+0000 7f24cd7e6640 1 -- 172.21.15.19:0/161459100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e356c2ef20 con 0x55e356c102d0 2024-09-11T00:08:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.302+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c0da10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f24c400fab0 tx=0x7f24c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8bb858ffba9cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.304+0000 7f24b2ffd640 1 -- 172.21.15.19:0/161459100 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c402b030 con 0x55e356c102d0 2024-09-11T00:08:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.304+0000 7f24b2ffd640 1 -- 172.21.15.19:0/161459100 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24c4019040 con 0x55e356c102d0 2024-09-11T00:08:05.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.304+0000 7f24b2ffd640 1 -- 172.21.15.19:0/161459100 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4015450 con 0x55e356c102d0 2024-09-11T00:08:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.308+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 msgr2=0x55e356c0da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.308+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c0da10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f24c400fab0 tx=0x7f24c4012000 comp rx=0 tx=0).stop 2024-09-11T00:08:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.308+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 shutdown_connections 2024-09-11T00:08:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.308+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c15200 0x55e356c18630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.308+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c1cb80 0x55e356c180f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.308+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/161459100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c102d0 0x55e356c0da10 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.308+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 >> 172.21.15.19:0/161459100 conn(0x55e356c0e100 msgr2=0x55e356c14af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.310+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 shutdown_connections 2024-09-11T00:08:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.314+0000 7f24d1e1f740 1 -- 172.21.15.19:0/161459100 wait complete. 2024-09-11T00:08:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.314+0000 7f24d1e1f740 1 -- start start 2024-09-11T00:08:05.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.314+0000 7f24d1e1f740 1 Processor -- start 2024-09-11T00:08:05.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.315+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c102d0 0x55e356c34370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.315+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 0x55e356c348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.315+0000 7f24d1e1f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c34df0 0x55e356c24200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.315+0000 7f24d1e1f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac00cd00 con 0x55e356c1cb80 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.315+0000 7f24d1e1f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac00e170 con 0x55e356c102d0 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.315+0000 7f24d1e1f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac00d3d0 con 0x55e356c34df0 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.315+0000 7f24d1e1f740 10 client.0 _ll_register_callbacks cb 0x7f24c400a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c34df0 0x55e356c24200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c34df0 0x55e356c24200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55728/0 (socket says 172.21.15.19:55728) 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 -- 172.21.15.19:0/4172002946 learned_addr learned my addr 172.21.15.19:0/4172002946 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c102d0 0x55e356c34370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 -- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c102d0 msgr2=0x55e356c34370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c102d0 0x55e356c34370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 -- 172.21.15.19:0/4172002946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 msgr2=0x55e356c348b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:05.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 0x55e356c348b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 -- 172.21.15.19:0/4172002946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e356c24740 con 0x55e356c34df0 2024-09-11T00:08:05.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.316+0000 7f24cdfe7640 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c34df0 0x55e356c24200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24c00dabb0 tx=0x7f24c0115c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e13624b94e75019f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.318+0000 7f24b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:08:05.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.318+0000 7f24b0ff9640 1 -- 172.21.15.19:0/4172002946 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c00e72c0 con 0x55e356c34df0 2024-09-11T00:08:05.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.318+0000 7f24b0ff9640 1 -- 172.21.15.19:0/4172002946 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f24c00e7700 con 0x55e356c34df0 2024-09-11T00:08:05.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.319+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24c4019040 con 0x55e356c34df0 2024-09-11T00:08:05.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.324+0000 7f24b0ff9640 1 -- 172.21.15.19:0/4172002946 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f24c00ddf00 con 0x55e356c34df0 2024-09-11T00:08:05.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.324+0000 7f24d1e1f740 10 client.25765 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:05.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.324+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e356c99e20 con 0x55e356c34df0 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24b0ff9640 1 -- 172.21.15.19:0/4172002946 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24c4019040 con 0x55e356c34df0 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24b0ff9640 1 -- 172.21.15.19:0/4172002946 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f24c01051b0 con 0x55e356c34df0 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24d1e1f740 10 client.25765 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24d1e1f740 10 client.25765 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24d1e1f740 20 client.25765 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c9a670 0x55e356c9ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24d1e1f740 4 client.25765 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e356b848a0 con 0x55e356c9a670 2024-09-11T00:08:05.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.328+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c9a670 0x55e356c9ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.329+0000 7f24b0ff9640 10 client.25765 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:08:05.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.329+0000 7f24cd7e6640 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c9a670 0x55e356c9ca90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7825dd241b49fc6 server_cookie=32b09b4f86874ac6 in_seq=0 out_seq=0 2024-09-11T00:08:05.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.336+0000 7f24b0ff9640 1 -- 172.21.15.19:0/4172002946 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e356b848a0 con 0x55e356c9a670 2024-09-11T00:08:05.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.336+0000 7f24b0ff9640 10 client.25765 handle_command_reply: tid=0 2024-09-11T00:08:05.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.336+0000 7f24d1e1f740 1 client.25765 shutdown 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.336+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c34df0 msgr2=0x55e356c24200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.336+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c34df0 0x55e356c24200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24c00dabb0 tx=0x7f24c0115c80 comp rx=0 tx=0).stop 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.338+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 shutdown_connections 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.338+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55e356c9a670 0x55e356c9ca90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.338+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e356c34df0 0x55e356c24200 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.338+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e356c1cb80 0x55e356c348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.338+0000 7f24d1e1f740 1 --2- 172.21.15.19:0/4172002946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e356c102d0 0x55e356c34370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.338+0000 7f24b0ff9640 0 client.25765 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:08:05.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.338+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 >> 172.21.15.19:0/4172002946 conn(0x55e356c0e100 msgr2=0x55e356c18070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.346+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 shutdown_connections 2024-09-11T00:08:05.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.346+0000 7f24d1e1f740 1 -- 172.21.15.19:0/4172002946 wait complete. 2024-09-11T00:08:05.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.346+0000 7f24d1e1f740 20 client.25765 trim_cache size 0 max 16384 2024-09-11T00:08:05.350 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:08:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24b40b56d0 msgr2=0x7f24b40b7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24b40b56d0 0x7f24b40b7b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55e356c0efe0 tx=0x7f24c4008040 comp rx=0 tx=0).stop 2024-09-11T00:08:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 msgr2=0x7f24c81a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 0x7f24c81a50c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f24c003be40 tx=0x7f24c0003ba0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 shutdown_connections 2024-09-11T00:08:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f24b40b56d0 0x7f24b40b7b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24c811c0a0 0x7f24c81a50c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24c810a530 0x7f24c8117ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 --2- 172.21.15.19:0/2576212071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c810a150 0x7f24c8117960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.350+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 >> 172.21.15.19:0/2576212071 conn(0x7f24c806cb30 msgr2=0x7f24c80727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.351+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 shutdown_connections 2024-09-11T00:08:05.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:05.351+0000 7f24ce7e8640 1 -- 172.21.15.19:0/2576212071 wait complete. 2024-09-11T00:08:06.305 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:08:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:06 smithi135 ceph-mon[35432]: pgmap v492: 97 pgs: 97 active+clean; 750 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T00:08:06.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:06 smithi019 ceph-mon[30859]: pgmap v492: 97 pgs: 97 active+clean; 750 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T00:08:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:06 smithi131 ceph-mon[35491]: pgmap v492: 97 pgs: 97 active+clean; 750 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 546 op/s 2024-09-11T00:08:07.417 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.137+0000 7f550dbf7640 1 -- 172.21.15.19:0/1322799181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550811c0a0 msgr2=0x7f550811e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.137+0000 7f550dbf7640 1 --2- 172.21.15.19:0/1322799181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550811c0a0 0x7f550811e490 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009900 tx=0x7f54f802a4b0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.142+0000 7f550dbf7640 1 -- 172.21.15.19:0/1322799181 shutdown_connections 2024-09-11T00:08:08.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.142+0000 7f550dbf7640 1 --2- 172.21.15.19:0/1322799181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550811c0a0 0x7f550811e490 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.142+0000 7f550dbf7640 1 --2- 172.21.15.19:0/1322799181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f550810a530 0x7f550810a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.142+0000 7f550dbf7640 1 --2- 172.21.15.19:0/1322799181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 0x7f55081111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.142+0000 7f550dbf7640 1 -- 172.21.15.19:0/1322799181 >> 172.21.15.19:0/1322799181 conn(0x7f550806dfc0 msgr2=0x7f550806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.148+0000 7f550dbf7640 1 -- 172.21.15.19:0/1322799181 shutdown_connections 2024-09-11T00:08:08.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.153+0000 7f550dbf7640 1 -- 172.21.15.19:0/1322799181 wait complete. 2024-09-11T00:08:08.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.154+0000 7f550dbf7640 1 Processor -- start 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.154+0000 7f550dbf7640 1 -- start start 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.154+0000 7f550dbf7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 0x7f55081195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f550dbf7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550810a530 0x7f5508119ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f550dbf7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f550811c0a0 0x7f5508112a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f550dbf7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5508121c40 con 0x7f550810a530 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f550dbf7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5508121ac0 con 0x7f550810a150 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f550dbf7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5508121dc0 con 0x7f550811c0a0 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f55077fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 0x7f55081195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f55077fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 0x7f55081195a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:36522/0 (socket says 172.21.15.19:36522) 2024-09-11T00:08:08.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.155+0000 7f55077fe640 1 -- 172.21.15.19:0/53152890 learned_addr learned my addr 172.21.15.19:0/53152890 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:08.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.156+0000 7f5507fff640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f550811c0a0 0x7f5508112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.156+0000 7f5506ffd640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550810a530 0x7f5508119ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.164+0000 7f55077fe640 1 -- 172.21.15.19:0/53152890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f550811c0a0 msgr2=0x7f5508112a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.164+0000 7f55077fe640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f550811c0a0 0x7f5508112a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.164+0000 7f55077fe640 1 -- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550810a530 msgr2=0x7f5508119ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.164+0000 7f55077fe640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550810a530 0x7f5508119ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.164+0000 7f55077fe640 1 -- 172.21.15.19:0/53152890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5508113340 con 0x7f550810a150 2024-09-11T00:08:08.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.164+0000 7f55077fe640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 0x7f55081195a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00b4a0 tx=0x7f54fc00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.165+0000 7f5504ff9640 1 -- 172.21.15.19:0/53152890 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc014070 con 0x7f550810a150 2024-09-11T00:08:08.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.165+0000 7f5504ff9640 1 -- 172.21.15.19:0/53152890 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc010ac0 con 0x7f550810a150 2024-09-11T00:08:08.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.165+0000 7f5504ff9640 1 -- 172.21.15.19:0/53152890 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc017c20 con 0x7f550810a150 2024-09-11T00:08:08.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.165+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5508118210 con 0x7f550810a150 2024-09-11T00:08:08.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.165+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5508118700 con 0x7f550810a150 2024-09-11T00:08:08.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.170+0000 7f550ffcc740 1 Processor -- start 2024-09-11T00:08:08.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.175+0000 7f550ffcc740 1 -- start start 2024-09-11T00:08:08.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.175+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.175+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee85df0 0x5616dee91840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.175+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee91d80 0x5616dee94170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.175+0000 7f550ffcc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5616dedfbea0 con 0x5616dee85df0 2024-09-11T00:08:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.175+0000 7f550ffcc740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5616dedeb2d0 con 0x5616dee91d80 2024-09-11T00:08:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.175+0000 7f550ffcc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616dedef0e0 con 0x5616dee854d0 2024-09-11T00:08:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.176+0000 7f55077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee85df0 0x5616dee91840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.176+0000 7f55077fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee85df0 0x5616dee91840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37678/0 (socket says 172.21.15.19:37678) 2024-09-11T00:08:08.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.176+0000 7f55077fe640 1 -- 172.21.15.19:0/2687252877 learned_addr learned my addr 172.21.15.19:0/2687252877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.176+0000 7f55077fe640 1 -- 172.21.15.19:0/2687252877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 msgr2=0x5616dee858b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.176+0000 7f55077fe640 1 --2- 172.21.15.19:0/2687252877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee858b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.176+0000 7f55077fe640 1 -- 172.21.15.19:0/2687252877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee91d80 msgr2=0x5616dee94170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.176+0000 7f55077fe640 1 --2- 172.21.15.19:0/2687252877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee91d80 0x5616dee94170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.177+0000 7f55077fe640 1 -- 172.21.15.19:0/2687252877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616deb49650 con 0x5616dee85df0 2024-09-11T00:08:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.177+0000 7f55077fe640 1 --2- 172.21.15.19:0/2687252877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee85df0 0x5616dee91840 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f54fc016000 tx=0x7f54fc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b603b2e0019d1ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.180+0000 7f5504ff9640 1 -- 172.21.15.19:0/53152890 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f54fc010c70 con 0x7f550810a150 2024-09-11T00:08:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.182+0000 7f5504ff9640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f54f00b5650 0x7f54f00b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.182+0000 7f54edffb640 1 -- 172.21.15.19:0/2687252877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0ee580 con 0x5616dee85df0 2024-09-11T00:08:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.182+0000 7f5507fff640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f54f00b5650 0x7f54f00b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.182+0000 7f5504ff9640 1 -- 172.21.15.19:0/53152890 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f54fc04e030 con 0x7f550810a150 2024-09-11T00:08:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.182+0000 7f54edffb640 1 -- 172.21.15.19:0/2687252877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc0eec50 con 0x5616dee85df0 2024-09-11T00:08:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.182+0000 7f54edffb640 1 -- 172.21.15.19:0/2687252877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0ec300 con 0x5616dee85df0 2024-09-11T00:08:08.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.186+0000 7f550ffcc740 1 -- 172.21.15.19:0/2687252877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee85df0 msgr2=0x5616dee91840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.186+0000 7f550ffcc740 1 --2- 172.21.15.19:0/2687252877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee85df0 0x5616dee91840 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f54fc016000 tx=0x7f54fc011000 comp rx=0 tx=0).stop 2024-09-11T00:08:08.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.191+0000 7f5507fff640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f54f00b5650 0x7f54f00b7b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f54f8005ab0 tx=0x7f54f802a9b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.192+0000 7f550ffcc740 1 -- 172.21.15.19:0/2687252877 shutdown_connections 2024-09-11T00:08:08.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.192+0000 7f550ffcc740 1 --2- 172.21.15.19:0/2687252877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee91d80 0x5616dee94170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.192+0000 7f550ffcc740 1 --2- 172.21.15.19:0/2687252877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee85df0 0x5616dee91840 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.192+0000 7f550ffcc740 1 --2- 172.21.15.19:0/2687252877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.192+0000 7f550ffcc740 1 -- 172.21.15.19:0/2687252877 >> 172.21.15.19:0/2687252877 conn(0x5616dee83300 msgr2=0x5616dee844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.195 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:08 smithi019 ceph-mon[30859]: pgmap v493: 97 pgs: 97 active+clean; 765 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 694 op/s 2024-09-11T00:08:08.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.202+0000 7f550ffcc740 1 -- 172.21.15.19:0/2687252877 shutdown_connections 2024-09-11T00:08:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.202+0000 7f550ffcc740 1 -- 172.21.15.19:0/2687252877 wait complete. 2024-09-11T00:08:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.203+0000 7f550ffcc740 1 -- start start 2024-09-11T00:08:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.203+0000 7f550ffcc740 1 Processor -- start 2024-09-11T00:08:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.204+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee854d0 0x5616dee916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.204+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee85df0 0x5616dee8eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee8f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f5506ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee85df0 0x5616dee8eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f5506ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee85df0 0x5616dee8eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:36538/0 (socket says 172.21.15.19:36538) 2024-09-11T00:08:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f5507fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee8f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f5507fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee8f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55736/0 (socket says 172.21.15.19:55736) 2024-09-11T00:08:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f5506ffd640 1 -- 172.21.15.19:0/883653152 learned_addr learned my addr 172.21.15.19:0/883653152 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5616dec4c700 con 0x5616dee854d0 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5616ded86160 con 0x5616dee85df0 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616dee94a00 con 0x5616dee91d80 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.208+0000 7f550ffcc740 10 client.0 _ll_register_callbacks cb 0x5616ded9f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.210+0000 7f5506ffd640 1 -- 172.21.15.19:0/883653152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 msgr2=0x5616dee8f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.210+0000 7f5506ffd640 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee8f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.210+0000 7f5506ffd640 1 -- 172.21.15.19:0/883653152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee854d0 msgr2=0x5616dee916c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.210+0000 7f5506ffd640 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee854d0 0x5616dee916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.210+0000 7f5506ffd640 1 -- 172.21.15.19:0/883653152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616dedb3c90 con 0x5616dee85df0 2024-09-11T00:08:08.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.216+0000 7f5506ffd640 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee85df0 0x5616dee8eb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f550000ba10 tx=0x7f550000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec51a18315427d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.218+0000 7f54e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:08:08.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.219+0000 7f54e6ffd640 1 -- 172.21.15.19:0/883653152 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500007850 con 0x5616dee85df0 2024-09-11T00:08:08.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.219+0000 7f54e6ffd640 1 -- 172.21.15.19:0/883653152 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f55000079f0 con 0x5616dee85df0 2024-09-11T00:08:08.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.219+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54fc0eec50 con 0x5616dee85df0 2024-09-11T00:08:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.227+0000 7f54e6ffd640 1 -- 172.21.15.19:0/883653152 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5500007bf0 con 0x5616dee85df0 2024-09-11T00:08:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.227+0000 7f550ffcc740 10 client.25559 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.227+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5616deea04a0 con 0x5616dee85df0 2024-09-11T00:08:08.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f54e6ffd640 1 -- 172.21.15.19:0/883653152 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc0eec50 con 0x5616dee85df0 2024-09-11T00:08:08.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f54e6ffd640 1 -- 172.21.15.19:0/883653152 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f55000153c0 con 0x5616dee85df0 2024-09-11T00:08:08.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f550ffcc740 10 client.25559 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:08.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f550ffcc740 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:08.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f550ffcc740 20 client.25559 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:08.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f550ffcc740 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616deea1a00 0x5616deea3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f550ffcc740 4 client.25559 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:08.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.231+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616dedfddf0 con 0x5616deea1a00 2024-09-11T00:08:08.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.232+0000 7f55077fe640 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616deea1a00 0x5616deea3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.245+0000 7f55077fe640 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616deea1a00 0x5616deea3e20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fd7c8803ffb2ff7 server_cookie=f6639933b033b3e7 in_seq=0 out_seq=0 2024-09-11T00:08:08.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.245+0000 7f54e6ffd640 10 client.25559 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:08.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.249+0000 7f54e6ffd640 1 -- 172.21.15.19:0/883653152 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616dedfddf0 con 0x5616deea1a00 2024-09-11T00:08:08.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.249+0000 7f54e6ffd640 10 client.25559 handle_command_reply: tid=0 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.249+0000 7f550ffcc740 1 client.25559 shutdown 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee85df0 msgr2=0x5616dee8eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee85df0 0x5616dee8eb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f550000ba10 tx=0x7f550000bed0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 shutdown_connections 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee8f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee85df0 0x5616dee8eb10 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f550000ba10 tx=0x7f550000bed0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616deea1a00 0x5616deea3e20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 --2- 172.21.15.19:0/883653152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee854d0 0x5616dee916c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 >> 172.21.15.19:0/883653152 conn(0x5616dee83300 msgr2=0x5616dee88e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.256+0000 7f54e6ffd640 0 client.25559 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.257+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 shutdown_connections 2024-09-11T00:08:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.257+0000 7f550ffcc740 1 -- 172.21.15.19:0/883653152 wait complete. 2024-09-11T00:08:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.257+0000 7f550ffcc740 20 client.25559 trim_cache size 0 max 16384 2024-09-11T00:08:08.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.286+0000 7f550ffcc740 1 Processor -- start 2024-09-11T00:08:08.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.286+0000 7f550ffcc740 1 -- start start 2024-09-11T00:08:08.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee82c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee91d80 0x5616dee84210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee8a4a0 0x5616dee84750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f550ffcc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f54f4010ff0 con 0x5616dee91d80 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f550ffcc740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f54f400e890 con 0x5616dee8a4a0 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f550ffcc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54f400c6e0 con 0x5616dee854d0 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f55077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee82c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f55077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee82c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55746/0 (socket says 172.21.15.19:55746) 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f55077fe640 1 -- 172.21.15.19:0/912663878 learned_addr learned my addr 172.21.15.19:0/912663878 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.287+0000 7f5506ffd640 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee91d80 0x5616dee84210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.288+0000 7f55077fe640 1 -- 172.21.15.19:0/912663878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee8a4a0 msgr2=0x5616dee84750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:08:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.288+0000 7f55077fe640 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee8a4a0 0x5616dee84750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.288+0000 7f55077fe640 1 -- 172.21.15.19:0/912663878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee91d80 msgr2=0x5616dee84210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:08.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.288+0000 7f55077fe640 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee91d80 0x5616dee84210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.288+0000 7f55077fe640 1 -- 172.21.15.19:0/912663878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616dee912f0 con 0x5616dee854d0 2024-09-11T00:08:08.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.288+0000 7f55077fe640 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee82c10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0efbf0 tx=0x7f54fc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72dff814d0b23326 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.290+0000 7f54ed7fa640 1 -- 172.21.15.19:0/912663878 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc01e040 con 0x5616dee854d0 2024-09-11T00:08:08.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.290+0000 7f54ed7fa640 1 -- 172.21.15.19:0/912663878 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc0eb040 con 0x5616dee854d0 2024-09-11T00:08:08.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.290+0000 7f54ed7fa640 1 -- 172.21.15.19:0/912663878 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0adbf0 con 0x5616dee854d0 2024-09-11T00:08:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.294+0000 7f550ffcc740 1 -- 172.21.15.19:0/912663878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 msgr2=0x5616dee82c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.294+0000 7f550ffcc740 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee82c10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0efbf0 tx=0x7f54fc000bc0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.296+0000 7f550ffcc740 1 -- 172.21.15.19:0/912663878 shutdown_connections 2024-09-11T00:08:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.296+0000 7f550ffcc740 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee8a4a0 0x5616dee84750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.296+0000 7f550ffcc740 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee91d80 0x5616dee84210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.296+0000 7f550ffcc740 1 --2- 172.21.15.19:0/912663878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee854d0 0x5616dee82c10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.296+0000 7f550ffcc740 1 -- 172.21.15.19:0/912663878 >> 172.21.15.19:0/912663878 conn(0x5616dee83300 msgr2=0x5616dee89d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.306+0000 7f550ffcc740 1 -- 172.21.15.19:0/912663878 shutdown_connections 2024-09-11T00:08:08.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.308+0000 7f550ffcc740 1 -- 172.21.15.19:0/912663878 wait complete. 2024-09-11T00:08:08.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.309+0000 7f550ffcc740 1 -- start start 2024-09-11T00:08:08.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.309+0000 7f550ffcc740 1 Processor -- start 2024-09-11T00:08:08.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.312+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee854d0 0x5616dee99d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.312+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee9a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.312+0000 7f550ffcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee9a8c0 0x5616dee94d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.312+0000 7f550ffcc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f54f400cd50 con 0x5616dee9a8c0 2024-09-11T00:08:08.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.312+0000 7f550ffcc740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f54f400e1c0 con 0x5616dee854d0 2024-09-11T00:08:08.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.312+0000 7f550ffcc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54f400d420 con 0x5616dee91d80 2024-09-11T00:08:08.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.312+0000 7f550ffcc740 10 client.0 _ll_register_callbacks cb 0x7f5500009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee9a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee9a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55762/0 (socket says 172.21.15.19:55762) 2024-09-11T00:08:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 -- 172.21.15.19:0/90114774 learned_addr learned my addr 172.21.15.19:0/90114774 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f55077fe640 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee854d0 0x5616dee99d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 -- 172.21.15.19:0/90114774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee854d0 msgr2=0x5616dee99d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee854d0 0x5616dee99d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 -- 172.21.15.19:0/90114774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee9a8c0 msgr2=0x5616dee94d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:08.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee9a8c0 0x5616dee94d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.313+0000 7f5506ffd640 1 -- 172.21.15.19:0/90114774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616dee955b0 con 0x5616dee91d80 2024-09-11T00:08:08.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.314+0000 7f5506ffd640 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee9a270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5500012040 tx=0x7f5500009a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=661ea8f9b556359d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.314+0000 7f54e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:08:08.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.318+0000 7f54e6ffd640 1 -- 172.21.15.19:0/90114774 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550002e020 con 0x5616dee91d80 2024-09-11T00:08:08.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.318+0000 7f54e6ffd640 1 -- 172.21.15.19:0/90114774 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f550000b0c0 con 0x5616dee91d80 2024-09-11T00:08:08.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.321+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54fc0eb040 con 0x5616dee91d80 2024-09-11T00:08:08.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.323+0000 7f54e6ffd640 1 -- 172.21.15.19:0/90114774 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5500003a30 con 0x5616dee91d80 2024-09-11T00:08:08.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.324+0000 7f550ffcc740 10 client.25777 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:08.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.324+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5616def0f550 con 0x5616dee91d80 2024-09-11T00:08:08.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.325+0000 7f54e6ffd640 1 -- 172.21.15.19:0/90114774 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc0eb040 con 0x5616dee91d80 2024-09-11T00:08:08.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.325+0000 7f54e6ffd640 1 -- 172.21.15.19:0/90114774 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f5500004040 con 0x5616dee91d80 2024-09-11T00:08:08.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.325+0000 7f550ffcc740 10 client.25777 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:08.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.325+0000 7f550ffcc740 10 client.25777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:08.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.325+0000 7f550ffcc740 20 client.25777 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:08.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.325+0000 7f550ffcc740 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616def0fcb0 0x5616def120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.326+0000 7f550ffcc740 4 client.25777 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:08:08.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.326+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616dedf98a0 con 0x5616def0fcb0 2024-09-11T00:08:08.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.326+0000 7f55077fe640 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616def0fcb0 0x5616def120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.328+0000 7f54e6ffd640 10 client.25777 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.329+0000 7f55077fe640 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616def0fcb0 0x5616def120d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a22674f28d0ee89 server_cookie=57a645c3ebc4d729 in_seq=0 out_seq=0 2024-09-11T00:08:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.330+0000 7f54e6ffd640 1 -- 172.21.15.19:0/90114774 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616dedf98a0 con 0x5616def0fcb0 2024-09-11T00:08:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.330+0000 7f54e6ffd640 10 client.25777 handle_command_reply: tid=0 2024-09-11T00:08:08.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.330+0000 7f550ffcc740 1 client.25777 shutdown 2024-09-11T00:08:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.335+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 msgr2=0x5616dee9a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.335+0000 7f550ffcc740 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee9a270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5500012040 tx=0x7f5500009a10 comp rx=0 tx=0).stop 2024-09-11T00:08:08.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.340+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 shutdown_connections 2024-09-11T00:08:08.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.340+0000 7f550ffcc740 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5616def0fcb0 0x5616def120d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.340+0000 7f550ffcc740 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616dee9a8c0 0x5616dee94d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.340+0000 7f550ffcc740 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616dee91d80 0x5616dee9a270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.340+0000 7f550ffcc740 1 --2- 172.21.15.19:0/90114774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616dee854d0 0x5616dee99d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.340+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 >> 172.21.15.19:0/90114774 conn(0x5616dee83300 msgr2=0x5616dee84210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.341+0000 7f54e6ffd640 0 client.25777 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:08.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.346+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 shutdown_connections 2024-09-11T00:08:08.352 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:08:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.351+0000 7f550ffcc740 1 -- 172.21.15.19:0/90114774 wait complete. 2024-09-11T00:08:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.351+0000 7f550ffcc740 20 client.25777 trim_cache size 0 max 16384 2024-09-11T00:08:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.352+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f54f00b5650 msgr2=0x7f54f00b7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.352+0000 7f550dbf7640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f54f00b5650 0x7f54f00b7b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f54f8005ab0 tx=0x7f54f802a9b0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.352+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 msgr2=0x7f55081195a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.352+0000 7f550dbf7640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 0x7f55081195a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00b4a0 tx=0x7f54fc00b960 comp rx=0 tx=0).stop 2024-09-11T00:08:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 shutdown_connections 2024-09-11T00:08:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f550811c0a0 0x7f5508112a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f54f00b5650 0x7f54f00b7b10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f550810a530 0x7f5508119ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 --2- 172.21.15.19:0/53152890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f550810a150 0x7f55081195a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 >> 172.21.15.19:0/53152890 conn(0x7f550806dfc0 msgr2=0x7f550811c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 shutdown_connections 2024-09-11T00:08:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:08.356+0000 7f550dbf7640 1 -- 172.21.15.19:0/53152890 wait complete. 2024-09-11T00:08:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:08 smithi135 ceph-mon[35432]: pgmap v493: 97 pgs: 97 active+clean; 765 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 694 op/s 2024-09-11T00:08:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:08 smithi131 ceph-mon[35491]: pgmap v493: 97 pgs: 97 active+clean; 765 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 694 op/s 2024-09-11T00:08:10.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:10 smithi135 ceph-mon[35432]: pgmap v494: 97 pgs: 97 active+clean; 757 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 734 op/s 2024-09-11T00:08:10.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:10 smithi019 ceph-mon[30859]: pgmap v494: 97 pgs: 97 active+clean; 757 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 734 op/s 2024-09-11T00:08:10.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:10 smithi131 ceph-mon[35491]: pgmap v494: 97 pgs: 97 active+clean; 757 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 734 op/s 2024-09-11T00:08:10.678 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:08:10.679 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:08:12.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:12 smithi019 ceph-mon[30859]: pgmap v495: 97 pgs: 97 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 728 op/s 2024-09-11T00:08:12.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:12 smithi131 ceph-mon[35491]: pgmap v495: 97 pgs: 97 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 728 op/s 2024-09-11T00:08:12.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:12 smithi135 ceph-mon[35432]: pgmap v495: 97 pgs: 97 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 728 op/s 2024-09-11T00:08:13.116 INFO:tasks.workunit.client.0.smithi019.stdout: 131 1891909 719 1311215 418 1126058 1708 2024-09-11T00:08:14.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:14 smithi019 ceph-mon[30859]: pgmap v496: 97 pgs: 97 active+clean; 745 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.1 MiB/s wr, 746 op/s 2024-09-11T00:08:14.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:14 smithi131 ceph-mon[35491]: pgmap v496: 97 pgs: 97 active+clean; 745 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.1 MiB/s wr, 746 op/s 2024-09-11T00:08:14.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:14 smithi135 ceph-mon[35432]: pgmap v496: 97 pgs: 97 active+clean; 745 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.1 MiB/s wr, 746 op/s 2024-09-11T00:08:14.879 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:16.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.149+0000 7f8094220640 1 -- 172.21.15.19:0/2788686773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10f750 msgr2=0x7f808c115f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.149+0000 7f8094220640 1 --2- 172.21.15.19:0/2788686773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10f750 0x7f808c115f50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8084009ca0 tx=0x7f808402a8f0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.149+0000 7f8094220640 1 -- 172.21.15.19:0/2788686773 shutdown_connections 2024-09-11T00:08:16.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.149+0000 7f8094220640 1 --2- 172.21.15.19:0/2788686773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10f750 0x7f808c115f50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.149+0000 7f8094220640 1 --2- 172.21.15.19:0/2788686773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808c10edd0 0x7f808c10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.149+0000 7f8094220640 1 --2- 172.21.15.19:0/2788686773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c1093c0 0x7f808c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.149+0000 7f8094220640 1 -- 172.21.15.19:0/2788686773 >> 172.21.15.19:0/2788686773 conn(0x7f808c078aa0 msgr2=0x7f808c07aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:16.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.156+0000 7f8094220640 1 -- 172.21.15.19:0/2788686773 shutdown_connections 2024-09-11T00:08:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.158+0000 7f8094220640 1 -- 172.21.15.19:0/2788686773 wait complete. 2024-09-11T00:08:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 Processor -- start 2024-09-11T00:08:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 -- start start 2024-09-11T00:08:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808c1093c0 0x7f808c074730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10edd0 0x7f808c074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c10f750 0x7f808c06da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f808c119400 con 0x7f808c10edd0 2024-09-11T00:08:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f808c119280 con 0x7f808c1093c0 2024-09-11T00:08:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.159+0000 7f8094220640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f808c119580 con 0x7f808c10f750 2024-09-11T00:08:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80927bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c10f750 0x7f808c06da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80927bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c10f750 0x7f808c06da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54088/0 (socket says 172.21.15.19:54088) 2024-09-11T00:08:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80927bd640 1 -- 172.21.15.19:0/3320930184 learned_addr learned my addr 172.21.15.19:0/3320930184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80917bb640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10edd0 0x7f808c074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80917bb640 1 -- 172.21.15.19:0/3320930184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c10f750 msgr2=0x7f808c06da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80917bb640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c10f750 0x7f808c06da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80917bb640 1 -- 172.21.15.19:0/3320930184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808c1093c0 msgr2=0x7f808c074730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:08:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80917bb640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808c1093c0 0x7f808c074730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.160+0000 7f80917bb640 1 -- 172.21.15.19:0/3320930184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808c06e340 con 0x7f808c10edd0 2024-09-11T00:08:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.165+0000 7f80917bb640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10edd0 0x7f808c074c70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f808000d930 tx=0x7f808000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.166+0000 7f807effd640 1 -- 172.21.15.19:0/3320930184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080017070 con 0x7f808c10edd0 2024-09-11T00:08:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.166+0000 7f807effd640 1 -- 172.21.15.19:0/3320930184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8080005020 con 0x7f808c10edd0 2024-09-11T00:08:16.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.166+0000 7f807effd640 1 -- 172.21.15.19:0/3320930184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080004bc0 con 0x7f808c10edd0 2024-09-11T00:08:16.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.167+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808c06e630 con 0x7f808c10edd0 2024-09-11T00:08:16.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.167+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808c0735f0 con 0x7f808c10edd0 2024-09-11T00:08:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.178+0000 7f80965f5740 1 Processor -- start 2024-09-11T00:08:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.180+0000 7f807effd640 1 -- 172.21.15.19:0/3320930184 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f8080009ae0 con 0x7f808c10edd0 2024-09-11T00:08:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.184+0000 7f80965f5740 1 -- start start 2024-09-11T00:08:16.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.184+0000 7f80965f5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.184+0000 7f80965f5740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31da250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.184+0000 7f80965f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 0x5601c31dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.184+0000 7f80965f5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5601c3144e60 con 0x5601c31cdee0 2024-09-11T00:08:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.184+0000 7f80965f5740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5601c3134290 con 0x5601c31ce800 2024-09-11T00:08:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.184+0000 7f80965f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5601c31380a0 con 0x5601c31da790 2024-09-11T00:08:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.186+0000 7f807effd640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80780b5650 0x7f80780b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.186+0000 7f8091fbc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31da250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.186+0000 7f8091fbc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31da250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:58228/0 (socket says 172.21.15.19:58228) 2024-09-11T00:08:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.186+0000 7f8091fbc640 1 -- 172.21.15.19:0/1912295984 learned_addr learned my addr 172.21.15.19:0/1912295984 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.186+0000 7f80917bb640 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 0x5601c31dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.186+0000 7f80927bd640 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f807effd640 1 -- 172.21.15.19:0/3320930184 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f80800e5b70 con 0x7f808c10edd0 2024-09-11T00:08:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f80927bd640 1 -- 172.21.15.19:0/1912295984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 msgr2=0x5601c31dcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f80927bd640 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 0x5601c31dcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f80927bd640 1 -- 172.21.15.19:0/1912295984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 msgr2=0x5601c31da250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f80927bd640 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31da250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f80927bd640 1 -- 172.21.15.19:0/1912295984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c2e92930 con 0x5601c31cdee0 2024-09-11T00:08:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f80927bd640 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31ce2c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f808402f570 tx=0x7f8084031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c7b8d90d52cc97 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.187+0000 7f80927bd640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80780b5650 0x7f80780b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.194+0000 7f80927bd640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80780b5650 0x7f80780b7b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8084031b60 tx=0x7f8084042000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:16.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.198+0000 7f8077fff640 1 -- 172.21.15.19:0/1912295984 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808402fb40 con 0x5601c31cdee0 2024-09-11T00:08:16.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.198+0000 7f8077fff640 1 -- 172.21.15.19:0/1912295984 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8084036070 con 0x5601c31cdee0 2024-09-11T00:08:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.199+0000 7f80965f5740 1 -- 172.21.15.19:0/1912295984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 msgr2=0x5601c31ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.199+0000 7f80965f5740 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31ce2c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f808402f570 tx=0x7f8084031af0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.202+0000 7f80965f5740 1 -- 172.21.15.19:0/1912295984 shutdown_connections 2024-09-11T00:08:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.202+0000 7f80965f5740 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 0x5601c31dcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.202+0000 7f80965f5740 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31da250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.202+0000 7f80965f5740 1 --2- 172.21.15.19:0/1912295984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31ce2c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.202+0000 7f80965f5740 1 -- 172.21.15.19:0/1912295984 >> 172.21.15.19:0/1912295984 conn(0x5601c31cbd10 msgr2=0x5601c31cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.205+0000 7f80965f5740 1 -- 172.21.15.19:0/1912295984 shutdown_connections 2024-09-11T00:08:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.206+0000 7f80965f5740 1 -- 172.21.15.19:0/1912295984 wait complete. 2024-09-11T00:08:16.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.206+0000 7f80965f5740 1 -- start start 2024-09-11T00:08:16.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.206+0000 7f80965f5740 1 Processor -- start 2024-09-11T00:08:16.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.207+0000 7f80965f5740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31cdee0 0x5601c31da210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.207+0000 7f80965f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31ce800 0x5601c31d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.207+0000 7f80965f5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.207+0000 7f80965f5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5601c2f95890 con 0x5601c31da790 2024-09-11T00:08:16.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.207+0000 7f80965f5740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5601c30ced40 con 0x5601c31cdee0 2024-09-11T00:08:16.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.207+0000 7f80965f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5601c31dd430 con 0x5601c31ce800 2024-09-11T00:08:16.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.207+0000 7f80965f5740 10 client.0 _ll_register_callbacks cb 0x5601c3132c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:16.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.210+0000 7f80927bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.210+0000 7f80927bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54006/0 (socket says 172.21.15.19:54006) 2024-09-11T00:08:16.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.211+0000 7f80927bd640 1 -- 172.21.15.19:0/3261076741 learned_addr learned my addr 172.21.15.19:0/3261076741 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:16.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.211+0000 7f80927bd640 1 -- 172.21.15.19:0/3261076741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31ce800 msgr2=0x5601c31d7660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:08:16.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.211+0000 7f80927bd640 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31ce800 0x5601c31d7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.211+0000 7f80927bd640 1 -- 172.21.15.19:0/3261076741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31cdee0 msgr2=0x5601c31da210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:16.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.211+0000 7f80927bd640 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31cdee0 0x5601c31da210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.211+0000 7f80927bd640 1 -- 172.21.15.19:0/3261076741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601c31e67b0 con 0x5601c31da790 2024-09-11T00:08:16.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.212+0000 7f80927bd640 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d7df0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8084046b70 tx=0x7f8084030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29cc41839acb185 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:16.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.213+0000 7f80757fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:08:16.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.213+0000 7f80757fa640 1 -- 172.21.15.19:0/3261076741 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084058030 con 0x5601c31da790 2024-09-11T00:08:16.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.213+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8084036070 con 0x5601c31da790 2024-09-11T00:08:16.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.213+0000 7f80757fa640 1 -- 172.21.15.19:0/3261076741 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8084046d50 con 0x5601c31da790 2024-09-11T00:08:16.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.217+0000 7f80757fa640 1 -- 172.21.15.19:0/3261076741 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8084004b40 con 0x5601c31da790 2024-09-11T00:08:16.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.218+0000 7f80965f5740 10 client.16200 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:16.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.218+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5601c31e9110 con 0x5601c31da790 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80757fa640 1 -- 172.21.15.19:0/3261076741 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8084036070 con 0x5601c31da790 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80757fa640 1 -- 172.21.15.19:0/3261076741 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f8084005280 con 0x5601c31da790 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80965f5740 10 client.16200 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80965f5740 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80965f5740 20 client.16200 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80965f5740 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c31ea6b0 0x5601c31ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80965f5740 4 client.16200 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:16.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.219+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601c3146db0 con 0x5601c31ea6b0 2024-09-11T00:08:16.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.223+0000 7f8091fbc640 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c31ea6b0 0x5601c31ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.238+0000 7f8091fbc640 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c31ea6b0 0x5601c31ecb30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c55986cddbf2b68 server_cookie=e596a73775217a2e in_seq=0 out_seq=0 2024-09-11T00:08:16.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.238+0000 7f80757fa640 10 client.16200 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:16.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.239+0000 7f80757fa640 1 -- 172.21.15.19:0/3261076741 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5601c3146db0 con 0x5601c31ea6b0 2024-09-11T00:08:16.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.239+0000 7f80757fa640 10 client.16200 handle_command_reply: tid=0 2024-09-11T00:08:16.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.239+0000 7f80965f5740 1 client.16200 shutdown 2024-09-11T00:08:16.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 msgr2=0x5601c31d7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d7df0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8084046b70 tx=0x7f8084030d90 comp rx=0 tx=0).stop 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 shutdown_connections 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c31ea6b0 0x5601c31ecb30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d7df0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31ce800 0x5601c31d7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 --2- 172.21.15.19:0/3261076741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31cdee0 0x5601c31da210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80757fa640 0 client.16200 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.244+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 >> 172.21.15.19:0/3261076741 conn(0x5601c31cbd10 msgr2=0x5601c31caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:16.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.245+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 shutdown_connections 2024-09-11T00:08:16.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.245+0000 7f80965f5740 1 -- 172.21.15.19:0/3261076741 wait complete. 2024-09-11T00:08:16.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.245+0000 7f80965f5740 20 client.16200 trim_cache size 0 max 16384 2024-09-11T00:08:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.289+0000 7f80965f5740 1 Processor -- start 2024-09-11T00:08:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.293+0000 7f80965f5740 1 -- start start 2024-09-11T00:08:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.293+0000 7f80965f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31cdee0 0x5601c31d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.293+0000 7f80965f5740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31d4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.293+0000 7f80965f5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.293+0000 7f80965f5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f808c1aec70 con 0x5601c31da790 2024-09-11T00:08:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.293+0000 7f80965f5740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f808c1ac510 con 0x5601c31ce800 2024-09-11T00:08:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.293+0000 7f80965f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f808c1aa360 con 0x5601c31cdee0 2024-09-11T00:08:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54022/0 (socket says 172.21.15.19:54022) 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 -- 172.21.15.19:0/3357832577 learned_addr learned my addr 172.21.15.19:0/3357832577 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f8091fbc640 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31cdee0 0x5601c31d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 -- 172.21.15.19:0/3357832577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31cdee0 msgr2=0x5601c31d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31cdee0 0x5601c31d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 -- 172.21.15.19:0/3357832577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 msgr2=0x5601c31d4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.294+0000 7f80927bd640 1 -- 172.21.15.19:0/3357832577 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c31ed1b0 con 0x5601c31da790 2024-09-11T00:08:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.295+0000 7f80927bd640 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d4db0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8084005650 tx=0x7f808402f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d91accb37acaf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:16.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.298+0000 7f80777fe640 1 -- 172.21.15.19:0/3357832577 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084058040 con 0x5601c31da790 2024-09-11T00:08:16.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.298+0000 7f80777fe640 1 -- 172.21.15.19:0/3357832577 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8084036040 con 0x5601c31da790 2024-09-11T00:08:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.298+0000 7f80777fe640 1 -- 172.21.15.19:0/3357832577 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084004f40 con 0x5601c31da790 2024-09-11T00:08:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.301+0000 7f80965f5740 1 -- 172.21.15.19:0/3357832577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 msgr2=0x5601c31d4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.301+0000 7f80965f5740 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d4db0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8084005650 tx=0x7f808402f420 comp rx=0 tx=0).stop 2024-09-11T00:08:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.302+0000 7f80965f5740 1 -- 172.21.15.19:0/3357832577 shutdown_connections 2024-09-11T00:08:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.302+0000 7f80965f5740 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31da790 0x5601c31d4db0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.302+0000 7f80965f5740 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31d4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.302+0000 7f80965f5740 1 --2- 172.21.15.19:0/3357832577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31cdee0 0x5601c31d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.302+0000 7f80965f5740 1 -- 172.21.15.19:0/3357832577 >> 172.21.15.19:0/3357832577 conn(0x5601c31cbd10 msgr2=0x5601c31d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:16.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.306+0000 7f80965f5740 1 -- 172.21.15.19:0/3357832577 shutdown_connections 2024-09-11T00:08:16.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.306+0000 7f80965f5740 1 -- 172.21.15.19:0/3357832577 wait complete. 2024-09-11T00:08:16.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.307+0000 7f80965f5740 1 -- start start 2024-09-11T00:08:16.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.307+0000 7f80965f5740 1 Processor -- start 2024-09-11T00:08:16.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.308+0000 7f80965f5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.308+0000 7f8091fbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.309+0000 7f8091fbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31df1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54024/0 (socket says 172.21.15.19:54024) 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.309+0000 7f8091fbc640 1 -- 172.21.15.19:0/1904783390 learned_addr learned my addr 172.21.15.19:0/1904783390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.309+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.309+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 0x5601c3250760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.309+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f808c1aa9d0 con 0x5601c31cdee0 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.309+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f808c1abe40 con 0x5601c31ce800 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.309+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f808c1ab0a0 con 0x5601c31da790 2024-09-11T00:08:16.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.310+0000 7f80917bb640 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.310+0000 7f8091fbc640 1 -- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 msgr2=0x5601c3250760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:16.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.310+0000 7f8091fbc640 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 0x5601c3250760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.310+0000 7f8091fbc640 1 -- 172.21.15.19:0/1904783390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 msgr2=0x5601c31df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:16.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.310+0000 7f8091fbc640 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31df740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.310+0000 7f8091fbc640 1 -- 172.21.15.19:0/1904783390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601c31cc790 con 0x5601c31cdee0 2024-09-11T00:08:16.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.311+0000 7f8091fbc640 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31df1c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f808800b690 tx=0x7f8088015a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe6c8c3d175479 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:16.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.311+0000 7f80965f5740 10 client.0 _ll_register_callbacks cb 0x7f80840099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:16.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.311+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8084036040 con 0x5601c31cdee0 2024-09-11T00:08:16.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.312+0000 7f80757fa640 10 client.16206 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:08:16.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.312+0000 7f80757fa640 1 -- 172.21.15.19:0/1904783390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808801f070 con 0x5601c31cdee0 2024-09-11T00:08:16.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.312+0000 7f80757fa640 1 -- 172.21.15.19:0/1904783390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f8088016430 con 0x5601c31cdee0 2024-09-11T00:08:16.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.312+0000 7f80757fa640 1 -- 172.21.15.19:0/1904783390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f808802b050 con 0x5601c31cdee0 2024-09-11T00:08:16.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.316+0000 7f80965f5740 10 client.16206 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:16.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.316+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=32}) -- 0x5601c32580a0 con 0x5601c31cdee0 2024-09-11T00:08:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.318+0000 7f80757fa640 1 -- 172.21.15.19:0/1904783390 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f8088016630 con 0x5601c31cdee0 2024-09-11T00:08:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.319+0000 7f80965f5740 10 client.16206 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.319+0000 7f80965f5740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.319+0000 7f80965f5740 20 client.16206 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.319+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c3258610 0x5601c325aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.319+0000 7f80965f5740 4 client.16206 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:08:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.319+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f8084036040 con 0x5601c3258610 2024-09-11T00:08:16.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.324+0000 7f80917bb640 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c3258610 0x5601c325aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.332+0000 7f80917bb640 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c3258610 0x5601c325aa80 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa087c51fe14a14e server_cookie=c4def9618214551d in_seq=0 out_seq=0 2024-09-11T00:08:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.333+0000 7f80757fa640 10 client.16206 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.334+0000 7f80757fa640 1 -- 172.21.15.19:0/1904783390 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f8084036040 con 0x5601c3258610 2024-09-11T00:08:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.334+0000 7f80757fa640 10 client.16206 handle_command_reply: tid=0 2024-09-11T00:08:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.335+0000 7f80965f5740 1 client.16206 shutdown 2024-09-11T00:08:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 msgr2=0x5601c31df1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31df1c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f808800b690 tx=0x7f8088015a80 comp rx=0 tx=0).stop 2024-09-11T00:08:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 shutdown_connections 2024-09-11T00:08:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601c31da790 0x5601c3250760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601c31ce800 0x5601c31df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5601c3258610 0x5601c325aa80 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 --2- 172.21.15.19:0/1904783390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5601c31cdee0 0x5601c31df1c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.341+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 >> 172.21.15.19:0/1904783390 conn(0x5601c31cbd10 msgr2=0x5601c31d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:16.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.342+0000 7f80757fa640 0 client.16206 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.345+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 shutdown_connections 2024-09-11T00:08:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.345+0000 7f80965f5740 1 -- 172.21.15.19:0/1904783390 wait complete. 2024-09-11T00:08:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.346+0000 7f80965f5740 20 client.16206 trim_cache size 0 max 16384 2024-09-11T00:08:16.350 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:08:16.350 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:08:16.350 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3", 2024-09-11T00:08:16.350 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:08:16.350 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:08:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.348+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80780b5650 msgr2=0x7f80780b7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.348+0000 7f8094220640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80780b5650 0x7f80780b7b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8084031b60 tx=0x7f8084042000 comp rx=0 tx=0).stop 2024-09-11T00:08:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10edd0 msgr2=0x7f808c074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10edd0 0x7f808c074c70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f808000d930 tx=0x7f808000ddf0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 shutdown_connections 2024-09-11T00:08:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808c10f750 0x7f808c06da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f80780b5650 0x7f80780b7b10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c10edd0 0x7f808c074c70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 --2- 172.21.15.19:0/3320930184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808c1093c0 0x7f808c074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.349+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 >> 172.21.15.19:0/3320930184 conn(0x7f808c078aa0 msgr2=0x7f808c07ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:16.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.351+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 shutdown_connections 2024-09-11T00:08:16.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:16.351+0000 7f8094220640 1 -- 172.21.15.19:0/3320930184 wait complete. 2024-09-11T00:08:16.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:16 smithi019 ceph-mon[30859]: pgmap v497: 97 pgs: 97 active+clean; 745 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.8 MiB/s wr, 507 op/s 2024-09-11T00:08:16.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:16 smithi131 ceph-mon[35491]: pgmap v497: 97 pgs: 97 active+clean; 745 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.8 MiB/s wr, 507 op/s 2024-09-11T00:08:16.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:16 smithi135 ceph-mon[35432]: pgmap v497: 97 pgs: 97 active+clean; 745 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.8 MiB/s wr, 507 op/s 2024-09-11T00:08:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:17 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:08:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:17 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:17 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:17 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:17.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:17 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:17 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:08:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:17 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:17 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:17 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:17.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:17 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:17.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:08:17.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:17 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:08:17.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:17 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:17.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:17 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:17.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:17 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:17.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:17 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:18.222 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:18.347 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:18 smithi019 ceph-mon[30859]: pgmap v498: 97 pgs: 97 active+clean; 749 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T00:08:18.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:18 smithi131 ceph-mon[35491]: pgmap v498: 97 pgs: 97 active+clean; 749 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T00:08:18.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:18 smithi135 ceph-mon[35432]: pgmap v498: 97 pgs: 97 active+clean; 749 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T00:08:18.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.807+0000 7fb9900a0640 1 -- 172.21.15.19:0/3576267100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 msgr2=0x7fb988104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.807+0000 7fb9900a0640 1 --2- 172.21.15.19:0/3576267100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb988104100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb984009900 tx=0x7fb98402a410 comp rx=0 tx=0).stop 2024-09-11T00:08:18.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.807+0000 7fb9900a0640 1 -- 172.21.15.19:0/3576267100 shutdown_connections 2024-09-11T00:08:18.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.807+0000 7fb9900a0640 1 --2- 172.21.15.19:0/3576267100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb98810d180 0x7fb98810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.807+0000 7fb9900a0640 1 --2- 172.21.15.19:0/3576267100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988104640 0x7fb98810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.807+0000 7fb9900a0640 1 --2- 172.21.15.19:0/3576267100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb988104100 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.807+0000 7fb9900a0640 1 -- 172.21.15.19:0/3576267100 >> 172.21.15.19:0/3576267100 conn(0x7fb9880fd7c0 msgr2=0x7fb9880ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:18.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.808+0000 7fb9900a0640 1 -- 172.21.15.19:0/3576267100 shutdown_connections 2024-09-11T00:08:18.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.808+0000 7fb9900a0640 1 -- 172.21.15.19:0/3576267100 wait complete. 2024-09-11T00:08:18.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.808+0000 7fb9900a0640 1 Processor -- start 2024-09-11T00:08:18.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb9900a0640 1 -- start start 2024-09-11T00:08:18.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb9900a0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb98819f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb9900a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988104640 0x7fb98819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb9900a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb98810d180 0x7fb9881a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb98819f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb98819f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:58272/0 (socket says 172.21.15.19:58272) 2024-09-11T00:08:18.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb98d63b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988104640 0x7fb98819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb98d63b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988104640 0x7fb98819fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54158/0 (socket says 172.21.15.19:54158) 2024-09-11T00:08:18.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb98de3c640 1 -- 172.21.15.19:0/106290671 learned_addr learned my addr 172.21.15.19:0/106290671 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:18.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.809+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881193f0 con 0x7fb98810d180 2024-09-11T00:08:18.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb988119270 con 0x7fb988103d20 2024-09-11T00:08:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb988119570 con 0x7fb988104640 2024-09-11T00:08:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb98e63d640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb98810d180 0x7fb9881a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb98de3c640 1 -- 172.21.15.19:0/106290671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988104640 msgr2=0x7fb98819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb98de3c640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988104640 0x7fb98819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb98de3c640 1 -- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb98810d180 msgr2=0x7fb9881a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb98de3c640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb98810d180 0x7fb9881a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.810+0000 7fb98de3c640 1 -- 172.21.15.19:0/106290671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9881a59f0 con 0x7fb988103d20 2024-09-11T00:08:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.811+0000 7fb98de3c640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb98819f940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb984005940 tx=0x7fb984004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.811+0000 7fb97effd640 1 -- 172.21.15.19:0/106290671 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98403f030 con 0x7fb988103d20 2024-09-11T00:08:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.812+0000 7fb97effd640 1 -- 172.21.15.19:0/106290671 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb984003aa0 con 0x7fb988103d20 2024-09-11T00:08:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.812+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9881a5c80 con 0x7fb988103d20 2024-09-11T00:08:18.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.812+0000 7fb97effd640 1 -- 172.21.15.19:0/106290671 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984035070 con 0x7fb988103d20 2024-09-11T00:08:18.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.812+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881ac3a0 con 0x7fb988103d20 2024-09-11T00:08:18.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.817+0000 7fb97effd640 1 -- 172.21.15.19:0/106290671 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fb984003c50 con 0x7fb988103d20 2024-09-11T00:08:18.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.818+0000 7fb97effd640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb9740b5540 0x7fb9740b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.818+0000 7fb992475740 1 Processor -- start 2024-09-11T00:08:18.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.819+0000 7fb98d63b640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb9740b5540 0x7fb9740b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.819+0000 7fb97effd640 1 -- 172.21.15.19:0/106290671 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb984106800 con 0x7fb988103d20 2024-09-11T00:08:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb992475740 1 -- start start 2024-09-11T00:08:18.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb992475740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafe4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb992475740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4da0 0x560beaff07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb992475740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beaff3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb992475740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560beaf5ae50 con 0x560beafe4da0 2024-09-11T00:08:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb992475740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560beaf4a280 con 0x560beaff0d30 2024-09-11T00:08:18.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb992475740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560beaf4e090 con 0x560beafe4480 2024-09-11T00:08:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb98d63b640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb9740b5540 0x7fb9740b7a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb98810f840 tx=0x7fb978005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb98d63b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4da0 0x560beaff07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb98d63b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4da0 0x560beaff07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54036/0 (socket says 172.21.15.19:54036) 2024-09-11T00:08:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb98d63b640 1 -- 172.21.15.19:0/161623941 learned_addr learned my addr 172.21.15.19:0/161623941 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.820+0000 7fb98e63d640 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beaff3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb98e63d640 1 -- 172.21.15.19:0/161623941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 msgr2=0x560beafe4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb98e63d640 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafe4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb98e63d640 1 -- 172.21.15.19:0/161623941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4da0 msgr2=0x560beaff07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb98e63d640 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4da0 0x560beaff07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb98e63d640 1 -- 172.21.15.19:0/161623941 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560beaca8650 con 0x560beaff0d30 2024-09-11T00:08:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb98e63d640 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beaff3120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb980009f50 tx=0x7fb980003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f750537f97f6312c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb973fff640 1 -- 172.21.15.19:0/161623941 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980011440 con 0x560beaff0d30 2024-09-11T00:08:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb973fff640 1 -- 172.21.15.19:0/161623941 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb980015030 con 0x560beaff0d30 2024-09-11T00:08:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.821+0000 7fb973fff640 1 -- 172.21.15.19:0/161623941 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980010980 con 0x560beaff0d30 2024-09-11T00:08:18.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.822+0000 7fb992475740 1 -- 172.21.15.19:0/161623941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 msgr2=0x560beaff3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.822+0000 7fb992475740 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beaff3120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb980009f50 tx=0x7fb980003e00 comp rx=0 tx=0).stop 2024-09-11T00:08:18.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.823+0000 7fb992475740 1 -- 172.21.15.19:0/161623941 shutdown_connections 2024-09-11T00:08:18.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.823+0000 7fb992475740 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beaff3120 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.823+0000 7fb992475740 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4da0 0x560beaff07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.823+0000 7fb992475740 1 --2- 172.21.15.19:0/161623941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafe4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.823+0000 7fb992475740 1 -- 172.21.15.19:0/161623941 >> 172.21.15.19:0/161623941 conn(0x560beafe22b0 msgr2=0x560beafe3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:18.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.823+0000 7fb992475740 1 -- 172.21.15.19:0/161623941 shutdown_connections 2024-09-11T00:08:18.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.823+0000 7fb992475740 1 -- 172.21.15.19:0/161623941 wait complete. 2024-09-11T00:08:18.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.824+0000 7fb992475740 1 -- start start 2024-09-11T00:08:18.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.824+0000 7fb992475740 1 Processor -- start 2024-09-11T00:08:18.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.825+0000 7fb992475740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4480 0x560beaff0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.825+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4480 0x560beaff0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.825+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4480 0x560beaff0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54046/0 (socket says 172.21.15.19:54046) 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.825+0000 7fb98de3c640 1 -- 172.21.15.19:0/3760957477 learned_addr learned my addr 172.21.15.19:0/3760957477 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.825+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beafedac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beafee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560beadab700 con 0x560beafe4480 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560beaee5110 con 0x560beaff0d30 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beafedac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560beaff39b0 con 0x560beafe4da0 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb98e63d640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beafee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb98d63b640 1 -- 172.21.15.19:0/3760957477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 msgr2=0x560beafee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beafee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.826+0000 7fb98d63b640 1 -- 172.21.15.19:0/3760957477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4480 msgr2=0x560beaff0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4480 0x560beaff0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb992475740 10 client.0 _ll_register_callbacks cb 0x560beaefe990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb98d63b640 1 -- 172.21.15.19:0/3760957477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560beaf12c40 con 0x560beafe4da0 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb98de3c640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4480 0x560beaff0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb980015030 con 0x560beafe4da0 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beafedac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x560beafe3190 tx=0x7fb978004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1bd8d406016a03f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb9717fa640 10 client.25789 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb9717fa640 1 -- 172.21.15.19:0/3760957477 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97801db20 con 0x560beafe4da0 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb9717fa640 1 -- 172.21.15.19:0/3760957477 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb97801dcc0 con 0x560beafe4da0 2024-09-11T00:08:18.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb9717fa640 1 -- 172.21.15.19:0/3760957477 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb978004020 con 0x560beafe4da0 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb992475740 10 client.25789 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.827+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=32}) -- 0x560beafff200 con 0x560beafe4da0 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb9717fa640 1 -- 172.21.15.19:0/3760957477 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fb9780041c0 con 0x560beafe4da0 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb992475740 10 client.25789 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb992475740 10 client.25789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb992475740 20 client.25789 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb000620 0x560beb002a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb992475740 4 client.25789 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560beaf5cda0 con 0x560beb000620 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb98de3c640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb000620 0x560beb002a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb98de3c640 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb000620 0x560beb002a70 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dda0d6135e2298d server_cookie=7d99818edbad696a in_seq=0 out_seq=0 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.828+0000 7fb9717fa640 10 client.25789 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb9717fa640 1 -- 172.21.15.19:0/3760957477 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560beaf5cda0 con 0x560beb000620 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb9717fa640 10 client.25789 handle_command_reply: tid=0 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 client.25789 shutdown 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 msgr2=0x560beafedac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beafedac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x560beafe3190 tx=0x7fb978004730 comp rx=0 tx=0).stop 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 shutdown_connections 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beaff0d30 0x560beafee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beafedac0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb000620 0x560beb002a70 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 --2- 172.21.15.19:0/3760957477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beafe4480 0x560beaff0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 >> 172.21.15.19:0/3760957477 conn(0x560beafe22b0 msgr2=0x560beafe7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.829+0000 7fb9717fa640 0 client.25789 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.830+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 shutdown_connections 2024-09-11T00:08:18.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.830+0000 7fb992475740 1 -- 172.21.15.19:0/3760957477 wait complete. 2024-09-11T00:08:18.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.830+0000 7fb992475740 20 client.25789 trim_cache size 0 max 16384 2024-09-11T00:08:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 Processor -- start 2024-09-11T00:08:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 -- start start 2024-09-11T00:08:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4da0 0x560beaffcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881b7440 con 0x560beaff0d30 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881b4ce0 con 0x560beafe4da0 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.853+0000 7fb992475740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881b2b30 con 0x560beafe4480 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafee140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54190/0 (socket says 172.21.15.19:54190) 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98de3c640 1 -- 172.21.15.19:0/3943476697 learned_addr learned my addr 172.21.15.19:0/3943476697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4da0 0x560beaffcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98e63d640 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98d63b640 1 -- 172.21.15.19:0/3943476697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 msgr2=0x560beafee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98d63b640 1 -- 172.21.15.19:0/3943476697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 msgr2=0x560beaff2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98d63b640 1 -- 172.21.15.19:0/3943476697 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560beaff3890 con 0x560beafe4da0 2024-09-11T00:08:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98de3c640 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.854+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4da0 0x560beaffcbe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb97800eca0 tx=0x7fb978022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f663a55039431a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.855+0000 7fb9737fe640 1 -- 172.21.15.19:0/3943476697 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97801dd20 con 0x560beafe4da0 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.855+0000 7fb9737fe640 1 -- 172.21.15.19:0/3943476697 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb980015030 con 0x560beafe4da0 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.855+0000 7fb9737fe640 1 -- 172.21.15.19:0/3943476697 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978005430 con 0x560beafe4da0 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.855+0000 7fb992475740 1 -- 172.21.15.19:0/3943476697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4da0 msgr2=0x560beaffcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.855+0000 7fb992475740 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4da0 0x560beaffcbe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb97800eca0 tx=0x7fb978022000 comp rx=0 tx=0).stop 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.855+0000 7fb992475740 1 -- 172.21.15.19:0/3943476697 shutdown_connections 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4da0 0x560beaffcbe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 --2- 172.21.15.19:0/3943476697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4480 0x560beafee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 -- 172.21.15.19:0/3943476697 >> 172.21.15.19:0/3943476697 conn(0x560beafe22b0 msgr2=0x560beafeda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 -- 172.21.15.19:0/3943476697 shutdown_connections 2024-09-11T00:08:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 -- 172.21.15.19:0/3943476697 wait complete. 2024-09-11T00:08:18.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 -- start start 2024-09-11T00:08:18.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.856+0000 7fb992475740 1 Processor -- start 2024-09-11T00:08:18.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb992475740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4480 0x560beaff8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb992475740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beaff91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb992475740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb992475740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881b31a0 con 0x560beaff0d30 2024-09-11T00:08:18.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb992475740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881b4610 con 0x560beafe4480 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb992475740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881b3870 con 0x560beafe4da0 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb992475740 10 client.0 _ll_register_callbacks cb 0x7fb97800e980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb98d63b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beaff91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4480 0x560beaff8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb98de3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4480 0x560beaff8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:58312/0 (socket says 172.21.15.19:58312) 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb98de3c640 1 -- 172.21.15.19:0/3423993960 learned_addr learned my addr 172.21.15.19:0/3423993960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.857+0000 7fb98e63d640 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb98de3c640 1 -- 172.21.15.19:0/3423993960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 msgr2=0x560beaff91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb98de3c640 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beaff91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb98de3c640 1 -- 172.21.15.19:0/3423993960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 msgr2=0x560beaff3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb98de3c640 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb98de3c640 1 -- 172.21.15.19:0/3423993960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560beaff41f0 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb98de3c640 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4480 0x560beaff8c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb984006010 tx=0x7fb984031950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b22bb657df1761a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb9717fa640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb9717fa640 1 -- 172.21.15.19:0/3423993960 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984049040 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb9717fa640 1 -- 172.21.15.19:0/3423993960 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7fb9841041f0 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb980015030 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb9717fa640 1 -- 172.21.15.19:0/3423993960 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb9841043f0 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb992475740 10 client.25589 fetch_fsmap learned FSMap version 32 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.858+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560beb06dec0 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb9717fa640 1 -- 172.21.15.19:0/3423993960 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9840d1030 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb9717fa640 1 -- 172.21.15.19:0/3423993960 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fb9840ccfb0 con 0x560beafe4480 2024-09-11T00:08:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb992475740 10 client.25589 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T00:08:18.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb992475740 10 client.25589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:18.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb992475740 20 client.25589 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:18.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb992475740 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb06e590 0x560beb070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:18.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb992475740 4 client.25589 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:08:18.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb980015030 con 0x560beb06e590 2024-09-11T00:08:18.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.859+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb06e590 0x560beb070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:18.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb9717fa640 10 client.25589 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:18.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb98d63b640 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb06e590 0x560beb070980 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b151d6602280bb1 server_cookie=b956a407e8fe4d9d in_seq=0 out_seq=0 2024-09-11T00:08:18.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb9717fa640 1 -- 172.21.15.19:0/3423993960 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x7fb980015030 con 0x560beb06e590 2024-09-11T00:08:18.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb9717fa640 10 client.25589 handle_command_reply: tid=0 2024-09-11T00:08:18.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb992475740 1 client.25589 shutdown 2024-09-11T00:08:18.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4480 msgr2=0x560beaff8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb992475740 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4480 0x560beaff8c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb984006010 tx=0x7fb984031950 comp rx=0 tx=0).stop 2024-09-11T00:08:18.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 shutdown_connections 2024-09-11T00:08:18.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb992475740 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560beb06e590 0x560beb070980 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.861+0000 7fb992475740 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560beaff0d30 0x560beaff3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb992475740 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560beafe4da0 0x560beaff91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb992475740 1 --2- 172.21.15.19:0/3423993960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560beafe4480 0x560beaff8c50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb9717fa640 0 client.25589 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:18.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 >> 172.21.15.19:0/3423993960 conn(0x560beafe22b0 msgr2=0x560beafe0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:18.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 shutdown_connections 2024-09-11T00:08:18.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb992475740 1 -- 172.21.15.19:0/3423993960 wait complete. 2024-09-11T00:08:18.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb992475740 20 client.25589 trim_cache size 0 max 16384 2024-09-11T00:08:18.871 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:08:18.872 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:08:18.872 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:08:18.872 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:08:18.872 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.872 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3", 2024-09-11T00:08:18.872 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.873 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.876 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.876 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.876 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:08:18.876 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:08:18.876 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.877 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.877 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.877 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.877 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.877 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:08:18.877 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:08:18.878 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:08:18.879 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.879 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.879 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.879 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.879 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.880 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:08:18.880 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:08:18.880 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.880 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.880 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.881 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.881 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.881 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:08:18.881 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:08:18.882 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.882 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.882 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.882 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.882 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.883 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:08:18.883 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:08:18.883 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.883 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.883 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.883 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:18.884 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:18.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:08:18.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:08:18.885 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:08:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb9740b5540 msgr2=0x7fb9740b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb9900a0640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb9740b5540 0x7fb9740b7a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb98810f840 tx=0x7fb978005f90 comp rx=0 tx=0).stop 2024-09-11T00:08:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.862+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 msgr2=0x7fb98819f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb98819f940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb984005940 tx=0x7fb984004270 comp rx=0 tx=0).stop 2024-09-11T00:08:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 shutdown_connections 2024-09-11T00:08:18.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb9740b5540 0x7fb9740b7a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb98810d180 0x7fb9881a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988104640 0x7fb98819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 --2- 172.21.15.19:0/106290671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb988103d20 0x7fb98819f940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:18.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 >> 172.21.15.19:0/106290671 conn(0x7fb9880fd7c0 msgr2=0x7fb9880fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:18.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 shutdown_connections 2024-09-11T00:08:18.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:18.863+0000 7fb9900a0640 1 -- 172.21.15.19:0/106290671 wait complete. 2024-09-11T00:08:19.845 INFO:tasks.cephfs.filesystem:scrub status for tag:3d18c9fb-65cc-4d33-8a8e-789ea88b35e3 - {'path': '/', 'tag': '3d18c9fb-65cc-4d33-8a8e-789ea88b35e3', 'options': 'recursive,force'} 2024-09-11T00:08:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:20 smithi019 ceph-mon[30859]: pgmap v499: 97 pgs: 97 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2024-09-11T00:08:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:20 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:20 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:20 smithi131 ceph-mon[35491]: pgmap v499: 97 pgs: 97 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2024-09-11T00:08:20.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:20 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:20.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:20 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:20.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:20 smithi135 ceph-mon[35432]: pgmap v499: 97 pgs: 97 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2024-09-11T00:08:20.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:20 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:20.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:20 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:22.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:22 smithi019 ceph-mon[30859]: pgmap v500: 97 pgs: 97 active+clean; 765 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-11T00:08:22.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:22 smithi131 ceph-mon[35491]: pgmap v500: 97 pgs: 97 active+clean; 765 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-11T00:08:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:22 smithi135 ceph-mon[35432]: pgmap v500: 97 pgs: 97 active+clean; 765 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-11T00:08:23.116 INFO:tasks.workunit.client.0.smithi019.stdout: 134 1412833 202 977450 229 851373 1420 2024-09-11T00:08:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:23 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:23.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:23 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:23 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:23.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:23 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:23.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:23 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:23.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:23 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:24 smithi019 ceph-mon[30859]: pgmap v501: 97 pgs: 97 active+clean; 803 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.9 MiB/s wr, 487 op/s 2024-09-11T00:08:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:24 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:24.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:24 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:24 smithi131 ceph-mon[35491]: pgmap v501: 97 pgs: 97 active+clean; 803 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.9 MiB/s wr, 487 op/s 2024-09-11T00:08:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:24 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:24.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:24 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:24 smithi135 ceph-mon[35432]: pgmap v501: 97 pgs: 97 active+clean; 803 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.9 MiB/s wr, 487 op/s 2024-09-11T00:08:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:24 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:24 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:25.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:25 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:25.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:25 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:25.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:25 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:25.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:25 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:25.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:25 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:25.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:25 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:26.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:26 smithi019 ceph-mon[30859]: pgmap v502: 97 pgs: 97 active+clean; 820 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 479 op/s 2024-09-11T00:08:26.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:26 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:26.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:26 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:08:26.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:26 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:26.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:26 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:26 smithi131 ceph-mon[35491]: pgmap v502: 97 pgs: 97 active+clean; 820 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 479 op/s 2024-09-11T00:08:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:26 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:26 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:08:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:26 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:26.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:26 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:26 smithi135 ceph-mon[35432]: pgmap v502: 97 pgs: 97 active+clean; 820 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 479 op/s 2024-09-11T00:08:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:26 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:26 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:08:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:26 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:26.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:26 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:28.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:28 smithi019 ceph-mon[30859]: pgmap v503: 97 pgs: 97 active+clean; 830 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.5 MiB/s wr, 620 op/s 2024-09-11T00:08:28.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:28 smithi131 ceph-mon[35491]: pgmap v503: 97 pgs: 97 active+clean; 830 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.5 MiB/s wr, 620 op/s 2024-09-11T00:08:28.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:28 smithi135 ceph-mon[35432]: pgmap v503: 97 pgs: 97 active+clean; 830 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.5 MiB/s wr, 620 op/s 2024-09-11T00:08:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:30 smithi019 ceph-mon[30859]: pgmap v504: 97 pgs: 97 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.5 MiB/s wr, 653 op/s 2024-09-11T00:08:30.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:30 smithi131 ceph-mon[35491]: pgmap v504: 97 pgs: 97 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.5 MiB/s wr, 653 op/s 2024-09-11T00:08:30.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:30 smithi135 ceph-mon[35432]: pgmap v504: 97 pgs: 97 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.5 MiB/s wr, 653 op/s 2024-09-11T00:08:32.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:32 smithi019 ceph-mon[30859]: pgmap v505: 97 pgs: 97 active+clean; 817 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.8 MiB/s wr, 685 op/s 2024-09-11T00:08:32.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:32 smithi131 ceph-mon[35491]: pgmap v505: 97 pgs: 97 active+clean; 817 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.8 MiB/s wr, 685 op/s 2024-09-11T00:08:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:32 smithi135 ceph-mon[35432]: pgmap v505: 97 pgs: 97 active+clean; 817 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.8 MiB/s wr, 685 op/s 2024-09-11T00:08:33.116 INFO:tasks.workunit.client.0.smithi019.stdout: 134 11563 2 7494 3 6345 5 2024-09-11T00:08:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:34 smithi019 ceph-mon[30859]: pgmap v506: 97 pgs: 97 active+clean; 820 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.9 MiB/s wr, 872 op/s 2024-09-11T00:08:34.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:34 smithi131 ceph-mon[35491]: pgmap v506: 97 pgs: 97 active+clean; 820 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.9 MiB/s wr, 872 op/s 2024-09-11T00:08:34.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:34 smithi135 ceph-mon[35432]: pgmap v506: 97 pgs: 97 active+clean; 820 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.9 MiB/s wr, 872 op/s 2024-09-11T00:08:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:36 smithi019 ceph-mon[30859]: pgmap v507: 97 pgs: 97 active+clean; 820 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 659 op/s 2024-09-11T00:08:36.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:36 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:08:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:36 smithi131 ceph-mon[35491]: pgmap v507: 97 pgs: 97 active+clean; 820 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 659 op/s 2024-09-11T00:08:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:36 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:08:36.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:36 smithi135 ceph-mon[35432]: pgmap v507: 97 pgs: 97 active+clean; 820 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 659 op/s 2024-09-11T00:08:36.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:36 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:08:38.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:38 smithi019 ceph-mon[30859]: pgmap v508: 97 pgs: 97 active+clean; 824 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 747 op/s 2024-09-11T00:08:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:38 smithi131 ceph-mon[35491]: pgmap v508: 97 pgs: 97 active+clean; 824 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 747 op/s 2024-09-11T00:08:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:38 smithi135 ceph-mon[35432]: pgmap v508: 97 pgs: 97 active+clean; 824 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 747 op/s 2024-09-11T00:08:40.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:40 smithi019 ceph-mon[30859]: pgmap v509: 97 pgs: 97 active+clean; 825 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 710 op/s 2024-09-11T00:08:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:40 smithi131 ceph-mon[35491]: pgmap v509: 97 pgs: 97 active+clean; 825 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 710 op/s 2024-09-11T00:08:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:40 smithi135 ceph-mon[35432]: pgmap v509: 97 pgs: 97 active+clean; 825 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 710 op/s 2024-09-11T00:08:42.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:42 smithi019 ceph-mon[30859]: pgmap v510: 97 pgs: 97 active+clean; 828 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 756 op/s 2024-09-11T00:08:42.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:42 smithi131 ceph-mon[35491]: pgmap v510: 97 pgs: 97 active+clean; 828 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 756 op/s 2024-09-11T00:08:42.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:42 smithi135 ceph-mon[35432]: pgmap v510: 97 pgs: 97 active+clean; 828 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 756 op/s 2024-09-11T00:08:43.116 INFO:tasks.workunit.client.0.smithi019.stdout: 134 869 2 358 1 216 4 2024-09-11T00:08:44.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:44 smithi019 ceph-mon[30859]: pgmap v511: 97 pgs: 97 active+clean; 828 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 867 op/s 2024-09-11T00:08:44.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:44 smithi131 ceph-mon[35491]: pgmap v511: 97 pgs: 97 active+clean; 828 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 867 op/s 2024-09-11T00:08:44.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:44 smithi135 ceph-mon[35432]: pgmap v511: 97 pgs: 97 active+clean; 828 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 867 op/s 2024-09-11T00:08:45.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:45 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:45.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:45 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:45.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:45 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:08:46.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:46 smithi019 ceph-mon[30859]: pgmap v512: 97 pgs: 97 active+clean; 831 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 741 op/s 2024-09-11T00:08:46.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:46 smithi131 ceph-mon[35491]: pgmap v512: 97 pgs: 97 active+clean; 831 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 741 op/s 2024-09-11T00:08:46.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:46 smithi135 ceph-mon[35432]: pgmap v512: 97 pgs: 97 active+clean; 831 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 741 op/s 2024-09-11T00:08:48.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:48 smithi019 ceph-mon[30859]: pgmap v513: 97 pgs: 97 active+clean; 834 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 858 op/s 2024-09-11T00:08:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:48 smithi131 ceph-mon[35491]: pgmap v513: 97 pgs: 97 active+clean; 834 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 858 op/s 2024-09-11T00:08:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:48 smithi135 ceph-mon[35432]: pgmap v513: 97 pgs: 97 active+clean; 834 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 858 op/s 2024-09-11T00:08:49.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:08:50.109 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:50.508 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:50 smithi019 ceph-mon[30859]: pgmap v514: 97 pgs: 97 active+clean; 835 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 789 op/s 2024-09-11T00:08:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:50 smithi131 ceph-mon[35491]: pgmap v514: 97 pgs: 97 active+clean; 835 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 789 op/s 2024-09-11T00:08:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:50 smithi135 ceph-mon[35432]: pgmap v514: 97 pgs: 97 active+clean; 835 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 789 op/s 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.753+0000 7f2946f9f640 1 -- 172.21.15.19:0/2429555121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 msgr2=0x7f29401031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.753+0000 7f2946f9f640 1 --2- 172.21.15.19:0/2429555121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401031a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2928009900 tx=0x7f292802a410 comp rx=0 tx=0).stop 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.753+0000 7f2946f9f640 1 -- 172.21.15.19:0/2429555121 shutdown_connections 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.753+0000 7f2946f9f640 1 --2- 172.21.15.19:0/2429555121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2940109150 0x7f294010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.753+0000 7f2946f9f640 1 --2- 172.21.15.19:0/2429555121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29401087d0 0x7f2940108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.753+0000 7f2946f9f640 1 --2- 172.21.15.19:0/2429555121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401031a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.753+0000 7f2946f9f640 1 -- 172.21.15.19:0/2429555121 >> 172.21.15.19:0/2429555121 conn(0x7f29400fe830 msgr2=0x7f2940100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 -- 172.21.15.19:0/2429555121 shutdown_connections 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 -- 172.21.15.19:0/2429555121 wait complete. 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 Processor -- start 2024-09-11T00:08:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 -- start start 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f29401997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940109150 0x7f294019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2940112e10 con 0x7f2940102dc0 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2940112c90 con 0x7f29401087d0 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2946f9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2940112f90 con 0x7f2940109150 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.754+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53216/0 (socket says 172.21.15.19:53216) 2024-09-11T00:08:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 -- 172.21.15.19:0/1464883196 learned_addr learned my addr 172.21.15.19:0/1464883196 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f294553c640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940109150 0x7f294019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f293ffff640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f29401997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 -- 172.21.15.19:0/1464883196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940109150 msgr2=0x7f294019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940109150 0x7f294019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 -- 172.21.15.19:0/1464883196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 msgr2=0x7f29401997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f29401997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 -- 172.21.15.19:0/1464883196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294019f350 con 0x7f2940102dc0 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f294553c640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940109150 0x7f294019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2944d3b640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401992a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2928005940 tx=0x7f2928004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f293dffb640 1 -- 172.21.15.19:0/1464883196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292803f030 con 0x7f2940102dc0 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f293dffb640 1 -- 172.21.15.19:0/1464883196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2928003aa0 con 0x7f2940102dc0 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f293dffb640 1 -- 172.21.15.19:0/1464883196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928035070 con 0x7f2940102dc0 2024-09-11T00:08:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.755+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294019f5e0 con 0x7f2940102dc0 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.756+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29401a5d00 con 0x7f2940102dc0 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.758+0000 7f2949374740 1 Processor -- start 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.758+0000 7f293dffb640 1 -- 172.21.15.19:0/1464883196 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f292803bca0 con 0x7f2940102dc0 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.758+0000 7f2949374740 1 -- start start 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2949374740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c0d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2949374740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2949374740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c1dd60 0x561fd1c20150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2949374740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561fd1b83e50 con 0x561fd1c1dd60 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2949374740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561fd1b73280 con 0x561fd1c0d9c0 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2949374740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561fd1b77090 con 0x561fd1c0d0a0 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f294553c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c0d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:33706/0 (socket says 172.21.15.19:33706) 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f2944d3b640 1 -- 172.21.15.19:0/3424312904 learned_addr learned my addr 172.21.15.19:0/3424312904 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f293ffff640 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c1dd60 0x561fd1c20150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f293dffb640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b5450 0x7f292c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f293ffff640 1 -- 172.21.15.19:0/3424312904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 msgr2=0x561fd1c0d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f293ffff640 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c0d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f293ffff640 1 -- 172.21.15.19:0/3424312904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c0d9c0 msgr2=0x561fd1c1d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f293ffff640 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f293ffff640 1 -- 172.21.15.19:0/3424312904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd18d1650 con 0x561fd1c1dd60 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.759+0000 7f294553c640 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c0d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.760+0000 7f293dffb640 1 -- 172.21.15.19:0/1464883196 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2928106820 con 0x7f2940102dc0 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.760+0000 7f294553c640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b5450 0x7f292c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.760+0000 7f293ffff640 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c1dd60 0x561fd1c20150 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2938009c00 tx=0x7f2938011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3eb902c2ce627e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:50.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.760+0000 7f2936ffd640 1 -- 172.21.15.19:0/3424312904 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938004230 con 0x561fd1c1dd60 2024-09-11T00:08:50.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.760+0000 7f2936ffd640 1 -- 172.21.15.19:0/3424312904 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29380043d0 con 0x561fd1c1dd60 2024-09-11T00:08:50.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.760+0000 7f2936ffd640 1 -- 172.21.15.19:0/3424312904 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938004c30 con 0x561fd1c1dd60 2024-09-11T00:08:50.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 -- 172.21.15.19:0/3424312904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c1dd60 msgr2=0x561fd1c20150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f294553c640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b5450 0x7f292c0b7910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2930005fd0 tx=0x7f2930004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:50.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c1dd60 0x561fd1c20150 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2938009c00 tx=0x7f2938011810 comp rx=0 tx=0).stop 2024-09-11T00:08:50.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 -- 172.21.15.19:0/3424312904 shutdown_connections 2024-09-11T00:08:50.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c1dd60 0x561fd1c20150 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 --2- 172.21.15.19:0/3424312904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c0d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 -- 172.21.15.19:0/3424312904 >> 172.21.15.19:0/3424312904 conn(0x561fd1c0aed0 msgr2=0x561fd1c0c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 -- 172.21.15.19:0/3424312904 shutdown_connections 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 -- 172.21.15.19:0/3424312904 wait complete. 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 -- start start 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.761+0000 7f2949374740 1 Processor -- start 2024-09-11T00:08:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2949374740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c1d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2949374740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2949374740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c1b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2949374740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561fd19d4700 con 0x561fd1c0d9c0 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2949374740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561fd1b0e110 con 0x561fd1c1dd60 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2949374740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561fd1c20a10 con 0x561fd1c0d0a0 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2949374740 10 client.0 _ll_register_callbacks cb 0x561fd1b27990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f293ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c1d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f293ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53228/0 (socket says 172.21.15.19:53228) 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f293ffff640 1 -- 172.21.15.19:0/3374234231 learned_addr learned my addr 172.21.15.19:0/3374234231 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f294553c640 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c1b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2944d3b640 1 -- 172.21.15.19:0/3374234231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 msgr2=0x561fd1c1b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2944d3b640 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c1b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2944d3b640 1 -- 172.21.15.19:0/3374234231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 msgr2=0x561fd1c1aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2944d3b640 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f2944d3b640 1 -- 172.21.15.19:0/3374234231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd1b3bc40 con 0x561fd1c0d0a0 2024-09-11T00:08:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.762+0000 7f294553c640 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c1b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.763+0000 7f2944d3b640 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c1d660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f29281045f0 tx=0x7f2928009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91448f76133d3aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.763+0000 7f291ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f291ffff640 1 -- 172.21.15.19:0/3374234231 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928049070 con 0x561fd1c0d0a0 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f291ffff640 1 -- 172.21.15.19:0/3374234231 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2928003c50 con 0x561fd1c0d0a0 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29380043d0 con 0x561fd1c0d0a0 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f291ffff640 1 -- 172.21.15.19:0/3374234231 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f29280c9420 con 0x561fd1c0d0a0 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 10 client.25807 fetch_fsmap learned FSMap version 33 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561fd1c2c360 con 0x561fd1c0d0a0 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f291ffff640 1 -- 172.21.15.19:0/3374234231 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29280cc8e0 con 0x561fd1c0d0a0 2024-09-11T00:08:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f291ffff640 1 -- 172.21.15.19:0/3374234231 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7f29280cd030 con 0x561fd1c0d0a0 2024-09-11T00:08:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 10 client.25807 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T00:08:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 10 client.25807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 20 client.25807 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c2d810 0x561fd1c2fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 4 client.25807 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.764+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f29380043d0 con 0x561fd1c2d810 2024-09-11T00:08:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.765+0000 7f293ffff640 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c2d810 0x561fd1c2fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.765+0000 7f293ffff640 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c2d810 0x561fd1c2fc50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78d1c168c29c6787 server_cookie=61480d57fda98f78 in_seq=0 out_seq=0 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.765+0000 7f291ffff640 10 client.25807 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f291ffff640 1 -- 172.21.15.19:0/3374234231 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f29380043d0 con 0x561fd1c2d810 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f291ffff640 10 client.25807 handle_command_reply: tid=0 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 client.25807 shutdown 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 msgr2=0x561fd1c1d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c1d660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f29281045f0 tx=0x7f2928009230 comp rx=0 tx=0).stop 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 shutdown_connections 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c1b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c2d810 0x561fd1c2fc50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c1aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 --2- 172.21.15.19:0/3374234231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c1d660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f291ffff640 0 client.25807 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 >> 172.21.15.19:0/3374234231 conn(0x561fd1c0aed0 msgr2=0x561fd1c10a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 shutdown_connections 2024-09-11T00:08:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.766+0000 7f2949374740 1 -- 172.21.15.19:0/3374234231 wait complete. 2024-09-11T00:08:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.767+0000 7f2949374740 20 client.25807 trim_cache size 0 max 16384 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 Processor -- start 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 -- start start 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c29c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c35520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c35a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29401aecb0 con 0x561fd1c0d9c0 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f29401ac550 con 0x561fd1c1dd60 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2949374740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29401aa3a0 con 0x561fd1c0d0a0 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f293ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c35520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c29c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c29c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:51874/0 (socket says 172.21.15.19:51874) 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 -- 172.21.15.19:0/2692609253 learned_addr learned my addr 172.21.15.19:0/2692609253 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f294553c640 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c35a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 -- 172.21.15.19:0/2692609253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 msgr2=0x561fd1c35a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c35a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 -- 172.21.15.19:0/2692609253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 msgr2=0x561fd1c35520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c35520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f2944d3b640 1 -- 172.21.15.19:0/2692609253 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd1c13200 con 0x561fd1c0d0a0 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.786+0000 7f294553c640 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c35a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.787+0000 7f2944d3b640 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c29c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f29280d5e40 tx=0x7f29280cd3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=666554cdf3b19ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.787+0000 7f29367fc640 1 -- 172.21.15.19:0/2692609253 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928049030 con 0x561fd1c0d0a0 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.787+0000 7f29367fc640 1 -- 172.21.15.19:0/2692609253 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f292810c240 con 0x561fd1c0d0a0 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.787+0000 7f29367fc640 1 -- 172.21.15.19:0/2692609253 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29280cc540 con 0x561fd1c0d0a0 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.787+0000 7f2949374740 1 -- 172.21.15.19:0/2692609253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 msgr2=0x561fd1c29c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.787+0000 7f2949374740 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c29c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f29280d5e40 tx=0x7f29280cd3f0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- 172.21.15.19:0/2692609253 shutdown_connections 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c35a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d9c0 0x561fd1c35520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 --2- 172.21.15.19:0/2692609253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d0a0 0x561fd1c29c40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- 172.21.15.19:0/2692609253 >> 172.21.15.19:0/2692609253 conn(0x561fd1c0aed0 msgr2=0x561fd1c1ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- 172.21.15.19:0/2692609253 shutdown_connections 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- 172.21.15.19:0/2692609253 wait complete. 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- start start 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 Processor -- start 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d0a0 0x561fd1c26440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d9c0 0x561fd1c23eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29401aaa10 con 0x561fd1c0d0a0 2024-09-11T00:08:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f29401abe80 con 0x561fd1c1dd60 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.788+0000 7f2949374740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29401ab0e0 con 0x561fd1c0d9c0 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f2949374740 10 client.0 _ll_register_callbacks cb 0x7f2928005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d0a0 0x561fd1c26440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f2944d3b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d0a0 0x561fd1c26440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53256/0 (socket says 172.21.15.19:53256) 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f2944d3b640 1 -- 172.21.15.19:0/1770198490 learned_addr learned my addr 172.21.15.19:0/1770198490 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f293ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d9c0 0x561fd1c23eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f294553c640 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f293ffff640 1 -- 172.21.15.19:0/1770198490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 msgr2=0x561fd1c243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f293ffff640 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c243f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f293ffff640 1 -- 172.21.15.19:0/1770198490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d0a0 msgr2=0x561fd1c26440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f293ffff640 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d0a0 0x561fd1c26440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f293ffff640 1 -- 172.21.15.19:0/1770198490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd1c24c20 con 0x561fd1c0d9c0 2024-09-11T00:08:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f2944d3b640 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d0a0 0x561fd1c26440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f293ffff640 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d9c0 0x561fd1c23eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x561fd1c304c0 tx=0x7f2938011e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdc263d8534c7c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f291ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.789+0000 7f291ffff640 1 -- 172.21.15.19:0/1770198490 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938031070 con 0x561fd1c0d9c0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f292810c240 con 0x561fd1c0d9c0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f291ffff640 1 -- 172.21.15.19:0/1770198490 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8397+0+0 (secure 0 0 0) 0x7f2938026850 con 0x561fd1c0d9c0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f291ffff640 1 -- 172.21.15.19:0/1770198490 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f293801e040 con 0x561fd1c0d9c0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 10 client.25813 fetch_fsmap learned FSMap version 33 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561fd1c9b7a0 con 0x561fd1c0d9c0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f291ffff640 1 -- 172.21.15.19:0/1770198490 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f292810c240 con 0x561fd1c0d9c0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f291ffff640 1 -- 172.21.15.19:0/1770198490 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7f2938034030 con 0x561fd1c0d9c0 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 10 client.25813 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 10 client.25813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:08:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 20 client.25813 populate_metadata read hostname 'smithi019' 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c9bd30 0x561fd1c9e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 4 client.25813 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561fd1b85da0 con 0x561fd1c9bd30 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.790+0000 7f2944d3b640 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c9bd30 0x561fd1c9e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2944d3b640 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c9bd30 0x561fd1c9e150 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab276352a13f96a server_cookie=243f421ad91d53a3 in_seq=0 out_seq=0 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f291ffff640 10 client.25813 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f291ffff640 1 -- 172.21.15.19:0/1770198490 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x561fd1b85da0 con 0x561fd1c9bd30 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f291ffff640 10 client.25813 handle_command_reply: tid=0 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 client.25813 shutdown 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d9c0 msgr2=0x561fd1c23eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d9c0 0x561fd1c23eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x561fd1c304c0 tx=0x7f2938011e30 comp rx=0 tx=0).stop 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 shutdown_connections 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fd1c1dd60 0x561fd1c243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fd1c0d9c0 0x561fd1c23eb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561fd1c9bd30 0x561fd1c9e150 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 --2- 172.21.15.19:0/1770198490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fd1c0d0a0 0x561fd1c26440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f291ffff640 0 client.25813 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:08:50.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.791+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 >> 172.21.15.19:0/1770198490 conn(0x561fd1c0aed0 msgr2=0x561fd1c1c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:50.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.792+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 shutdown_connections 2024-09-11T00:08:50.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.792+0000 7f2949374740 1 -- 172.21.15.19:0/1770198490 wait complete. 2024-09-11T00:08:50.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.792+0000 7f2949374740 20 client.25813 trim_cache size 0 max 16384 2024-09-11T00:08:50.800 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:08:50.800 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:08:50.800 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:08:50.800 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:08:50.800 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.800 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3", 2024-09-11T00:08:50.800 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:08:50.801 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.802 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.803 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.803 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.803 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:08:50.803 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:08:50.803 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.804 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.804 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.804 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.804 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.804 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:08:50.804 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:08:50.805 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.805 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.805 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.805 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.805 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.805 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:08:50.806 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:08:50.806 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.806 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.806 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.806 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.806 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:08:50.807 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:08:50.808 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:08:50.808 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:08:50.808 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:08:50.808 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:08:50.808 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:08:50.808 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:08:50.809 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:08:50.809 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:08:50.809 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:08:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b5450 msgr2=0x7f292c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b5450 0x7f292c0b7910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2930005fd0 tx=0x7f2930004a40 comp rx=0 tx=0).stop 2024-09-11T00:08:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 msgr2=0x7f29401992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401992a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2928005940 tx=0x7f2928004270 comp rx=0 tx=0).stop 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 shutdown_connections 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2940109150 0x7f294019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29401087d0 0x7f29401997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f292c0b5450 0x7f292c0b7910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 --2- 172.21.15.19:0/1464883196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2940102dc0 0x7f29401992a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 >> 172.21.15.19:0/1464883196 conn(0x7f29400fe830 msgr2=0x7f2940100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 shutdown_connections 2024-09-11T00:08:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:08:50.793+0000 7f2946f9f640 1 -- 172.21.15.19:0/1464883196 wait complete. 2024-09-11T00:08:51.639 INFO:tasks.cephfs.filesystem:scrub status for tag:3d18c9fb-65cc-4d33-8a8e-789ea88b35e3 - {'path': '/', 'tag': '3d18c9fb-65cc-4d33-8a8e-789ea88b35e3', 'options': 'recursive,force'} 2024-09-11T00:08:52.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:52 smithi019 ceph-mon[30859]: pgmap v515: 97 pgs: 97 active+clean; 821 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 736 op/s 2024-09-11T00:08:52.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:52 smithi131 ceph-mon[35491]: pgmap v515: 97 pgs: 97 active+clean; 821 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 736 op/s 2024-09-11T00:08:52.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:52 smithi135 ceph-mon[35432]: pgmap v515: 97 pgs: 97 active+clean; 821 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 736 op/s 2024-09-11T00:08:54.108 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-11T00:08:54.108 INFO:tasks.workunit.client.0.smithi019.stdout:Final score for writes: 134 2024-09-11T00:08:54.108 INFO:tasks.workunit.client.0.smithi019.stdout:Final score for reads : 347300 2024-09-11T00:08:54.108 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-11T00:08:54.109 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T00:08:54.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T00:08:54.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:54 smithi019 ceph-mon[30859]: pgmap v516: 97 pgs: 97 active+clean; 804 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 710 op/s 2024-09-11T00:08:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:54 smithi131 ceph-mon[35491]: pgmap v516: 97 pgs: 97 active+clean; 804 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 710 op/s 2024-09-11T00:08:54.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:54 smithi135 ceph-mon[35432]: pgmap v516: 97 pgs: 97 active+clean; 804 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 710 op/s 2024-09-11T00:08:56.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:56 smithi019 ceph-mon[30859]: pgmap v517: 97 pgs: 97 active+clean; 800 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 536 op/s 2024-09-11T00:08:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:56 smithi131 ceph-mon[35491]: pgmap v517: 97 pgs: 97 active+clean; 800 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 536 op/s 2024-09-11T00:08:56.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:56 smithi135 ceph-mon[35432]: pgmap v517: 97 pgs: 97 active+clean; 800 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 536 op/s 2024-09-11T00:08:58.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:08:58 smithi019 ceph-mon[30859]: pgmap v518: 97 pgs: 97 active+clean; 802 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 522 op/s 2024-09-11T00:08:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:08:58 smithi131 ceph-mon[35491]: pgmap v518: 97 pgs: 97 active+clean; 802 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 522 op/s 2024-09-11T00:08:58.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:08:58 smithi135 ceph-mon[35432]: pgmap v518: 97 pgs: 97 active+clean; 802 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 522 op/s 2024-09-11T00:09:00.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:00 smithi019 ceph-mon[30859]: pgmap v519: 97 pgs: 97 active+clean; 809 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 431 op/s 2024-09-11T00:09:00.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:00 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:09:00.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:00 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:09:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:00 smithi131 ceph-mon[35491]: pgmap v519: 97 pgs: 97 active+clean; 809 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 431 op/s 2024-09-11T00:09:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:00 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:09:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:00 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:09:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:00 smithi135 ceph-mon[35432]: pgmap v519: 97 pgs: 97 active+clean; 809 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 431 op/s 2024-09-11T00:09:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:00 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:09:00.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:00 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:09:01.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:01 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:09:01.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:01 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:09:01.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:01 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:09:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:02 smithi131 ceph-mon[35491]: pgmap v520: 97 pgs: 97 active+clean; 813 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 404 op/s 2024-09-11T00:09:02.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:02 smithi135 ceph-mon[35432]: pgmap v520: 97 pgs: 97 active+clean; 813 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 404 op/s 2024-09-11T00:09:02.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:02 smithi019 ceph-mon[30859]: pgmap v520: 97 pgs: 97 active+clean; 813 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 404 op/s 2024-09-11T00:09:04.552 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: pgmap v521: 97 pgs: 97 active+clean; 814 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 502 op/s 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:04.553 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:09:04.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: pgmap v521: 97 pgs: 97 active+clean; 814 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 502 op/s 2024-09-11T00:09:04.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:04.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:04.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:04.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:09:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: pgmap v521: 97 pgs: 97 active+clean; 814 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 502 op/s 2024-09-11T00:09:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:09:05.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:05 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-11T00:09:05.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:05 smithi131 ceph-mon[35491]: Unable to set osd_memory_target on smithi019 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-11T00:09:05.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:05 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-11T00:09:05.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:05 smithi135 ceph-mon[35432]: Unable to set osd_memory_target on smithi019 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-11T00:09:05.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:05 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-11T00:09:05.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:05 smithi019 ceph-mon[30859]: Unable to set osd_memory_target on smithi019 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-11T00:09:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:06 smithi131 ceph-mon[35491]: pgmap v522: 97 pgs: 97 active+clean; 821 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 453 op/s 2024-09-11T00:09:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:06 smithi131 ceph-mon[35491]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T00:09:06.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:06 smithi135 ceph-mon[35432]: pgmap v522: 97 pgs: 97 active+clean; 821 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 453 op/s 2024-09-11T00:09:06.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:06 smithi135 ceph-mon[35432]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T00:09:06.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:06 smithi019 ceph-mon[30859]: pgmap v522: 97 pgs: 97 active+clean; 821 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 453 op/s 2024-09-11T00:09:06.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:06 smithi019 ceph-mon[30859]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T00:09:08.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:08 smithi131 ceph-mon[35491]: pgmap v524: 97 pgs: 97 active+clean; 828 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 624 op/s 2024-09-11T00:09:08.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:08 smithi135 ceph-mon[35432]: pgmap v524: 97 pgs: 97 active+clean; 828 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 624 op/s 2024-09-11T00:09:08.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:08 smithi019 ceph-mon[30859]: pgmap v524: 97 pgs: 97 active+clean; 828 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 624 op/s 2024-09-11T00:09:10.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:10 smithi131 ceph-mon[35491]: pgmap v525: 97 pgs: 97 active+clean; 817 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 718 op/s 2024-09-11T00:09:10.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:10 smithi135 ceph-mon[35432]: pgmap v525: 97 pgs: 97 active+clean; 817 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 718 op/s 2024-09-11T00:09:10.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:10 smithi019 ceph-mon[30859]: pgmap v525: 97 pgs: 97 active+clean; 817 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 718 op/s 2024-09-11T00:09:11.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:11 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:09:11.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:11 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:09:11.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:11 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:09:12.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:12 smithi135 ceph-mon[35432]: pgmap v526: 97 pgs: 97 active+clean; 815 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 722 op/s 2024-09-11T00:09:12.701 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:12 smithi131 ceph-mon[35491]: pgmap v526: 97 pgs: 97 active+clean; 815 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 722 op/s 2024-09-11T00:09:12.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:12 smithi019 ceph-mon[30859]: pgmap v526: 97 pgs: 97 active+clean; 815 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 722 op/s 2024-09-11T00:09:14.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:14 smithi135 ceph-mon[35432]: pgmap v527: 97 pgs: 97 active+clean; 815 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 706 op/s 2024-09-11T00:09:14.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:14 smithi135 ceph-mon[35432]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T00:09:14.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:14 smithi019 ceph-mon[30859]: pgmap v527: 97 pgs: 97 active+clean; 815 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 706 op/s 2024-09-11T00:09:14.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:14 smithi019 ceph-mon[30859]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T00:09:14.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:14 smithi131 ceph-mon[35491]: pgmap v527: 97 pgs: 97 active+clean; 815 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 706 op/s 2024-09-11T00:09:14.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:14 smithi131 ceph-mon[35491]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T00:09:16.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:16 smithi135 ceph-mon[35432]: pgmap v529: 97 pgs: 97 active+clean; 821 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 686 op/s 2024-09-11T00:09:16.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:16 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:09:16.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:16 smithi019 ceph-mon[30859]: pgmap v529: 97 pgs: 97 active+clean; 821 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 686 op/s 2024-09-11T00:09:16.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:16 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:09:16.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:16 smithi131 ceph-mon[35491]: pgmap v529: 97 pgs: 97 active+clean; 821 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 686 op/s 2024-09-11T00:09:16.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:16 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:09:18.575 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:18 smithi019 ceph-mon[30859]: pgmap v530: 97 pgs: 97 active+clean; 825 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 620 op/s 2024-09-11T00:09:18.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:18 smithi135 ceph-mon[35432]: pgmap v530: 97 pgs: 97 active+clean; 825 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 620 op/s 2024-09-11T00:09:18.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:18 smithi131 ceph-mon[35491]: pgmap v530: 97 pgs: 97 active+clean; 825 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 620 op/s 2024-09-11T00:09:20.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:20 smithi135 ceph-mon[35432]: pgmap v531: 97 pgs: 97 active+clean; 840 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 542 op/s 2024-09-11T00:09:20.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:20 smithi019 ceph-mon[30859]: pgmap v531: 97 pgs: 97 active+clean; 840 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 542 op/s 2024-09-11T00:09:20.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:20 smithi131 ceph-mon[35491]: pgmap v531: 97 pgs: 97 active+clean; 840 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 542 op/s 2024-09-11T00:09:21.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:09:21.903 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:22.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 -- 172.21.15.19:0/1757833026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 msgr2=0x7fd19c111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 --2- 172.21.15.19:0/1757833026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c111850 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd194009ca0 tx=0x7fd19402a950 comp rx=0 tx=0).stop 2024-09-11T00:09:22.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 -- 172.21.15.19:0/1757833026 shutdown_connections 2024-09-11T00:09:22.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 --2- 172.21.15.19:0/1757833026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c111850 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 --2- 172.21.15.19:0/1757833026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd19c1021d0 0x7fd19c10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 --2- 172.21.15.19:0/1757833026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd19c1018b0 0x7fd19c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 -- 172.21.15.19:0/1757833026 >> 172.21.15.19:0/1757833026 conn(0x7fd19c0fd700 msgr2=0x7fd19c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 -- 172.21.15.19:0/1757833026 shutdown_connections 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.464+0000 7fd1a080b640 1 -- 172.21.15.19:0/1757833026 wait complete. 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 Processor -- start 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 -- start start 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd19c1018b0 0x7fd19c19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd19c1021d0 0x7fd19c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c1a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c114f30 con 0x7fd19c10f460 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c114db0 con 0x7fd19c1018b0 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.465+0000 7fd1a080b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1150b0 con 0x7fd19c1021d0 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c1a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c1a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52820/0 (socket says 172.21.15.19:52820) 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 -- 172.21.15.19:0/997698529 learned_addr learned my addr 172.21.15.19:0/997698529 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd199d9b640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd19c1021d0 0x7fd19c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19a59c640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd19c1018b0 0x7fd19c19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 -- 172.21.15.19:0/997698529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd19c1021d0 msgr2=0x7fd19c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd19c1021d0 0x7fd19c19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 -- 172.21.15.19:0/997698529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd19c1018b0 msgr2=0x7fd19c19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd19c1018b0 0x7fd19c19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 -- 172.21.15.19:0/997698529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c1a1490 con 0x7fd19c10f460 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd19ad9d640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c1a0cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd19402ae70 tx=0x7fd19402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd18b7fe640 1 -- 172.21.15.19:0/997698529 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194034040 con 0x7fd19c10f460 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19c1a1720 con 0x7fd19c10f460 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd18b7fe640 1 -- 172.21.15.19:0/997698529 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1940308f0 con 0x7fd19c10f460 2024-09-11T00:09:22.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd18b7fe640 1 -- 172.21.15.19:0/997698529 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940047f0 con 0x7fd19c10f460 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.466+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19c1a7e40 con 0x7fd19c10f460 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.469+0000 7fd18b7fe640 1 -- 172.21.15.19:0/997698529 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fd19404d030 con 0x7fd19c10f460 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.469+0000 7fd1a2be0740 1 Processor -- start 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.469+0000 7fd1a2be0740 1 -- start start 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c960a0 0x55a409c96480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c969c0 0x55a409ca2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409ca2950 0x55a409ca4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a409c0ce50 con 0x55a409c969c0 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a409bfc280 con 0x55a409c960a0 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a409c00090 con 0x55a409ca2950 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c969c0 0x55a409ca2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c969c0 0x55a409ca2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52826/0 (socket says 172.21.15.19:52826) 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 -- 172.21.15.19:0/4151082791 learned_addr learned my addr 172.21.15.19:0/4151082791 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd199d9b640 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c960a0 0x55a409c96480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd199d9b640 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409ca2950 0x55a409ca4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd18b7fe640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd1840b5450 0x7fd1840b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 -- 172.21.15.19:0/4151082791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409ca2950 msgr2=0x55a409ca4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409ca2950 0x55a409ca4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 -- 172.21.15.19:0/4151082791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c960a0 msgr2=0x55a409c96480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c960a0 0x55a409c96480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 -- 172.21.15.19:0/4151082791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40995a650 con 0x55a409c969c0 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd199d9b640 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409ca2950 0x55a409ca4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19ad9d640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd1840b5450 0x7fd1840b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd19a59c640 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c969c0 0x55a409ca2410 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00bd50 tx=0x7fd18c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43811fbf969377b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.470+0000 7fd18b7fe640 1 -- 172.21.15.19:0/997698529 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7fd194106dc0 con 0x7fd19c10f460 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd188ff9640 1 -- 172.21.15.19:0/4151082791 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c005220 con 0x55a409c969c0 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd188ff9640 1 -- 172.21.15.19:0/4151082791 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd18c00be40 con 0x55a409c969c0 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd188ff9640 1 -- 172.21.15.19:0/4151082791 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0117c0 con 0x55a409c969c0 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd1a2be0740 1 -- 172.21.15.19:0/4151082791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c969c0 msgr2=0x55a409ca2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd19ad9d640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd1840b5450 0x7fd1840b7910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd1940ccf90 tx=0x7fd1940c99d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c969c0 0x55a409ca2410 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00bd50 tx=0x7fd18c0107a0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd1a2be0740 1 -- 172.21.15.19:0/4151082791 shutdown_connections 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409ca2950 0x55a409ca4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c969c0 0x55a409ca2410 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/4151082791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c960a0 0x55a409c96480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.471+0000 7fd1a2be0740 1 -- 172.21.15.19:0/4151082791 >> 172.21.15.19:0/4151082791 conn(0x55a409c93ed0 msgr2=0x55a409c95070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 -- 172.21.15.19:0/4151082791 shutdown_connections 2024-09-11T00:09:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 -- 172.21.15.19:0/4151082791 wait complete. 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 -- start start 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 Processor -- start 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409ca2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c9f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409c9fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a409a5d700 con 0x55a409ca2950 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a409b97110 con 0x55a409c969c0 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a409ca55d0 con 0x55a409c960a0 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd1a2be0740 10 client.0 _ll_register_callbacks cb 0x55a409bb0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd199d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409c9fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.472+0000 7fd199d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409c9fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52842/0 (socket says 172.21.15.19:52842) 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 -- 172.21.15.19:0/3044558320 learned_addr learned my addr 172.21.15.19:0/3044558320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd19a59c640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c9f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409ca2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 -- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 msgr2=0x55a409ca2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409ca2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 -- 172.21.15.19:0/3044558320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 msgr2=0x55a409c9f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c9f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 -- 172.21.15.19:0/3044558320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a409bc4c40 con 0x55a409ca2950 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd19a59c640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c9f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd199d9b640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409c9fd50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd190012c20 tx=0x7fd190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193a55baa4bbd496 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd181ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd181ffb640 1 -- 172.21.15.19:0/3044558320 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19001b040 con 0x55a409ca2950 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd181ffb640 1 -- 172.21.15.19:0/3044558320 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7fd190004030 con 0x55a409ca2950 2024-09-11T00:09:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.473+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a409c0eda0 con 0x55a409ca2950 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd181ffb640 1 -- 172.21.15.19:0/3044558320 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd190026030 con 0x55a409ca2950 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 10 client.16254 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a409cb1000 con 0x55a409ca2950 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd181ffb640 1 -- 172.21.15.19:0/3044558320 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a409c0eda0 con 0x55a409ca2950 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd181ffb640 1 -- 172.21.15.19:0/3044558320 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd1900047a0 con 0x55a409ca2950 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 10 client.16254 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 20 client.16254 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409cb2480 0x55a409cb48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 4 client.16254 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a409c0a850 con 0x55a409cb2480 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.474+0000 7fd19a59c640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409cb2480 0x55a409cb48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.475+0000 7fd181ffb640 10 client.16254 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.475+0000 7fd19a59c640 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409cb2480 0x55a409cb48c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbe41e684b83b5c0 server_cookie=e8f469bce8c608b9 in_seq=0 out_seq=0 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.475+0000 7fd181ffb640 1 -- 172.21.15.19:0/3044558320 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a409c0a850 con 0x55a409cb2480 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.475+0000 7fd181ffb640 10 client.16254 handle_command_reply: tid=0 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.475+0000 7fd1a2be0740 1 client.16254 shutdown 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.475+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 msgr2=0x55a409c9fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.475+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409c9fd50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd190012c20 tx=0x7fd190004730 comp rx=0 tx=0).stop 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 shutdown_connections 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409cb2480 0x55a409cb48c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409c9fd50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c9f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3044558320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409ca2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd181ffb640 0 client.16254 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:22.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 >> 172.21.15.19:0/3044558320 conn(0x55a409c93ed0 msgr2=0x55a409c99a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 shutdown_connections 2024-09-11T00:09:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3044558320 wait complete. 2024-09-11T00:09:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.476+0000 7fd1a2be0740 20 client.16254 trim_cache size 0 max 16384 2024-09-11T00:09:22.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 Processor -- start 2024-09-11T00:09:22.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 -- start start 2024-09-11T00:09:22.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409cae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c93710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409ca3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1b2ff0 con 0x55a409ca2950 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1b0830 con 0x55a409c969c0 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1ae6a0 con 0x55a409c960a0 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409ca3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409ca3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52850/0 (socket says 172.21.15.19:52850) 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 -- 172.21.15.19:0/29013644 learned_addr learned my addr 172.21.15.19:0/29013644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409cae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd19a59c640 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c93710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 -- 172.21.15.19:0/29013644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 msgr2=0x55a409cae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409cae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 -- 172.21.15.19:0/29013644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 msgr2=0x55a409c93710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.494+0000 7fd199d9b640 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c93710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.495+0000 7fd199d9b640 1 -- 172.21.15.19:0/29013644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a409c94bb0 con 0x55a409ca2950 2024-09-11T00:09:22.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.495+0000 7fd199d9b640 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409ca3d40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd190004650 tx=0x7fd1900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1f7c385bac9c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.495+0000 7fd183fff640 1 -- 172.21.15.19:0/29013644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1900120e0 con 0x55a409ca2950 2024-09-11T00:09:22.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.495+0000 7fd183fff640 1 -- 172.21.15.19:0/29013644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1900047a0 con 0x55a409ca2950 2024-09-11T00:09:22.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.495+0000 7fd183fff640 1 -- 172.21.15.19:0/29013644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19002b690 con 0x55a409ca2950 2024-09-11T00:09:22.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- 172.21.15.19:0/29013644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 msgr2=0x55a409ca3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409ca3d40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd190004650 tx=0x7fd1900046c0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- 172.21.15.19:0/29013644 shutdown_connections 2024-09-11T00:09:22.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409ca2950 0x55a409ca3d40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409c969c0 0x55a409c93710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/29013644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c960a0 0x55a409cae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- 172.21.15.19:0/29013644 >> 172.21.15.19:0/29013644 conn(0x55a409c93ed0 msgr2=0x55a409c94f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- 172.21.15.19:0/29013644 shutdown_connections 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- 172.21.15.19:0/29013644 wait complete. 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- start start 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 Processor -- start 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c960a0 0x55a409caaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c969c0 0x55a409cb9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409ca2950 0x55a409cba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1aecf0 con 0x55a409c960a0 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1b0160 con 0x55a409ca2950 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.496+0000 7fd1a2be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1af3c0 con 0x55a409c969c0 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd1a2be0740 10 client.0 _ll_register_callbacks cb 0x7fd19000bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c960a0 0x55a409caaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd19a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c969c0 0x55a409cb9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c960a0 0x55a409caaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52856/0 (socket says 172.21.15.19:52856) 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 -- 172.21.15.19:0/3067407501 learned_addr learned my addr 172.21.15.19:0/3067407501 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 -- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c969c0 msgr2=0x55a409cb9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c969c0 0x55a409cb9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 -- 172.21.15.19:0/3067407501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409ca2950 msgr2=0x55a409cba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409ca2950 0x55a409cba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 -- 172.21.15.19:0/3067407501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a409cba910 con 0x55a409c960a0 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd19a59c640 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c969c0 0x55a409cb9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd199d9b640 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c960a0 0x55a409caaf50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd19000bb30 tx=0x7fd190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199afe0636cb1d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd181ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd181ffb640 1 -- 172.21.15.19:0/3067407501 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19003c070 con 0x55a409c960a0 2024-09-11T00:09:22.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd181ffb640 1 -- 172.21.15.19:0/3067407501 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7fd190004e90 con 0x55a409c960a0 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.497+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1900047a0 con 0x55a409c960a0 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd181ffb640 1 -- 172.21.15.19:0/3067407501 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd190005c10 con 0x55a409c960a0 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 10 client.16260 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a409d1f3e0 con 0x55a409c960a0 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd181ffb640 1 -- 172.21.15.19:0/3067407501 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1900047a0 con 0x55a409c960a0 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd181ffb640 1 -- 172.21.15.19:0/3067407501 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd19002b8e0 con 0x55a409c960a0 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 10 client.16260 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 20 client.16260 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409d1f950 0x55a409d21d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 4 client.16260 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a409c07c80 con 0x55a409d1f950 2024-09-11T00:09:22.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.498+0000 7fd19a59c640 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409d1f950 0x55a409d21d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd181ffb640 10 client.16260 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd19a59c640 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409d1f950 0x55a409d21d70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e9999dc92230256 server_cookie=a84b6b2f3da8c267 in_seq=0 out_seq=0 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd181ffb640 1 -- 172.21.15.19:0/3067407501 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55a409c07c80 con 0x55a409d1f950 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd181ffb640 10 client.16260 handle_command_reply: tid=0 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 client.16260 shutdown 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c960a0 msgr2=0x55a409caaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c960a0 0x55a409caaf50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd19000bb30 tx=0x7fd190004730 comp rx=0 tx=0).stop 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 shutdown_connections 2024-09-11T00:09:22.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a409ca2950 0x55a409cba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a409c969c0 0x55a409cb9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55a409d1f950 0x55a409d21d70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 --2- 172.21.15.19:0/3067407501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a409c960a0 0x55a409caaf50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 >> 172.21.15.19:0/3067407501 conn(0x55a409c93ed0 msgr2=0x55a409ca0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd181ffb640 0 client.16260 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 shutdown_connections 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.499+0000 7fd1a2be0740 1 -- 172.21.15.19:0/3067407501 wait complete. 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a2be0740 20 client.16260 trim_cache size 0 max 16384 2024-09-11T00:09:22.506 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:09:22.507 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.509 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:09:22.510 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:22.511 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:09:22.512 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:09:22.512 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:09:22.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd1840b5450 msgr2=0x7fd1840b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd1840b5450 0x7fd1840b7910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd1940ccf90 tx=0x7fd1940c99d0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 msgr2=0x7fd19c1a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c1a0cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd19402ae70 tx=0x7fd19402f5d0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 shutdown_connections 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd1840b5450 0x7fd1840b7910 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19c10f460 0x7fd19c1a0cc0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd19c1021d0 0x7fd19c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 --2- 172.21.15.19:0/997698529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd19c1018b0 0x7fd19c19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 >> 172.21.15.19:0/997698529 conn(0x7fd19c0fd700 msgr2=0x7fd19c1116d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.500+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 shutdown_connections 2024-09-11T00:09:22.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:22.501+0000 7fd1a080b640 1 -- 172.21.15.19:0/997698529 wait complete. 2024-09-11T00:09:22.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:22 smithi019 ceph-mon[30859]: pgmap v532: 97 pgs: 97 active+clean; 836 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-09-11T00:09:22.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:22 smithi135 ceph-mon[35432]: pgmap v532: 97 pgs: 97 active+clean; 836 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-09-11T00:09:22.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:22 smithi131 ceph-mon[35491]: pgmap v532: 97 pgs: 97 active+clean; 836 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-09-11T00:09:23.566 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:09:23.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:09:23.831 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:24.666 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:24 smithi019 ceph-mon[30859]: pgmap v533: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 428 op/s 2024-09-11T00:09:24.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:24 smithi135 ceph-mon[35432]: pgmap v533: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 428 op/s 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 -- 172.21.15.19:0/2370424339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72781076a0 msgr2=0x7f7278107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2370424339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72781076a0 0x7f7278107ae0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7260009900 tx=0x7f726002a410 comp rx=0 tx=0).stop 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 -- 172.21.15.19:0/2370424339 shutdown_connections 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2370424339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7278108020 0x7f727810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2370424339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72781076a0 0x7f7278107ae0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2370424339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7278101c90 0x7f7278102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 -- 172.21.15.19:0/2370424339 >> 172.21.15.19:0/2370424339 conn(0x7f72780fd700 msgr2=0x7f72780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 -- 172.21.15.19:0/2370424339 shutdown_connections 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.750+0000 7f727e2bc640 1 -- 172.21.15.19:0/2370424339 wait complete. 2024-09-11T00:09:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 Processor -- start 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 -- start start 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7278101c90 0x7f7278199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72781076a0 0x7f7278199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7278108020 0x7f727819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7278111ce0 con 0x7f7278108020 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7278111b60 con 0x7f7278101c90 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727e2bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7278111e60 con 0x7f72781076a0 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727c859640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7278108020 0x7f727819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727c859640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7278108020 0x7f727819ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52878/0 (socket says 172.21.15.19:52878) 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f727c859640 1 -- 172.21.15.19:0/2308467269 learned_addr learned my addr 172.21.15.19:0/2308467269 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.751+0000 7f726ffff640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72781076a0 0x7f7278199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:24.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f7277fff640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7278101c90 0x7f7278199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727c859640 1 -- 172.21.15.19:0/2308467269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72781076a0 msgr2=0x7f7278199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727c859640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72781076a0 0x7f7278199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727c859640 1 -- 172.21.15.19:0/2308467269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7278101c90 msgr2=0x7f7278199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727c859640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7278101c90 0x7f7278199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727c859640 1 -- 172.21.15.19:0/2308467269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727819f3c0 con 0x7f7278108020 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727c859640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7278108020 0x7f727819ebf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f727000eaa0 tx=0x7f727000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f7275ffb640 1 -- 172.21.15.19:0/2308467269 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727000cdb0 con 0x7f7278108020 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f7275ffb640 1 -- 172.21.15.19:0/2308467269 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7270005020 con 0x7f7278108020 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727819f6b0 con 0x7f7278108020 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f7275ffb640 1 -- 172.21.15.19:0/2308467269 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700116d0 con 0x7f7278108020 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.752+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72781a5d70 con 0x7f7278108020 2024-09-11T00:09:24.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.753+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7278102070 con 0x7f7278108020 2024-09-11T00:09:24.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.755+0000 7f7275ffb640 1 -- 172.21.15.19:0/2308467269 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f727000f040 con 0x7f7278108020 2024-09-11T00:09:24.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.756+0000 7f7275ffb640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72640b5450 0x7f72640b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:24.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.756+0000 7f7277fff640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72640b5450 0x7f72640b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:24.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.756+0000 7f7275ffb640 1 -- 172.21.15.19:0/2308467269 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f72700e6110 con 0x7f7278108020 2024-09-11T00:09:24.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.756+0000 7f7277fff640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72640b5450 0x7f72640b7910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7268009bd0 tx=0x7f7268005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:24.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:24.759+0000 7f7275ffb640 1 -- 172.21.15.19:0/2308467269 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7270016030 con 0x7f7278108020 2024-09-11T00:09:24.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:24 smithi131 ceph-mon[35491]: pgmap v533: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 428 op/s 2024-09-11T00:09:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.058+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f727819a440 con 0x7f7278108020 2024-09-11T00:09:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.060+0000 7f7275ffb640 1 -- 172.21.15.19:0/2308467269 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11920 (secure 0 0 0) 0x7f72700ac690 con 0x7f7278108020 2024-09-11T00:09:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:09:25.062 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":35,"btime":"2024-09-11T00:09:15:303339+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:09:15.054686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:09:25.062 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 35 2024-09-11T00:09:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.063+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72640b5450 msgr2=0x7f72640b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.063+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72640b5450 0x7f72640b7910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7268009bd0 tx=0x7f7268005f90 comp rx=0 tx=0).stop 2024-09-11T00:09:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.063+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7278108020 msgr2=0x7f727819ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.063+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7278108020 0x7f727819ebf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f727000eaa0 tx=0x7f727000ef60 comp rx=0 tx=0).stop 2024-09-11T00:09:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.064+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 shutdown_connections 2024-09-11T00:09:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.064+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f72640b5450 0x7f72640b7910 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.064+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7278108020 0x7f727819ebf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.064+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72781076a0 0x7f7278199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.064+0000 7f727e2bc640 1 --2- 172.21.15.19:0/2308467269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7278101c90 0x7f7278199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.064+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 >> 172.21.15.19:0/2308467269 conn(0x7f72780fd700 msgr2=0x7f727806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.064+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 shutdown_connections 2024-09-11T00:09:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:25.065+0000 7f727e2bc640 1 -- 172.21.15.19:0/2308467269 wait complete. 2024-09-11T00:09:25.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:25 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2308467269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:09:25.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:25 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2308467269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:09:25.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:25 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2308467269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:09:25.909 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:09:26.208 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:26.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:26 smithi135 ceph-mon[35432]: pgmap v534: 97 pgs: 97 active+clean; 824 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 407 op/s 2024-09-11T00:09:26.682 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:26 smithi019 ceph-mon[30859]: pgmap v534: 97 pgs: 97 active+clean; 824 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 407 op/s 2024-09-11T00:09:26.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 -- 172.21.15.19:0/3146742609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018108860 msgr2=0x7f7018108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 --2- 172.21.15.19:0/3146742609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018108860 0x7f7018108cc0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7008009900 tx=0x7f700802a410 comp rx=0 tx=0).stop 2024-09-11T00:09:26.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 -- 172.21.15.19:0/3146742609 shutdown_connections 2024-09-11T00:09:26.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 --2- 172.21.15.19:0/3146742609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7018109200 0x7f701810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 --2- 172.21.15.19:0/3146742609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018108860 0x7f7018108cc0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 --2- 172.21.15.19:0/3146742609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7018100df0 0x7f70181011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 -- 172.21.15.19:0/3146742609 >> 172.21.15.19:0/3146742609 conn(0x7f70180fca20 msgr2=0x7f70180fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 -- 172.21.15.19:0/3146742609 shutdown_connections 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.766+0000 7f701fb12640 1 -- 172.21.15.19:0/3146742609 wait complete. 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.767+0000 7f701fb12640 1 Processor -- start 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.767+0000 7f701fb12640 1 -- start start 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701fb12640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7018100df0 0x7f7018199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701fb12640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7018108860 0x7f70181997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701fb12640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018109200 0x7f701819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701fb12640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7018112d80 con 0x7f7018109200 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701fb12640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7018112c00 con 0x7f7018100df0 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701fb12640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7018112f00 con 0x7f7018108860 2024-09-11T00:09:26.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018109200 0x7f701819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018109200 0x7f701819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52894/0 (socket says 172.21.15.19:52894) 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7018108860 0x7f70181997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 -- 172.21.15.19:0/917134058 learned_addr learned my addr 172.21.15.19:0/917134058 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701d8ae640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7018100df0 0x7f7018199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 -- 172.21.15.19:0/917134058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7018108860 msgr2=0x7f70181997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7018108860 0x7f70181997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 -- 172.21.15.19:0/917134058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7018100df0 msgr2=0x7f7018199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7018100df0 0x7f7018199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 -- 172.21.15.19:0/917134058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701819f340 con 0x7f7018109200 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701d8ae640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7018100df0 0x7f7018199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701e0af640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018109200 0x7f701819eb70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f701000eaa0 tx=0x7f701000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f700effd640 1 -- 172.21.15.19:0/917134058 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701000cdb0 con 0x7f7018109200 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f700effd640 1 -- 172.21.15.19:0/917134058 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7010005020 con 0x7f7018109200 2024-09-11T00:09:26.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.768+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701819f630 con 0x7f7018109200 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.769+0000 7f700effd640 1 -- 172.21.15.19:0/917134058 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100116d0 con 0x7f7018109200 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.769+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70181a5cf0 con 0x7f7018109200 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.771+0000 7f700effd640 1 -- 172.21.15.19:0/917134058 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f701000f040 con 0x7f7018109200 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.771+0000 7f7021ee7740 1 Processor -- start 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.771+0000 7f7021ee7740 1 -- start start 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f7021ee7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fc1dc1bea0 con 0x55fc1dcb6190 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f7021ee7740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55fc1dc0b2d0 con 0x55fc1dca5df0 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f7021ee7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc1dc0f0e0 con 0x55fc1dca54d0 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35840/0 (socket says 172.21.15.19:35840) 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d0ad640 1 -- 172.21.15.19:0/2667839653 learned_addr learned my addr 172.21.15.19:0/2667839653 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d8ae640 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d0ad640 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f700effd640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70040b54d0 0x7f70040b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d8ae640 1 -- 172.21.15.19:0/2667839653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 msgr2=0x55fc1dca58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d8ae640 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d8ae640 1 -- 172.21.15.19:0/2667839653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 msgr2=0x55fc1dcb8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d8ae640 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d8ae640 1 -- 172.21.15.19:0/2667839653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc1d969650 con 0x55fc1dca5df0 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701e0af640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70040b54d0 0x7f70040b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f700effd640 1 -- 172.21.15.19:0/917134058 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f70100e5d80 con 0x7f7018109200 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.772+0000 7f701d8ae640 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb5c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f701400bc80 tx=0x7f701400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a92016dd4efc6d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7003fff640 1 -- 172.21.15.19:0/2667839653 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014015070 con 0x55fc1dca5df0 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7003fff640 1 -- 172.21.15.19:0/2667839653 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f701401a910 con 0x55fc1dca5df0 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7003fff640 1 -- 172.21.15.19:0/2667839653 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014011860 con 0x55fc1dca5df0 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7021ee7740 1 -- 172.21.15.19:0/2667839653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 msgr2=0x55fc1dcb5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f701e0af640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70040b54d0 0x7f70040b7990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f70100a94c0 tx=0x7f70100762d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb5c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f701400bc80 tx=0x7f701400f730 comp rx=0 tx=0).stop 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7021ee7740 1 -- 172.21.15.19:0/2667839653 shutdown_connections 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb5c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2667839653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.773+0000 7f7021ee7740 1 -- 172.21.15.19:0/2667839653 >> 172.21.15.19:0/2667839653 conn(0x55fc1dca3300 msgr2=0x55fc1dca44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.774+0000 7f7021ee7740 1 -- 172.21.15.19:0/2667839653 shutdown_connections 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.774+0000 7f7021ee7740 1 -- 172.21.15.19:0/2667839653 wait complete. 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.774+0000 7f7021ee7740 1 -- start start 2024-09-11T00:09:26.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.774+0000 7f7021ee7740 1 Processor -- start 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca54d0 0x55fc1dcb59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fc1da6c700 con 0x55fc1dca54d0 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55fc1dba6160 con 0x55fc1dcb6190 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc1dcb8e40 con 0x55fc1dca5df0 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 10 client.0 _ll_register_callbacks cb 0x55fc1dbbf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca54d0 0x55fc1dcb59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca54d0 0x55fc1dcb59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52912/0 (socket says 172.21.15.19:52912) 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 -- 172.21.15.19:0/4276232939 learned_addr learned my addr 172.21.15.19:0/4276232939 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d8ae640 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 -- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca5df0 msgr2=0x55fc1dcb2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 -- 172.21.15.19:0/4276232939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 msgr2=0x55fc1dcb3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 -- 172.21.15.19:0/4276232939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc1dbd3c90 con 0x55fc1dca54d0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f701d0ad640 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca54d0 0x55fc1dcb59d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f700802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71c69995843906c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f70017fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f70017fa640 1 -- 172.21.15.19:0/4276232939 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008035050 con 0x55fc1dca54d0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f70017fa640 1 -- 172.21.15.19:0/4276232939 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f70080035f0 con 0x55fc1dca54d0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.775+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701401a910 con 0x55fc1dca54d0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f70017fa640 1 -- 172.21.15.19:0/4276232939 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f700804f020 con 0x55fc1dca54d0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 10 client.16278 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fc1dcc4730 con 0x55fc1dca54d0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f70017fa640 1 -- 172.21.15.19:0/4276232939 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f701401a910 con 0x55fc1dca54d0 2024-09-11T00:09:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f70017fa640 1 -- 172.21.15.19:0/4276232939 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f700803d790 con 0x55fc1dca54d0 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 10 client.16278 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 10 client.16278 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 20 client.16278 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dcc5be0 0x55fc1dcc8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 4 client.16278 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc1dc1ddf0 con 0x55fc1dcc5be0 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.776+0000 7f701d8ae640 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dcc5be0 0x55fc1dcc8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.777+0000 7f70017fa640 10 client.16278 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.777+0000 7f701d8ae640 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dcc5be0 0x55fc1dcc8040 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7edb8d5984cdb463 server_cookie=79549b93de13797b in_seq=0 out_seq=0 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.778+0000 7f70017fa640 1 -- 172.21.15.19:0/4276232939 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc1dc1ddf0 con 0x55fc1dcc5be0 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.778+0000 7f70017fa640 10 client.16278 handle_command_reply: tid=0 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.778+0000 7f7021ee7740 1 client.16278 shutdown 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca54d0 msgr2=0x55fc1dcb59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca54d0 0x55fc1dcb59d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f700802a410 comp rx=0 tx=0).stop 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 shutdown_connections 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dcc5be0 0x55fc1dcc8040 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcb3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca5df0 0x55fc1dcb2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 --2- 172.21.15.19:0/4276232939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca54d0 0x55fc1dcb59d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f70017fa640 0 client.16278 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 >> 172.21.15.19:0/4276232939 conn(0x55fc1dca3300 msgr2=0x55fc1dca8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 shutdown_connections 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 1 -- 172.21.15.19:0/4276232939 wait complete. 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.779+0000 7f7021ee7740 20 client.16278 trim_cache size 0 max 16384 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 Processor -- start 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 -- start start 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dccd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dccde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70181aed60 con 0x55fc1dcb6190 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70181ac5a0 con 0x55fc1dca5df0 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f7021ee7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70181aa3f0 con 0x55fc1dca54d0 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dccde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dccde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52924/0 (socket says 172.21.15.19:52924) 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.792+0000 7f701d0ad640 1 -- 172.21.15.19:0/3455873058 learned_addr learned my addr 172.21.15.19:0/3455873058 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d0ad640 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d8ae640 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dccd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d0ad640 1 -- 172.21.15.19:0/3455873058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 msgr2=0x55fc1dca47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d0ad640 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d0ad640 1 -- 172.21.15.19:0/3455873058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 msgr2=0x55fc1dccd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d0ad640 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dccd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d0ad640 1 -- 172.21.15.19:0/3455873058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc1dcb2bd0 con 0x55fc1dcb6190 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f701d0ad640 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dccde50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f70080315f0 tx=0x7f7008031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a557eecdcac615c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f70037fe640 1 -- 172.21.15.19:0/3455873058 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700805a070 con 0x55fc1dcb6190 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f70037fe640 1 -- 172.21.15.19:0/3455873058 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f700805b040 con 0x55fc1dcb6190 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.793+0000 7f70037fe640 1 -- 172.21.15.19:0/3455873058 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008035040 con 0x55fc1dcb6190 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 -- 172.21.15.19:0/3455873058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 msgr2=0x55fc1dccde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dccde50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f70080315f0 tx=0x7f7008031400 comp rx=0 tx=0).stop 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 -- 172.21.15.19:0/3455873058 shutdown_connections 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dcb6190 0x55fc1dccde50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dca5df0 0x55fc1dccd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 --2- 172.21.15.19:0/3455873058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dca47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 -- 172.21.15.19:0/3455873058 >> 172.21.15.19:0/3455873058 conn(0x55fc1dca3300 msgr2=0x55fc1dca40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 -- 172.21.15.19:0/3455873058 shutdown_connections 2024-09-11T00:09:26.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 -- 172.21.15.19:0/3455873058 wait complete. 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 -- start start 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.794+0000 7f7021ee7740 1 Processor -- start 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dcbe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca5df0 0x55fc1dcbeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f7021ee7740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcbb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f7021ee7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70181aaa60 con 0x55fc1dca5df0 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f7021ee7740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70181abed0 con 0x55fc1dcb6190 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f7021ee7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70181ab130 con 0x55fc1dca54d0 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f7021ee7740 10 client.0 _ll_register_callbacks cb 0x7f70080314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dcbe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dcbe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35860/0 (socket says 172.21.15.19:35860) 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d8ae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca5df0 0x55fc1dcbeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 -- 172.21.15.19:0/2407640388 learned_addr learned my addr 172.21.15.19:0/2407640388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcbb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 -- 172.21.15.19:0/2407640388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 msgr2=0x55fc1dcbb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcbb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 -- 172.21.15.19:0/2407640388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca5df0 msgr2=0x55fc1dcbeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca5df0 0x55fc1dcbeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 -- 172.21.15.19:0/2407640388 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc1dcbbb80 con 0x55fc1dca54d0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d8ae640 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca5df0 0x55fc1dcbeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f701d0ad640 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dcbe570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f700802ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27d240c61a23983 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.795+0000 7f70017fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f70017fa640 1 -- 172.21.15.19:0/2407640388 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700805a070 con 0x55fc1dca54d0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f700805b040 con 0x55fc1dca54d0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f70017fa640 1 -- 172.21.15.19:0/2407640388 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f7008031c00 con 0x55fc1dca54d0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f70017fa640 1 -- 172.21.15.19:0/2407640388 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f700804d240 con 0x55fc1dca54d0 2024-09-11T00:09:26.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 10 client.25855 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fc1dd33830 con 0x55fc1dca54d0 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f70017fa640 1 -- 172.21.15.19:0/2407640388 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f700805b040 con 0x55fc1dca54d0 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f70017fa640 1 -- 172.21.15.19:0/2407640388 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f70080052d0 con 0x55fc1dca54d0 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 10 client.25855 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 10 client.25855 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 20 client.25855 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dd34020 0x55fc1dd36440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 4 client.25855 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.796+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc1dc198a0 con 0x55fc1dd34020 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.797+0000 7f701d8ae640 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dd34020 0x55fc1dd36440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.797+0000 7f701d8ae640 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dd34020 0x55fc1dd36440 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da64014ecd973e57 server_cookie=f584100a8c65d082 in_seq=0 out_seq=0 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.797+0000 7f70017fa640 10 client.25855 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.797+0000 7f70017fa640 1 -- 172.21.15.19:0/2407640388 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc1dc198a0 con 0x55fc1dd34020 2024-09-11T00:09:26.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.797+0000 7f70017fa640 10 client.25855 handle_command_reply: tid=0 2024-09-11T00:09:26.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.797+0000 7f7021ee7740 1 client.25855 shutdown 2024-09-11T00:09:26.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 msgr2=0x55fc1dcbe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dcbe570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f700802ab90 comp rx=0 tx=0).stop 2024-09-11T00:09:26.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 shutdown_connections 2024-09-11T00:09:26.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55fc1dd34020 0x55fc1dd36440 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.816 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc1dcb6190 0x55fc1dcbb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f70017fa640 0 client.25855 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fc1dca5df0 0x55fc1dcbeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 --2- 172.21.15.19:0/2407640388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc1dca54d0 0x55fc1dcbe570 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 >> 172.21.15.19:0/2407640388 conn(0x55fc1dca3300 msgr2=0x55fc1dca8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 shutdown_connections 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 1 -- 172.21.15.19:0/2407640388 wait complete. 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.798+0000 7f7021ee7740 20 client.25855 trim_cache size 0 max 16384 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70040b54d0 msgr2=0x7f70040b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70040b54d0 0x7f70040b7990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f70100a94c0 tx=0x7f70100762d0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018109200 msgr2=0x7f701819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018109200 0x7f701819eb70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f701000eaa0 tx=0x7f701000ef60 comp rx=0 tx=0).stop 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 shutdown_connections 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70040b54d0 0x7f70040b7990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7018109200 0x7f701819eb70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7018108860 0x7f70181997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 --2- 172.21.15.19:0/917134058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7018100df0 0x7f7018199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 >> 172.21.15.19:0/917134058 conn(0x7f70180fca20 msgr2=0x7f70180fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 shutdown_connections 2024-09-11T00:09:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:26.799+0000 7f701fb12640 1 -- 172.21.15.19:0/917134058 wait complete. 2024-09-11T00:09:26.819 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:26 smithi131 ceph-mon[35491]: pgmap v534: 97 pgs: 97 active+clean; 824 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 407 op/s 2024-09-11T00:09:27.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:09:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 -- 172.21.15.19:0/779477929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c101cd0 msgr2=0x7f705c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 --2- 172.21.15.19:0/779477929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c101cd0 0x7f705c1020b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f704c009900 tx=0x7f704c02a410 comp rx=0 tx=0).stop 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 -- 172.21.15.19:0/779477929 shutdown_connections 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 --2- 172.21.15.19:0/779477929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f705c108060 0x7f705c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 --2- 172.21.15.19:0/779477929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c1076e0 0x7f705c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 --2- 172.21.15.19:0/779477929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c101cd0 0x7f705c1020b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 -- 172.21.15.19:0/779477929 >> 172.21.15.19:0/779477929 conn(0x7f705c0fd700 msgr2=0x7f705c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 -- 172.21.15.19:0/779477929 shutdown_connections 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.473+0000 7f7060c79640 1 -- 172.21.15.19:0/779477929 wait complete. 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.474+0000 7f7060c79640 1 Processor -- start 2024-09-11T00:09:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.474+0000 7f7060c79640 1 -- start start 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.474+0000 7f7060c79640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f705c101cd0 0x7f705c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.474+0000 7f7060c79640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c1076e0 0x7f705c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f7060c79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c108060 0x7f705c19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f7060c79640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f705c111d20 con 0x7f705c108060 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f7060c79640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f705c111ba0 con 0x7f705c1076e0 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f7060c79640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f705c111ea0 con 0x7f705c101cd0 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f705c101cd0 0x7f705c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c108060 0x7f705c19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f705c101cd0 0x7f705c1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:35878/0 (socket says 172.21.15.19:35878) 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705a59c640 1 -- 172.21.15.19:0/3284397169 learned_addr learned my addr 172.21.15.19:0/3284397169 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f7053fff640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c1076e0 0x7f705c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705ad9d640 1 -- 172.21.15.19:0/3284397169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f705c101cd0 msgr2=0x7f705c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705ad9d640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f705c101cd0 0x7f705c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705ad9d640 1 -- 172.21.15.19:0/3284397169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c1076e0 msgr2=0x7f705c199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705ad9d640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c1076e0 0x7f705c199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705ad9d640 1 -- 172.21.15.19:0/3284397169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c19f470 con 0x7f705c108060 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f705ad9d640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c108060 0x7f705c19eca0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7054009fd0 tx=0x7f705400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f70537fe640 1 -- 172.21.15.19:0/3284397169 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705400ce20 con 0x7f705c108060 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f70537fe640 1 -- 172.21.15.19:0/3284397169 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7054005020 con 0x7f705c108060 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705c19f760 con 0x7f705c108060 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f70537fe640 1 -- 172.21.15.19:0/3284397169 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054010690 con 0x7f705c108060 2024-09-11T00:09:28.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.475+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f705c0fdae0 con 0x7f705c108060 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.478+0000 7f706304e740 1 Processor -- start 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.478+0000 7f70537fe640 1 -- 172.21.15.19:0/3284397169 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f70540054d0 con 0x7f705c108060 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.478+0000 7f706304e740 1 -- start start 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f706304e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f706304e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f706304e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f706304e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f9e9b30ea0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f706304e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f9e9b202d0 con 0x55f9e9bbadf0 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f706304e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9e9b240e0 con 0x55f9e9bc6d80 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bba8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52966/0 (socket says 172.21.15.19:52966) 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 -- 172.21.15.19:0/494891157 learned_addr learned my addr 172.21.15.19:0/494891157 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:28.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f705a59c640 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 -- 172.21.15.19:0/494891157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bc6d80 msgr2=0x55f9e9bc9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f70537fe640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70480b5450 0x7f70480b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 -- 172.21.15.19:0/494891157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bbadf0 msgr2=0x55f9e9bc6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f7053fff640 1 -- 172.21.15.19:0/494891157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e987e650 con 0x55f9e9bba4d0 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.479+0000 7f705ad9d640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70480b5450 0x7f70480b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f7053fff640 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bba8b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7044012840 tx=0x7f704400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceb332a372df64a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f70537fe640 1 -- 172.21.15.19:0/3284397169 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f70540e65b0 con 0x7f705c108060 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f7050ff9640 1 -- 172.21.15.19:0/494891157 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044012dc0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f7050ff9640 1 -- 172.21.15.19:0/494891157 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70440120d0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f7050ff9640 1 -- 172.21.15.19:0/494891157 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704400ed00 con 0x55f9e9bba4d0 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f706304e740 1 -- 172.21.15.19:0/494891157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 msgr2=0x55f9e9bba8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f705ad9d640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70480b5450 0x7f70480b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70540e4350 tx=0x7f7054078c60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.480+0000 7f706304e740 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bba8b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7044012840 tx=0x7f704400b410 comp rx=0 tx=0).stop 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- 172.21.15.19:0/494891157 shutdown_connections 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 --2- 172.21.15.19:0/494891157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bba8b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- 172.21.15.19:0/494891157 >> 172.21.15.19:0/494891157 conn(0x55f9e9bb8300 msgr2=0x55f9e9bb94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- 172.21.15.19:0/494891157 shutdown_connections 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- 172.21.15.19:0/494891157 wait complete. 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- start start 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 Processor -- start 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f9e9981700 con 0x55f9e9bba4d0 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f9e9abb160 con 0x55f9e9bc6d80 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9e9bc99a0 con 0x55f9e9bbadf0 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f706304e740 10 client.0 _ll_register_callbacks cb 0x55f9e9ad49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.481+0000 7f7053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f705a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52980/0 (socket says 172.21.15.19:52980) 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 -- 172.21.15.19:0/673426360 learned_addr learned my addr 172.21.15.19:0/673426360 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 -- 172.21.15.19:0/673426360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 msgr2=0x55f9e9bc3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 -- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 msgr2=0x55f9e9bc41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 -- 172.21.15.19:0/673426360 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e9ae8c90 con 0x55f9e9bba4d0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f705a59c640 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7053fff640 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc66e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f704400ea20 tx=0x7f704400b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec50256f529099d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7041ffb640 1 -- 172.21.15.19:0/673426360 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044027030 con 0x55f9e9bba4d0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7041ffb640 1 -- 172.21.15.19:0/673426360 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f704400ecd0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70440120d0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f7041ffb640 1 -- 172.21.15.19:0/673426360 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7044004020 con 0x55f9e9bba4d0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f706304e740 10 client.16296 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.482+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f9e9bd5350 con 0x55f9e9bba4d0 2024-09-11T00:09:28.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f7041ffb640 1 -- 172.21.15.19:0/673426360 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70440120d0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f7041ffb640 1 -- 172.21.15.19:0/673426360 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f70440042c0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f706304e740 10 client.16296 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f706304e740 10 client.16296 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f706304e740 20 client.16296 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f706304e740 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9bd66a0 0x55f9e9bd8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f706304e740 4 client.16296 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9e9b32df0 con 0x55f9e9bd66a0 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f705a59c640 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9bd66a0 0x55f9e9bd8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f705a59c640 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9bd66a0 0x55f9e9bd8a90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f77d3a511f0e1e69 server_cookie=bce66ea5053d39a6 in_seq=0 out_seq=0 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.483+0000 7f7041ffb640 10 client.16296 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f7041ffb640 1 -- 172.21.15.19:0/673426360 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9e9b32df0 con 0x55f9e9bd66a0 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f7041ffb640 10 client.16296 handle_command_reply: tid=0 2024-09-11T00:09:28.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 client.16296 shutdown 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 msgr2=0x55f9e9bc66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc66e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f704400ea20 tx=0x7f704400b750 comp rx=0 tx=0).stop 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 shutdown_connections 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9bd66a0 0x55f9e9bd8a90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f7041ffb640 0 client.16296 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 --2- 172.21.15.19:0/673426360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc66e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 >> 172.21.15.19:0/673426360 conn(0x55f9e9bb8300 msgr2=0x55f9e9bbdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 shutdown_connections 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.484+0000 7f706304e740 1 -- 172.21.15.19:0/673426360 wait complete. 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.485+0000 7f706304e740 20 client.16296 trim_cache size 0 max 16384 2024-09-11T00:09:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.498+0000 7f706304e740 1 Processor -- start 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f706304e740 1 -- start start 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f706304e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f706304e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f706304e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f706304e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f705c1b3150 con 0x55f9e9bbadf0 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f706304e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f705c1b0990 con 0x55f9e9bc6d80 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f706304e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f705c1ae800 con 0x55f9e9bba4d0 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52982/0 (socket says 172.21.15.19:52982) 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 -- 172.21.15.19:0/3351855067 learned_addr learned my addr 172.21.15.19:0/3351855067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f7053fff640 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 -- 172.21.15.19:0/3351855067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bba4d0 msgr2=0x55f9e9bc3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 -- 172.21.15.19:0/3351855067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 msgr2=0x55f9e9bc8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 -- 172.21.15.19:0/3351855067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e9bbac20 con 0x55f9e9bbadf0 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f705a59c640 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc5870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f704c031440 tx=0x7f704c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bae235ddc91abb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f7043fff640 1 -- 172.21.15.19:0/3351855067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c04a070 con 0x55f9e9bbadf0 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f7043fff640 1 -- 172.21.15.19:0/3351855067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f704c031950 con 0x55f9e9bbadf0 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.499+0000 7f7043fff640 1 -- 172.21.15.19:0/3351855067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c035040 con 0x55f9e9bbadf0 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 -- 172.21.15.19:0/3351855067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bbadf0 msgr2=0x55f9e9bc5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc5870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f704c031440 tx=0x7f704c0058d0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 -- 172.21.15.19:0/3351855067 shutdown_connections 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bc5870 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 --2- 172.21.15.19:0/3351855067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bc3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 -- 172.21.15.19:0/3351855067 >> 172.21.15.19:0/3351855067 conn(0x55f9e9bb8300 msgr2=0x55f9e9bc5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 -- 172.21.15.19:0/3351855067 shutdown_connections 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 -- 172.21.15.19:0/3351855067 wait complete. 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 -- start start 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.500+0000 7f706304e740 1 Processor -- start 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bcec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bcf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f705c1aee50 con 0x55f9e9bba4d0 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f705c1b02c0 con 0x55f9e9bc6d80 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f705c1af520 con 0x55f9e9bbadf0 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 10 client.0 _ll_register_callbacks cb 0x7f704c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bcec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bcec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52994/0 (socket says 172.21.15.19:52994) 2024-09-11T00:09:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 -- 172.21.15.19:0/3783661172 learned_addr learned my addr 172.21.15.19:0/3783661172 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f705a59c640 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bcf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 -- 172.21.15.19:0/3783661172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 msgr2=0x55f9e9bcf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bcf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 -- 172.21.15.19:0/3783661172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 msgr2=0x55f9e9bc9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 -- 172.21.15.19:0/3783661172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e9bcf8f0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7053fff640 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bcec40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f704400ea20 tx=0x7f704400bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dc7f5e70eb8c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7041ffb640 1 -- 172.21.15.19:0/3783661172 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044027040 con 0x55f9e9bba4d0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9e9b2e8a0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.501+0000 7f7041ffb640 1 -- 172.21.15.19:0/3783661172 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f704400e810 con 0x55f9e9bba4d0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f7041ffb640 1 -- 172.21.15.19:0/3783661172 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f70440120d0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 10 client.16302 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f9e9c43950 con 0x55f9e9bba4d0 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f7041ffb640 1 -- 172.21.15.19:0/3783661172 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f9e9b2e8a0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f7041ffb640 1 -- 172.21.15.19:0/3783661172 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7044003aa0 con 0x55f9e9bba4d0 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 10 client.16302 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 10 client.16302 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 20 client.16302 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9c44160 0x55f9e9c46580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 4 client.16302 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9e9b2bcd0 con 0x55f9e9c44160 2024-09-11T00:09:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.502+0000 7f705a59c640 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9c44160 0x55f9e9c46580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f705a59c640 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9c44160 0x55f9e9c46580 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6920997511f4eee6 server_cookie=dd1bca9d22ba9d52 in_seq=0 out_seq=0 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f7041ffb640 10 client.16302 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f7041ffb640 1 -- 172.21.15.19:0/3783661172 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9e9b2bcd0 con 0x55f9e9c44160 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f7041ffb640 10 client.16302 handle_command_reply: tid=0 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 client.16302 shutdown 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 msgr2=0x55f9e9bcec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bcec40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f704400ea20 tx=0x7f704400bfc0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 shutdown_connections 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55f9e9c44160 0x55f9e9c46580 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9e9bc6d80 0x55f9e9bc9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e9bbadf0 0x55f9e9bcf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f7041ffb640 0 client.16302 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 --2- 172.21.15.19:0/3783661172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e9bba4d0 0x55f9e9bcec40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 >> 172.21.15.19:0/3783661172 conn(0x55f9e9bb8300 msgr2=0x55f9e9bb7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 shutdown_connections 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 1 -- 172.21.15.19:0/3783661172 wait complete. 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.503+0000 7f706304e740 20 client.16302 trim_cache size 0 max 16384 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70480b5450 msgr2=0x7f70480b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70480b5450 0x7f70480b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70540e4350 tx=0x7f7054078c60 comp rx=0 tx=0).stop 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c108060 msgr2=0x7f705c19eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c108060 0x7f705c19eca0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7054009fd0 tx=0x7f705400ef10 comp rx=0 tx=0).stop 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 shutdown_connections 2024-09-11T00:09:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f70480b5450 0x7f70480b7910 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f705c108060 0x7f705c19eca0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c1076e0 0x7f705c199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 --2- 172.21.15.19:0/3284397169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f705c101cd0 0x7f705c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 >> 172.21.15.19:0/3284397169 conn(0x7f705c0fd700 msgr2=0x7f705c06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 shutdown_connections 2024-09-11T00:09:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:28.504+0000 7f7060c79640 1 -- 172.21.15.19:0/3284397169 wait complete. 2024-09-11T00:09:28.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:28 smithi135 ceph-mon[35432]: pgmap v535: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 441 op/s 2024-09-11T00:09:28.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:28 smithi019 ceph-mon[30859]: pgmap v535: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 441 op/s 2024-09-11T00:09:28.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:28 smithi131 ceph-mon[35491]: pgmap v535: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 441 op/s 2024-09-11T00:09:29.232 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:09:29.493 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:30.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 -- 172.21.15.19:0/1881903256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 msgr2=0x7f99c8101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/1881903256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c8101c50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009900 tx=0x7f99bc02a480 comp rx=0 tx=0).stop 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 -- 172.21.15.19:0/1881903256 shutdown_connections 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/1881903256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99c810f420 0x7f99c8111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/1881903256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8102190 0x7f99c810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/1881903256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c8101c50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 -- 172.21.15.19:0/1881903256 >> 172.21.15.19:0/1881903256 conn(0x7f99c80fd720 msgr2=0x7f99c80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 -- 172.21.15.19:0/1881903256 shutdown_connections 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 -- 172.21.15.19:0/1881903256 wait complete. 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 Processor -- start 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 -- start start 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.011+0000 7f99ceb5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99ceb5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8102190 0x7f99c819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99ceb5e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99c810f420 0x7f99c81a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99ceb5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8114fb0 con 0x7f99c8101870 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99ceb5e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8114e30 con 0x7f99c810f420 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99ceb5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8115130 con 0x7f99c8102190 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52998/0 (socket says 172.21.15.19:52998) 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 -- 172.21.15.19:0/2247804658 learned_addr learned my addr 172.21.15.19:0/2247804658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8102190 0x7f99c819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99c810f420 0x7f99c81a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 -- 172.21.15.19:0/2247804658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8102190 msgr2=0x7f99c819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8102190 0x7f99c819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 -- 172.21.15.19:0/2247804658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99c810f420 msgr2=0x7f99c81a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99c810f420 0x7f99c81a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 -- 172.21.15.19:0/2247804658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c81a1570 con 0x7f99c8101870 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99c810f420 0x7f99c81a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99cc8fa640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c819b4c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f99bc005ab0 tx=0x7f99bc003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99c5ffb640 1 -- 172.21.15.19:0/2247804658 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc03f070 con 0x7f99c8101870 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99c5ffb640 1 -- 172.21.15.19:0/2247804658 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99bc031d60 con 0x7f99c8101870 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.012+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c81a1800 con 0x7f99c8101870 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.013+0000 7f99c5ffb640 1 -- 172.21.15.19:0/2247804658 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc035030 con 0x7f99c8101870 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.013+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c81a7f20 con 0x7f99c8101870 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.015+0000 7f99c5ffb640 1 -- 172.21.15.19:0/2247804658 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f99bc03b560 con 0x7f99c8101870 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.015+0000 7f99d0f33740 1 Processor -- start 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.015+0000 7f99d0f33740 1 -- start start 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f5e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f5e9a0 0x562981f60d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99d0f33740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562981ec8ea0 con 0x562981f520f0 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99d0f33740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562981eb82d0 con 0x562981f5e9a0 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99d0f33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562981ebc0e0 con 0x562981f52a10 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cc8fa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f5e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53002/0 (socket says 172.21.15.19:53002) 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 -- 172.21.15.19:0/1622307776 learned_addr learned my addr 172.21.15.19:0/1622307776 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99c7fff640 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f5e9a0 0x562981f60d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 -- 172.21.15.19:0/1622307776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 msgr2=0x562981f5e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f5e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 -- 172.21.15.19:0/1622307776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f5e9a0 msgr2=0x562981f60d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f5e9a0 0x562981f60d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 -- 172.21.15.19:0/1622307776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562981c16650 con 0x562981f520f0 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99c7fff640 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f5e9a0 0x562981f60d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cc8fa640 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f5e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99c5ffb640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99b80b54d0 0x7f99b80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f524d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009f30 tx=0x7f99c0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f2b9c045383bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.016+0000 7f99cc8fa640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99b80b54d0 0x7f99b80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.017+0000 7f99b2ffd640 1 -- 172.21.15.19:0/1622307776 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0016070 con 0x562981f520f0 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.017+0000 7f99b2ffd640 1 -- 172.21.15.19:0/1622307776 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c001bb10 con 0x562981f520f0 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.017+0000 7f99b2ffd640 1 -- 172.21.15.19:0/1622307776 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0012c10 con 0x562981f520f0 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.017+0000 7f99c5ffb640 1 -- 172.21.15.19:0/2247804658 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f99bc106ad0 con 0x7f99c8101870 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 -- 172.21.15.19:0/1622307776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 msgr2=0x562981f524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99cc8fa640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99b80b54d0 0x7f99b80b7990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f99bc104320 tx=0x7f99bc10a620 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:30.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f524d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009f30 tx=0x7f99c0010800 comp rx=0 tx=0).stop 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 -- 172.21.15.19:0/1622307776 shutdown_connections 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f5e9a0 0x562981f60d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f5e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 --2- 172.21.15.19:0/1622307776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f524d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 -- 172.21.15.19:0/1622307776 >> 172.21.15.19:0/1622307776 conn(0x562981f4ff20 msgr2=0x562981f510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 -- 172.21.15.19:0/1622307776 shutdown_connections 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 -- 172.21.15.19:0/1622307776 wait complete. 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 -- start start 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.018+0000 7f99d0f33740 1 Processor -- start 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f5e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f52a10 0x562981f5b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f5bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99d0f33740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562981d19700 con 0x562981f52a10 2024-09-11T00:09:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99d0f33740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562981e53160 con 0x562981f520f0 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99d0f33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562981f61620 con 0x562981f5e9a0 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99d0f33740 10 client.0 _ll_register_callbacks cb 0x562981e6c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f52a10 0x562981f5b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f52a10 0x562981f5b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53012/0 (socket says 172.21.15.19:53012) 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 -- 172.21.15.19:0/585784468 learned_addr learned my addr 172.21.15.19:0/585784468 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f5e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 -- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 msgr2=0x562981f5bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f5bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 -- 172.21.15.19:0/585784468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 msgr2=0x562981f5e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f5e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 -- 172.21.15.19:0/585784468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562981e80c90 con 0x562981f52a10 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99c7fff640 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f52a10 0x562981f5b6b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f99b400bf90 tx=0x7f99b40128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9a040b749a702f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.019+0000 7f99a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99a7fff640 1 -- 172.21.15.19:0/585784468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4021060 con 0x562981f52a10 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99a7fff640 1 -- 172.21.15.19:0/585784468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f99b4010750 con 0x562981f52a10 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c001bb10 con 0x562981f52a10 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99a7fff640 1 -- 172.21.15.19:0/585784468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f99b4010950 con 0x562981f52a10 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 10 client.16314 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562981f6cf80 con 0x562981f52a10 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99a7fff640 1 -- 172.21.15.19:0/585784468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c001bb10 con 0x562981f52a10 2024-09-11T00:09:30.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99a7fff640 1 -- 172.21.15.19:0/585784468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f99b4024be0 con 0x562981f52a10 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 10 client.16314 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 20 client.16314 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981f708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 4 client.16314 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.020+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562981ecadf0 con 0x562981f6e440 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.021+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981f708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.021+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981f708a0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=663db720a28e4203 server_cookie=d49331b144fd9c59 in_seq=0 out_seq=0 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.021+0000 7f99a7fff640 10 client.16314 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99a7fff640 1 -- 172.21.15.19:0/585784468 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562981ecadf0 con 0x562981f6e440 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99a7fff640 10 client.16314 handle_command_reply: tid=0 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 client.16314 shutdown 2024-09-11T00:09:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f52a10 msgr2=0x562981f5b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f52a10 0x562981f5b6b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f99b400bf90 tx=0x7f99b40128e0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 shutdown_connections 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981f708a0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99a7fff640 0 client.16314 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f52a10 0x562981f5b6b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 --2- 172.21.15.19:0/585784468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f5e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 >> 172.21.15.19:0/585784468 conn(0x562981f4ff20 msgr2=0x562981f55a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 shutdown_connections 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.022+0000 7f99d0f33740 1 -- 172.21.15.19:0/585784468 wait complete. 2024-09-11T00:09:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.023+0000 7f99d0f33740 20 client.16314 trim_cache size 0 max 16384 2024-09-11T00:09:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 Processor -- start 2024-09-11T00:09:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 -- start start 2024-09-11T00:09:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f6a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f52a10 0x562981f5d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81b3190 con 0x562981f520f0 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81b09d0 con 0x562981f52a10 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99d0f33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81ae840 con 0x562981f5e9a0 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99cd0fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f6a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99cd0fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f6a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53018/0 (socket says 172.21.15.19:53018) 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99cd0fb640 1 -- 172.21.15.19:0/362442599 learned_addr learned my addr 172.21.15.19:0/362442599 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.037+0000 7f99c7fff640 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f52a10 0x562981f5d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99cd0fb640 1 -- 172.21.15.19:0/362442599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 msgr2=0x562981f588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99cd0fb640 1 -- 172.21.15.19:0/362442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f52a10 msgr2=0x562981f5d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f52a10 0x562981f5d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99cd0fb640 1 -- 172.21.15.19:0/362442599 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562981f5c000 con 0x562981f520f0 2024-09-11T00:09:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99c7fff640 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f52a10 0x562981f5d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f6a850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009cc0 tx=0x7f99c0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f099315a708d5c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99b27fc640 1 -- 172.21.15.19:0/362442599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0016040 con 0x562981f520f0 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99b27fc640 1 -- 172.21.15.19:0/362442599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c0005040 con 0x562981f520f0 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.038+0000 7f99b27fc640 1 -- 172.21.15.19:0/362442599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c002b6d0 con 0x562981f520f0 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 -- 172.21.15.19:0/362442599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 msgr2=0x562981f6a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f6a850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009cc0 tx=0x7f99c0010800 comp rx=0 tx=0).stop 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 -- 172.21.15.19:0/362442599 shutdown_connections 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f5e9a0 0x562981f588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f52a10 0x562981f5d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 --2- 172.21.15.19:0/362442599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f520f0 0x562981f6a850 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 -- 172.21.15.19:0/362442599 >> 172.21.15.19:0/362442599 conn(0x562981f4ff20 msgr2=0x562981f5cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 -- 172.21.15.19:0/362442599 shutdown_connections 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 -- 172.21.15.19:0/362442599 wait complete. 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.039+0000 7f99d0f33740 1 -- start start 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 1 Processor -- start 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f66d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f5e9a0 0x562981f63470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81aee90 con 0x562981f5e9a0 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81b0300 con 0x562981f520f0 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81af560 con 0x562981f52a10 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99d0f33740 10 client.0 _ll_register_callbacks cb 0x7f99b400bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99cd0fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f5e9a0 0x562981f63470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99cd0fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f5e9a0 0x562981f63470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53034/0 (socket says 172.21.15.19:53034) 2024-09-11T00:09:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99cd0fb640 1 -- 172.21.15.19:0/2231224575 learned_addr learned my addr 172.21.15.19:0/2231224575 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.040+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f66d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99cd0fb640 1 -- 172.21.15.19:0/2231224575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 msgr2=0x562981f672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99cd0fb640 1 -- 172.21.15.19:0/2231224575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 msgr2=0x562981f66d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f66d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99cd0fb640 1 -- 172.21.15.19:0/2231224575 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562981f63c70 con 0x562981f5e9a0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99cd0fb640 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f5e9a0 0x562981f63470 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f99c00125d0 tx=0x7f99c0010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b894f0e395d07b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99a7fff640 1 -- 172.21.15.19:0/2231224575 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0016040 con 0x562981f5e9a0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99a7fff640 1 -- 172.21.15.19:0/2231224575 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f99c0012840 con 0x562981f5e9a0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c0005040 con 0x562981f5e9a0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99a7fff640 1 -- 172.21.15.19:0/2231224575 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f99c0012a40 con 0x562981f5e9a0 2024-09-11T00:09:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99d0f33740 10 client.16320 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562981fdc150 con 0x562981f5e9a0 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99a7fff640 1 -- 172.21.15.19:0/2231224575 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c0005040 con 0x562981f5e9a0 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.041+0000 7f99a7fff640 1 -- 172.21.15.19:0/2231224575 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f99c000f040 con 0x562981f5e9a0 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99d0f33740 10 client.16320 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99d0f33740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99d0f33740 20 client.16320 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99d0f33740 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981fde610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99d0f33740 4 client.16320 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562981ec68a0 con 0x562981f6e440 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99c7fff640 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981fde610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99c7fff640 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981fde610 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b3ca78dc9683fe server_cookie=3040b07a8d0267b4 in_seq=0 out_seq=0 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99a7fff640 10 client.16320 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:30.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99a7fff640 1 -- 172.21.15.19:0/2231224575 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562981ec68a0 con 0x562981f6e440 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99a7fff640 10 client.16320 handle_command_reply: tid=0 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.042+0000 7f99d0f33740 1 client.16320 shutdown 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f5e9a0 msgr2=0x562981f63470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f5e9a0 0x562981f63470 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f99c00125d0 tx=0x7f99c0010fd0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 shutdown_connections 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x562981f6e440 0x562981fde610 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562981f5e9a0 0x562981f63470 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562981f52a10 0x562981f672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 --2- 172.21.15.19:0/2231224575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562981f520f0 0x562981f66d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99a7fff640 0 client.16320 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 >> 172.21.15.19:0/2231224575 conn(0x562981f4ff20 msgr2=0x562981f59b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 shutdown_connections 2024-09-11T00:09:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 1 -- 172.21.15.19:0/2231224575 wait complete. 2024-09-11T00:09:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.043+0000 7f99d0f33740 20 client.16320 trim_cache size 0 max 16384 2024-09-11T00:09:30.051 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:09:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99b80b54d0 msgr2=0x7f99b80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99b80b54d0 0x7f99b80b7990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f99bc104320 tx=0x7f99bc10a620 comp rx=0 tx=0).stop 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 msgr2=0x7f99c819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c819b4c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f99bc005ab0 tx=0x7f99bc003cd0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 shutdown_connections 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99c810f420 0x7f99c81a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8102190 0x7f99c819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f99b80b54d0 0x7f99b80b7990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 --2- 172.21.15.19:0/2247804658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99c8101870 0x7f99c819b4c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 >> 172.21.15.19:0/2247804658 conn(0x7f99c80fd720 msgr2=0x7f99c8110730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 shutdown_connections 2024-09-11T00:09:30.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:30.044+0000 7f99ceb5e640 1 -- 172.21.15.19:0/2247804658 wait complete. 2024-09-11T00:09:30.643 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:30 smithi019 ceph-mon[30859]: pgmap v536: 97 pgs: 97 active+clean; 848 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-09-11T00:09:30.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:30 smithi135 ceph-mon[35432]: pgmap v536: 97 pgs: 97 active+clean; 848 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-09-11T00:09:30.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:30 smithi131 ceph-mon[35491]: pgmap v536: 97 pgs: 97 active+clean; 848 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-09-11T00:09:31.769 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:09:31.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:09:32.030 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:32.450 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:32 smithi019 ceph-mon[30859]: pgmap v537: 97 pgs: 97 active+clean; 848 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 428 op/s 2024-09-11T00:09:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 -- 172.21.15.19:0/698963112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301076a0 msgr2=0x7f1a30107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/698963112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301076a0 0x7f1a30107ae0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009900 tx=0x7f1a1c02a410 comp rx=0 tx=0).stop 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 -- 172.21.15.19:0/698963112 shutdown_connections 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/698963112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a30108020 0x7f1a3010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/698963112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a301076a0 0x7f1a30107ae0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/698963112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a30101c90 0x7f1a30102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 -- 172.21.15.19:0/698963112 >> 172.21.15.19:0/698963112 conn(0x7f1a300fd700 msgr2=0x7f1a300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 -- 172.21.15.19:0/698963112 shutdown_connections 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.535+0000 7f1a36cdd640 1 -- 172.21.15.19:0/698963112 wait complete. 2024-09-11T00:09:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 Processor -- start 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 -- start start 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30101c90 0x7f1a30199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a301076a0 0x7f1a30199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a30108020 0x7f1a3019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112dc0 con 0x7f1a30101c90 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112c40 con 0x7f1a301076a0 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a36cdd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112f40 con 0x7f1a30108020 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a34a79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30101c90 0x7f1a30199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a34a79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30101c90 0x7f1a30199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37846/0 (socket says 172.21.15.19:37846) 2024-09-11T00:09:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a34a79640 1 -- 172.21.15.19:0/3483935538 learned_addr learned my addr 172.21.15.19:0/3483935538 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a30108020 0x7f1a3019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.536+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a301076a0 0x7f1a30199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a34a79640 1 -- 172.21.15.19:0/3483935538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a30108020 msgr2=0x7f1a3019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a34a79640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a30108020 0x7f1a3019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a34a79640 1 -- 172.21.15.19:0/3483935538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a301076a0 msgr2=0x7f1a30199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a34a79640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a301076a0 0x7f1a30199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a34a79640 1 -- 172.21.15.19:0/3483935538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3019f300 con 0x7f1a30101c90 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a34a79640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30101c90 0x7f1a30199250 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e9f0 tx=0x7f1a2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a2dffb640 1 -- 172.21.15.19:0/3483935538 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400cd80 con 0x7f1a30101c90 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a2dffb640 1 -- 172.21.15.19:0/3483935538 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a240108e0 con 0x7f1a30101c90 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3019f5f0 con 0x7f1a30101c90 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a2dffb640 1 -- 172.21.15.19:0/3483935538 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24018980 con 0x7f1a30101c90 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.537+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301a5e80 con 0x7f1a30101c90 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 Processor -- start 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 -- start start 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfdc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfe8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfe8790 0x559f2dfeab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559f2df52e60 con 0x559f2dfdc800 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559f2df42290 con 0x559f2dfe8790 2024-09-11T00:09:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a390b2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559f2df460a0 con 0x559f2dfdbee0 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a2dffb640 1 -- 172.21.15.19:0/3483935538 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f1a24010430 con 0x7f1a30101c90 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfdc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfdc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45252/0 (socket says 172.21.15.19:45252) 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a34a79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfe8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a3527a640 1 -- 172.21.15.19:0/2532310913 learned_addr learned my addr 172.21.15.19:0/2532310913 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.540+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfe8790 0x559f2dfeab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a3527a640 1 -- 172.21.15.19:0/2532310913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfe8790 msgr2=0x559f2dfeab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a3527a640 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfe8790 0x559f2dfeab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a3527a640 1 -- 172.21.15.19:0/2532310913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 msgr2=0x559f2dfe8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a3527a640 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfe8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a3527a640 1 -- 172.21.15.19:0/2532310913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f2dca0930 con 0x559f2dfdbee0 2024-09-11T00:09:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a3527a640 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfdc2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a28011440 tx=0x7f1a28011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5e49d2a70ace65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a2dffb640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a200b54d0 0x7f1a200b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a1affd640 1 -- 172.21.15.19:0/2532310913 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28004d20 con 0x559f2dfdbee0 2024-09-11T00:09:32.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a1affd640 1 -- 172.21.15.19:0/2532310913 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a28004050 con 0x559f2dfdbee0 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a1affd640 1 -- 172.21.15.19:0/2532310913 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2800f780 con 0x559f2dfdbee0 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a34a79640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a200b54d0 0x7f1a200b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.541+0000 7f1a2dffb640 1 -- 172.21.15.19:0/3483935538 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f1a240e61f0 con 0x7f1a30101c90 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 -- 172.21.15.19:0/2532310913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 msgr2=0x559f2dfdc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfdc2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a28011440 tx=0x7f1a28011900 comp rx=0 tx=0).stop 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a34a79640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a200b54d0 0x7f1a200b7990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a240e3a40 tx=0x7f1a240e9d40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 -- 172.21.15.19:0/2532310913 shutdown_connections 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfe8790 0x559f2dfeab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfe8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 --2- 172.21.15.19:0/2532310913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfdc2c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 -- 172.21.15.19:0/2532310913 >> 172.21.15.19:0/2532310913 conn(0x559f2dfd9d10 msgr2=0x559f2dfdaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 -- 172.21.15.19:0/2532310913 shutdown_connections 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 -- 172.21.15.19:0/2532310913 wait complete. 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.542+0000 7f1a390b2740 1 -- start start 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 1 Processor -- start 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfe57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfe8790 0x559f2dfe6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559f2dda3890 con 0x559f2dfe8790 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559f2dedcd40 con 0x559f2dfdc800 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559f2dfeb440 con 0x559f2dfdbee0 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a390b2740 10 client.0 _ll_register_callbacks cb 0x559f2df40c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfe57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfe57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45260/0 (socket says 172.21.15.19:45260) 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a3527a640 1 -- 172.21.15.19:0/4254774835 learned_addr learned my addr 172.21.15.19:0/4254774835 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a3527a640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfe8790 0x559f2dfe6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.543+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a3527a640 1 -- 172.21.15.19:0/4254774835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 msgr2=0x559f2dfe5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a3527a640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a3527a640 1 -- 172.21.15.19:0/4254774835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfe8790 msgr2=0x559f2dfe6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a3527a640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfe8790 0x559f2dfe6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a3527a640 1 -- 172.21.15.19:0/4254774835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f2dff48a0 con 0x559f2dfdbee0 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a3527a640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfe57c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a28003d90 tx=0x7f1a28005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da113b11da4fcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a0ffff640 1 -- 172.21.15.19:0/4254774835 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2802b020 con 0x559f2dfdbee0 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a0ffff640 1 -- 172.21.15.19:0/4254774835 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f1a2800fb80 con 0x559f2dfdbee0 2024-09-11T00:09:32.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a28004050 con 0x559f2dfdbee0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a0ffff640 1 -- 172.21.15.19:0/4254774835 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1a28036050 con 0x559f2dfdbee0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a390b2740 10 client.25903 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559f2dff7230 con 0x559f2dfdbee0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.544+0000 7f1a0ffff640 1 -- 172.21.15.19:0/4254774835 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a28004050 con 0x559f2dfdbee0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a0ffff640 1 -- 172.21.15.19:0/4254774835 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1a28019aa0 con 0x559f2dfdbee0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a390b2740 10 client.25903 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a390b2740 10 client.25903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a390b2740 20 client.25903 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a390b2740 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2dff85e0 0x559f2dffa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a390b2740 4 client.25903 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f2df54db0 con 0x559f2dff85e0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2dff85e0 0x559f2dffa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2dff85e0 0x559f2dffa9d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cde539b7d0e12e5 server_cookie=ba26d4abae1049db in_seq=0 out_seq=0 2024-09-11T00:09:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.545+0000 7f1a0ffff640 10 client.25903 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.546+0000 7f1a0ffff640 1 -- 172.21.15.19:0/4254774835 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f2df54db0 con 0x559f2dff85e0 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.546+0000 7f1a0ffff640 10 client.25903 handle_command_reply: tid=0 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 client.25903 shutdown 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 msgr2=0x559f2dfe57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfe57c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a28003d90 tx=0x7f1a28005bd0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 shutdown_connections 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2dff85e0 0x559f2dffa9d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfe8790 0x559f2dfe6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 --2- 172.21.15.19:0/4254774835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfdbee0 0x559f2dfe57c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a0ffff640 0 client.25903 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 >> 172.21.15.19:0/4254774835 conn(0x559f2dfd9d10 msgr2=0x559f2dfd8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 shutdown_connections 2024-09-11T00:09:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 1 -- 172.21.15.19:0/4254774835 wait complete. 2024-09-11T00:09:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.547+0000 7f1a390b2740 20 client.25903 trim_cache size 0 max 16384 2024-09-11T00:09:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 Processor -- start 2024-09-11T00:09:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 -- start start 2024-09-11T00:09:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdbee0 0x559f2dfe4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfe29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301b0f00 con 0x559f2dfdbee0 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ae740 con 0x559f2dfdc800 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.566+0000 7f1a390b2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ac5b0 con 0x559f2dfe8790 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdbee0 0x559f2dfe4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdbee0 0x559f2dfe4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37866/0 (socket says 172.21.15.19:37866) 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 -- 172.21.15.19:0/3770628668 learned_addr learned my addr 172.21.15.19:0/3770628668 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfe29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 -- 172.21.15.19:0/3770628668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 msgr2=0x559f2dfe29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfe29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 -- 172.21.15.19:0/3770628668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 msgr2=0x559f2dfe5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 -- 172.21.15.19:0/3770628668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f2dffaf60 con 0x559f2dfdbee0 2024-09-11T00:09:32.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdbee0 0x559f2dfe4f20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1a28002230 tx=0x7f1a28009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc8005f74046e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a1a7fc640 1 -- 172.21.15.19:0/3770628668 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28041070 con 0x559f2dfdbee0 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a1a7fc640 1 -- 172.21.15.19:0/3770628668 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a2801e040 con 0x559f2dfdbee0 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.567+0000 7f1a1a7fc640 1 -- 172.21.15.19:0/3770628668 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2802b050 con 0x559f2dfdbee0 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 -- 172.21.15.19:0/3770628668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdbee0 msgr2=0x559f2dfe4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdbee0 0x559f2dfe4f20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1a28002230 tx=0x7f1a28009500 comp rx=0 tx=0).stop 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 -- 172.21.15.19:0/3770628668 shutdown_connections 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfe29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdc800 0x559f2dfe5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3770628668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdbee0 0x559f2dfe4f20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 -- 172.21.15.19:0/3770628668 >> 172.21.15.19:0/3770628668 conn(0x559f2dfd9d10 msgr2=0x559f2dfe5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 -- 172.21.15.19:0/3770628668 shutdown_connections 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.568+0000 7f1a390b2740 1 -- 172.21.15.19:0/3770628668 wait complete. 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 -- start start 2024-09-11T00:09:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 Processor -- start 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdbee0 0x559f2dfec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301acc00 con 0x559f2dfdc800 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ae070 con 0x559f2dfdbee0 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ad2d0 con 0x559f2dfe8790 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a390b2740 10 client.0 _ll_register_callbacks cb 0x7f1a240e9c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a3527a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfed120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45282/0 (socket says 172.21.15.19:45282) 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a3527a640 1 -- 172.21.15.19:0/3161705435 learned_addr learned my addr 172.21.15.19:0/3161705435 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.569+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdbee0 0x559f2dfec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a3527a640 1 -- 172.21.15.19:0/3161705435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdbee0 msgr2=0x559f2dfec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdbee0 0x559f2dfec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a3527a640 1 -- 172.21.15.19:0/3161705435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 msgr2=0x559f2dfecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfecbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a3527a640 1 -- 172.21.15.19:0/3161705435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f2dfda790 con 0x559f2dfe8790 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a3527a640 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfed120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005d70 tx=0x7f1a28027480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c77c9a4c6d07a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a0ffff640 1 -- 172.21.15.19:0/3161705435 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28041070 con 0x559f2dfe8790 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a0ffff640 1 -- 172.21.15.19:0/3161705435 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f1a2800fdc0 con 0x559f2dfe8790 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a2801e040 con 0x559f2dfe8790 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a0ffff640 1 -- 172.21.15.19:0/3161705435 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1a2804c020 con 0x559f2dfe8790 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a390b2740 10 client.25909 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559f2e0655b0 con 0x559f2dfe8790 2024-09-11T00:09:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.570+0000 7f1a0ffff640 1 -- 172.21.15.19:0/3161705435 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a2801e040 con 0x559f2dfe8790 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a0ffff640 1 -- 172.21.15.19:0/3161705435 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1a28047030 con 0x559f2dfe8790 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a390b2740 10 client.25909 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a390b2740 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a390b2740 20 client.25909 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2e065b70 0x559f2e067f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a390b2740 4 client.25909 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559f2df50860 con 0x559f2e065b70 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2e065b70 0x559f2e067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a2ffff640 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2e065b70 0x559f2e067f90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e99ebb35c1bbfe6 server_cookie=f848c791832cf55f in_seq=0 out_seq=0 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.571+0000 7f1a0ffff640 10 client.25909 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a0ffff640 1 -- 172.21.15.19:0/3161705435 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559f2df50860 con 0x559f2e065b70 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a0ffff640 10 client.25909 handle_command_reply: tid=0 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 client.25909 shutdown 2024-09-11T00:09:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 msgr2=0x559f2dfed120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfed120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005d70 tx=0x7f1a28027480 comp rx=0 tx=0).stop 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 shutdown_connections 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f2dfe8790 0x559f2dfed120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559f2e065b70 0x559f2e067f90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f2dfdc800 0x559f2dfecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 --2- 172.21.15.19:0/3161705435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f2dfdbee0 0x559f2dfec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 >> 172.21.15.19:0/3161705435 conn(0x559f2dfd9d10 msgr2=0x559f2dfe5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.573+0000 7f1a0ffff640 0 client.25909 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 shutdown_connections 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a390b2740 1 -- 172.21.15.19:0/3161705435 wait complete. 2024-09-11T00:09:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a390b2740 20 client.25909 trim_cache size 0 max 16384 2024-09-11T00:09:32.584 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:09:32.584 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:09:32.584 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008", 2024-09-11T00:09:32.584 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:09:32.584 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a200b54d0 msgr2=0x7f1a200b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a200b54d0 0x7f1a200b7990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a240e3a40 tx=0x7f1a240e9d40 comp rx=0 tx=0).stop 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30101c90 msgr2=0x7f1a30199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30101c90 0x7f1a30199250 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e9f0 tx=0x7f1a2400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 shutdown_connections 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a30108020 0x7f1a3019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a301076a0 0x7f1a30199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f1a200b54d0 0x7f1a200b7990 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 --2- 172.21.15.19:0/3483935538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a30101c90 0x7f1a30199250 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 >> 172.21.15.19:0/3483935538 conn(0x7f1a300fd700 msgr2=0x7f1a300ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:32.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 shutdown_connections 2024-09-11T00:09:32.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:32.574+0000 7f1a36cdd640 1 -- 172.21.15.19:0/3483935538 wait complete. 2024-09-11T00:09:32.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:32 smithi135 ceph-mon[35432]: pgmap v537: 97 pgs: 97 active+clean; 848 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 428 op/s 2024-09-11T00:09:32.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:32 smithi131 ceph-mon[35491]: pgmap v537: 97 pgs: 97 active+clean; 848 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 428 op/s 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:33 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:09:33.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:09:33.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:09:33.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:09:33.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:09:33.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:09:33.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:33 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:09:33.680 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:33.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:09:33.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:09:33.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:09:33.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:09:33.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:33.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:33 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:09:34.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 -- 172.21.15.19:0/4280884086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28103ca0 msgr2=0x7ffb28104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 --2- 172.21.15.19:0/4280884086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28103ca0 0x7ffb28104080 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009900 tx=0x7ffb2402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 -- 172.21.15.19:0/4280884086 shutdown_connections 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 --2- 172.21.15.19:0/4280884086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb2810d100 0x7ffb2810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 --2- 172.21.15.19:0/4280884086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb281045c0 0x7ffb2810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 --2- 172.21.15.19:0/4280884086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28103ca0 0x7ffb28104080 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 -- 172.21.15.19:0/4280884086 >> 172.21.15.19:0/4280884086 conn(0x7ffb280fd700 msgr2=0x7ffb280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 -- 172.21.15.19:0/4280884086 shutdown_connections 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.200+0000 7ffb30518640 1 -- 172.21.15.19:0/4280884086 wait complete. 2024-09-11T00:09:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 Processor -- start 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 -- start start 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb28103ca0 0x7ffb28101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb281045c0 0x7ffb28101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb2810d100 0x7ffb281023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28112d70 con 0x7ffb281045c0 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28112bf0 con 0x7ffb28103ca0 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb30518640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28112ef0 con 0x7ffb2810d100 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb281045c0 0x7ffb28101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb281045c0 0x7ffb28101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37906/0 (socket says 172.21.15.19:37906) 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 -- 172.21.15.19:0/30830274 learned_addr learned my addr 172.21.15.19:0/30830274 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2eab5640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb2810d100 0x7ffb281023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb28103ca0 0x7ffb28101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 -- 172.21.15.19:0/30830274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb2810d100 msgr2=0x7ffb281023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb2810d100 0x7ffb281023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 -- 172.21.15.19:0/30830274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb28103ca0 msgr2=0x7ffb28101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb28103ca0 0x7ffb28101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2dab3640 1 -- 172.21.15.19:0/30830274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb281a7600 con 0x7ffb281045c0 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2eab5640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb2810d100 0x7ffb281023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.201+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb28103ca0 0x7ffb28101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.202+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb281045c0 0x7ffb28101e90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800c970 tx=0x7ffb1800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.202+0000 7ffb1f7fe640 1 -- 172.21.15.19:0/30830274 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18007bb0 con 0x7ffb281045c0 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.202+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb281a78f0 con 0x7ffb281045c0 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.202+0000 7ffb1f7fe640 1 -- 172.21.15.19:0/30830274 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb18007d50 con 0x7ffb281045c0 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.202+0000 7ffb1f7fe640 1 -- 172.21.15.19:0/30830274 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800f720 con 0x7ffb281045c0 2024-09-11T00:09:34.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.202+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281a7e80 con 0x7ffb281045c0 2024-09-11T00:09:34.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.204+0000 7ffb328ed740 1 Processor -- start 2024-09-11T00:09:34.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb328ed740 1 -- start start 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb1f7fe640 1 -- 172.21.15.19:0/30830274 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7ffb1800f900 con 0x7ffb281045c0 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb328ed740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56028b919e50 con 0x56028b9afd30 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb328ed740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56028b909280 con 0x56028b9a3480 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb328ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56028b90d090 con 0x56028b9a3da0 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb2e2b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb2e2b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45298/0 (socket says 172.21.15.19:45298) 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb2eab5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb2e2b4640 1 -- 172.21.15.19:0/881202845 learned_addr learned my addr 172.21.15.19:0/881202845 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.205+0000 7ffb2eab5640 1 -- 172.21.15.19:0/881202845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 msgr2=0x56028b9af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb2eab5640 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb2eab5640 1 -- 172.21.15.19:0/881202845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 msgr2=0x56028b9b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb2eab5640 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb2eab5640 1 -- 172.21.15.19:0/881202845 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028b667650 con 0x56028b9a3480 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb2eab5640 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a3860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb20005fd0 tx=0x7ffb20009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d4e377d7f3f2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb1cff9640 1 -- 172.21.15.19:0/881202845 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20004d20 con 0x56028b9a3480 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb1f7fe640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ffb140b5450 0x7ffb140b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb1cff9640 1 -- 172.21.15.19:0/881202845 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb200119b0 con 0x56028b9a3480 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb1cff9640 1 -- 172.21.15.19:0/881202845 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200054e0 con 0x56028b9a3480 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ffb140b5450 0x7ffb140b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.206+0000 7ffb1f7fe640 1 -- 172.21.15.19:0/30830274 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7ffb180e6370 con 0x7ffb281045c0 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 -- 172.21.15.19:0/881202845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 msgr2=0x56028b9a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ffb140b5450 0x7ffb140b7910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56028b9a2190 tx=0x7ffb240058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a3860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb20005fd0 tx=0x7ffb20009f90 comp rx=0 tx=0).stop 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 -- 172.21.15.19:0/881202845 shutdown_connections 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 --2- 172.21.15.19:0/881202845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a3860 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 -- 172.21.15.19:0/881202845 >> 172.21.15.19:0/881202845 conn(0x56028b9a12b0 msgr2=0x56028b9a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 -- 172.21.15.19:0/881202845 shutdown_connections 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 -- 172.21.15.19:0/881202845 wait complete. 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.207+0000 7ffb328ed740 1 -- start start 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 1 Processor -- start 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56028b76a700 con 0x56028b9a3da0 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56028b8a4110 con 0x56028b9a3480 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56028b9b29b0 con 0x56028b9afd30 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb328ed740 10 client.0 _ll_register_callbacks cb 0x56028b8bd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37922/0 (socket says 172.21.15.19:37922) 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 -- 172.21.15.19:0/223755526 learned_addr learned my addr 172.21.15.19:0/223755526 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2eab5640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 -- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 msgr2=0x56028b9ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 -- 172.21.15.19:0/223755526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 msgr2=0x56028b9af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2dab3640 1 -- 172.21.15.19:0/223755526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028b8d1c40 con 0x56028b9a3da0 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.208+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9aca90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ffb180a9aa0 tx=0x7ffb18004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5405582d064748 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb11ffb640 1 -- 172.21.15.19:0/223755526 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb180ac600 con 0x56028b9a3da0 2024-09-11T00:09:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb200119b0 con 0x56028b9a3da0 2024-09-11T00:09:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb11ffb640 1 -- 172.21.15.19:0/223755526 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7ffb180b58a0 con 0x56028b9a3da0 2024-09-11T00:09:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb11ffb640 1 -- 172.21.15.19:0/223755526 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb180abfa0 con 0x56028b9a3da0 2024-09-11T00:09:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb328ed740 10 client.16350 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56028b9be3c0 con 0x56028b9a3da0 2024-09-11T00:09:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.209+0000 7ffb11ffb640 1 -- 172.21.15.19:0/223755526 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb200119b0 con 0x56028b9a3da0 2024-09-11T00:09:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb11ffb640 1 -- 172.21.15.19:0/223755526 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ffb180adb60 con 0x56028b9a3da0 2024-09-11T00:09:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb328ed740 10 client.16350 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb328ed740 10 client.16350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb328ed740 20 client.16350 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb328ed740 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028b9bf7d0 0x56028b9c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb328ed740 4 client.16350 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56028b91bda0 con 0x56028b9bf7d0 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.210+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028b9bf7d0 0x56028b9c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.211+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028b9bf7d0 0x56028b9c1bc0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83cd065a046a4 server_cookie=a4568000c483f767 in_seq=0 out_seq=0 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.211+0000 7ffb11ffb640 10 client.16350 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb11ffb640 1 -- 172.21.15.19:0/223755526 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56028b91bda0 con 0x56028b9bf7d0 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb11ffb640 10 client.16350 handle_command_reply: tid=0 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 client.16350 shutdown 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 msgr2=0x56028b9aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9aca90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ffb180a9aa0 tx=0x7ffb18004740 comp rx=0 tx=0).stop 2024-09-11T00:09:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 shutdown_connections 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028b9bf7d0 0x56028b9c1bc0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9aca90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 --2- 172.21.15.19:0/223755526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 >> 172.21.15.19:0/223755526 conn(0x56028b9a12b0 msgr2=0x56028b9a6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb11ffb640 0 client.16350 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 shutdown_connections 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 1 -- 172.21.15.19:0/223755526 wait complete. 2024-09-11T00:09:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.212+0000 7ffb328ed740 20 client.16350 trim_cache size 0 max 16384 2024-09-11T00:09:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 Processor -- start 2024-09-11T00:09:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 -- start start 2024-09-11T00:09:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9bbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281b3120 con 0x56028b9afd30 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281b0960 con 0x56028b9a3480 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb328ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ae7d0 con 0x56028b9a3da0 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2eab5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:50788/0 (socket says 172.21.15.19:50788) 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 -- 172.21.15.19:0/3206794279 learned_addr learned my addr 172.21.15.19:0/3206794279 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:34.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2dab3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9bbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 -- 172.21.15.19:0/3206794279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 msgr2=0x56028b9bbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/3206794279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9bbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 -- 172.21.15.19:0/3206794279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 msgr2=0x56028b9a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/3206794279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.231+0000 7ffb2e2b4640 1 -- 172.21.15.19:0/3206794279 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028b9a1f90 con 0x56028b9a3480 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.232+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/3206794279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a2a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb24032fd0 tx=0x7ffb2403e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cb68c5d769a33c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.232+0000 7ffb13fff640 1 -- 172.21.15.19:0/3206794279 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24035040 con 0x56028b9a3480 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.232+0000 7ffb13fff640 1 -- 172.21.15.19:0/3206794279 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24056070 con 0x56028b9a3480 2024-09-11T00:09:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.232+0000 7ffb13fff640 1 -- 172.21.15.19:0/3206794279 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24003850 con 0x56028b9a3480 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.232+0000 7ffb328ed740 1 -- 172.21.15.19:0/3206794279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 msgr2=0x56028b9a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.232+0000 7ffb328ed740 1 --2- 172.21.15.19:0/3206794279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a2a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb24032fd0 tx=0x7ffb2403e000 comp rx=0 tx=0).stop 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- 172.21.15.19:0/3206794279 shutdown_connections 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 --2- 172.21.15.19:0/3206794279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9afd30 0x56028b9a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 --2- 172.21.15.19:0/3206794279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9a3da0 0x56028b9bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 --2- 172.21.15.19:0/3206794279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9a2a80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- 172.21.15.19:0/3206794279 >> 172.21.15.19:0/3206794279 conn(0x56028b9a12b0 msgr2=0x56028b9a2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- 172.21.15.19:0/3206794279 shutdown_connections 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- 172.21.15.19:0/3206794279 wait complete. 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- start start 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 Processor -- start 2024-09-11T00:09:34.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281aee20 con 0x56028b9a3da0 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281b0290 con 0x56028b9a3480 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281af4f0 con 0x56028b9afd30 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb328ed740 10 client.0 _ll_register_callbacks cb 0x7ffb18018c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb2dab3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb2dab3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37928/0 (socket says 172.21.15.19:37928) 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.233+0000 7ffb2dab3640 1 -- 172.21.15.19:0/135086266 learned_addr learned my addr 172.21.15.19:0/135086266 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:09:34.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2eab5640 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2dab3640 1 -- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 msgr2=0x56028b9b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2dab3640 1 -- 172.21.15.19:0/135086266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 msgr2=0x56028b9b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2dab3640 1 -- 172.21.15.19:0/135086266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028ba2b8c0 con 0x56028b9a3da0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb2dab3640 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9b43b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffb180d1040 tx=0x7ffb180b5c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc89c05c3da304 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb11ffb640 1 -- 172.21.15.19:0/135086266 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb180ac180 con 0x56028b9a3da0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb11ffb640 1 -- 172.21.15.19:0/135086266 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7ffb180cfcf0 con 0x56028b9a3da0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb24056070 con 0x56028b9a3da0 2024-09-11T00:09:34.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb11ffb640 1 -- 172.21.15.19:0/135086266 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb180ac600 con 0x56028b9a3da0 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb328ed740 10 client.16356 fetch_fsmap learned FSMap version 35 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.234+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56028ba2cb90 con 0x56028b9a3da0 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb11ffb640 1 -- 172.21.15.19:0/135086266 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24056070 con 0x56028b9a3da0 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb11ffb640 1 -- 172.21.15.19:0/135086266 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ffb180ab500 con 0x56028b9a3da0 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb328ed740 10 client.16356 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb328ed740 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb328ed740 20 client.16356 populate_metadata read hostname 'smithi019' 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb328ed740 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028ba2d340 0x56028ba2f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb328ed740 4 client.16356 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56028b917850 con 0x56028ba2d340 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.235+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028ba2d340 0x56028ba2f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb11ffb640 10 client.16356 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:34.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb2e2b4640 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028ba2d340 0x56028ba2f760 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c7b60757e06b364 server_cookie=dab9bb63c497c7c1 in_seq=0 out_seq=0 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb11ffb640 1 -- 172.21.15.19:0/135086266 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x56028b917850 con 0x56028ba2d340 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb11ffb640 10 client.16356 handle_command_reply: tid=0 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 client.16356 shutdown 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 msgr2=0x56028b9b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9b43b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffb180d1040 tx=0x7ffb180b5c30 comp rx=0 tx=0).stop 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 shutdown_connections 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56028b9afd30 0x56028b9b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56028ba2d340 0x56028ba2f760 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028b9a3da0 0x56028b9b43b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb11ffb640 0 client.16356 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 --2- 172.21.15.19:0/135086266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56028b9a3480 0x56028b9b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 >> 172.21.15.19:0/135086266 conn(0x56028b9a12b0 msgr2=0x56028b99fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:34.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 shutdown_connections 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 1 -- 172.21.15.19:0/135086266 wait complete. 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.236+0000 7ffb328ed740 20 client.16356 trim_cache size 0 max 16384 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008", 2024-09-11T00:09:34.248 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.249 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.252 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:09:34.254 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:09:34.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ffb140b5450 msgr2=0x7ffb140b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ffb140b5450 0x7ffb140b7910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56028b9a2190 tx=0x7ffb240058b0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb281045c0 msgr2=0x7ffb28101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:34.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb281045c0 0x7ffb28101e90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800c970 tx=0x7ffb1800ce30 comp rx=0 tx=0).stop 2024-09-11T00:09:34.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 shutdown_connections 2024-09-11T00:09:34.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb2810d100 0x7ffb281023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ffb140b5450 0x7ffb140b7910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb281045c0 0x7ffb28101e90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 --2- 172.21.15.19:0/30830274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb28103ca0 0x7ffb28101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:34.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 >> 172.21.15.19:0/30830274 conn(0x7ffb280fd700 msgr2=0x7ffb2810f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:34.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 shutdown_connections 2024-09-11T00:09:34.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:09:34.237+0000 7ffb30518640 1 -- 172.21.15.19:0/30830274 wait complete. 2024-09-11T00:09:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:34 smithi019 ceph-mon[30859]: pgmap v538: 97 pgs: 97 active+clean; 842 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 574 op/s 2024-09-11T00:09:34.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:34 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:34.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:34 smithi135 ceph-mon[35432]: pgmap v538: 97 pgs: 97 active+clean; 842 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 574 op/s 2024-09-11T00:09:34.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:34 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:34.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:34 smithi131 ceph-mon[35491]: pgmap v538: 97 pgs: 97 active+clean; 842 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 574 op/s 2024-09-11T00:09:34.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:34 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:35.045 INFO:tasks.cephfs.filesystem:scrub status for tag:f5d8d3b3-9cd5-497e-b0c3-20c5b3183008 - {'path': '/', 'tag': 'f5d8d3b3-9cd5-497e-b0c3-20c5b3183008', 'options': 'recursive,force'} 2024-09-11T00:09:36.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:36 smithi135 ceph-mon[35432]: pgmap v539: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 537 op/s 2024-09-11T00:09:36.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:36 smithi019 ceph-mon[30859]: pgmap v539: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 537 op/s 2024-09-11T00:09:36.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:36 smithi131 ceph-mon[35491]: pgmap v539: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 537 op/s 2024-09-11T00:09:38.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:38 smithi135 ceph-mon[35432]: pgmap v540: 97 pgs: 97 active+clean; 834 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 667 op/s 2024-09-11T00:09:38.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:38 smithi019 ceph-mon[30859]: pgmap v540: 97 pgs: 97 active+clean; 834 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 667 op/s 2024-09-11T00:09:38.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:38 smithi131 ceph-mon[35491]: pgmap v540: 97 pgs: 97 active+clean; 834 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 667 op/s 2024-09-11T00:09:40.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:40 smithi135 ceph-mon[35432]: pgmap v541: 97 pgs: 97 active+clean; 836 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 755 op/s 2024-09-11T00:09:40.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:40 smithi019 ceph-mon[30859]: pgmap v541: 97 pgs: 97 active+clean; 836 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 755 op/s 2024-09-11T00:09:40.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:40 smithi131 ceph-mon[35491]: pgmap v541: 97 pgs: 97 active+clean; 836 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 755 op/s 2024-09-11T00:09:42.604 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:42 smithi131 ceph-mon[35491]: pgmap v542: 97 pgs: 97 active+clean; 840 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 729 op/s 2024-09-11T00:09:42.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:42 smithi135 ceph-mon[35432]: pgmap v542: 97 pgs: 97 active+clean; 840 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 729 op/s 2024-09-11T00:09:42.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:42 smithi019 ceph-mon[30859]: pgmap v542: 97 pgs: 97 active+clean; 840 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 729 op/s 2024-09-11T00:09:44.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:44 smithi135 ceph-mon[35432]: pgmap v543: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 818 op/s 2024-09-11T00:09:44.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:44 smithi019 ceph-mon[30859]: pgmap v543: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 818 op/s 2024-09-11T00:09:44.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:44 smithi131 ceph-mon[35491]: pgmap v543: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 818 op/s 2024-09-11T00:09:46.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:46 smithi135 ceph-mon[35432]: pgmap v544: 97 pgs: 97 active+clean; 850 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 667 op/s 2024-09-11T00:09:46.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:46 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:46.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:46 smithi019 ceph-mon[30859]: pgmap v544: 97 pgs: 97 active+clean; 850 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 667 op/s 2024-09-11T00:09:46.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:46 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:46.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:46 smithi131 ceph-mon[35491]: pgmap v544: 97 pgs: 97 active+clean; 850 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 667 op/s 2024-09-11T00:09:46.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:46 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:09:48.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:48 smithi135 ceph-mon[35432]: pgmap v545: 97 pgs: 97 active+clean; 851 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 745 op/s 2024-09-11T00:09:48.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:48 smithi019 ceph-mon[30859]: pgmap v545: 97 pgs: 97 active+clean; 851 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 745 op/s 2024-09-11T00:09:48.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:48 smithi131 ceph-mon[35491]: pgmap v545: 97 pgs: 97 active+clean; 851 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 745 op/s 2024-09-11T00:09:50.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:50 smithi135 ceph-mon[35432]: pgmap v546: 97 pgs: 97 active+clean; 853 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 733 op/s 2024-09-11T00:09:50.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:50 smithi019 ceph-mon[30859]: pgmap v546: 97 pgs: 97 active+clean; 853 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 733 op/s 2024-09-11T00:09:50.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:50 smithi131 ceph-mon[35491]: pgmap v546: 97 pgs: 97 active+clean; 853 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 733 op/s 2024-09-11T00:09:52.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:52 smithi135 ceph-mon[35432]: pgmap v547: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 644 op/s 2024-09-11T00:09:52.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:52 smithi019 ceph-mon[30859]: pgmap v547: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 644 op/s 2024-09-11T00:09:52.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:52 smithi131 ceph-mon[35491]: pgmap v547: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 644 op/s 2024-09-11T00:09:54.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:54 smithi135 ceph-mon[35432]: pgmap v548: 97 pgs: 97 active+clean; 834 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 717 op/s 2024-09-11T00:09:54.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:54 smithi019 ceph-mon[30859]: pgmap v548: 97 pgs: 97 active+clean; 834 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 717 op/s 2024-09-11T00:09:54.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:54 smithi131 ceph-mon[35491]: pgmap v548: 97 pgs: 97 active+clean; 834 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 717 op/s 2024-09-11T00:09:55.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:55 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:09:55.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:55 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:09:55.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:55 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:09:56.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:56 smithi135 ceph-mon[35432]: pgmap v549: 97 pgs: 97 active+clean; 839 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 601 op/s 2024-09-11T00:09:56.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:56 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:09:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:56 smithi019 ceph-mon[30859]: pgmap v549: 97 pgs: 97 active+clean; 839 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 601 op/s 2024-09-11T00:09:56.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:56 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:09:56.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:56 smithi131 ceph-mon[35491]: pgmap v549: 97 pgs: 97 active+clean; 839 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 601 op/s 2024-09-11T00:09:56.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:56 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:09:58.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:09:58 smithi135 ceph-mon[35432]: pgmap v550: 97 pgs: 97 active+clean; 843 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 663 op/s 2024-09-11T00:09:58.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:09:58 smithi019 ceph-mon[30859]: pgmap v550: 97 pgs: 97 active+clean; 843 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 663 op/s 2024-09-11T00:09:58.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:09:58 smithi131 ceph-mon[35491]: pgmap v550: 97 pgs: 97 active+clean; 843 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 663 op/s 2024-09-11T00:10:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:00 smithi135 ceph-mon[35432]: pgmap v551: 97 pgs: 97 active+clean; 851 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 616 op/s 2024-09-11T00:10:00.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:00 smithi135 ceph-mon[35432]: overall HEALTH_OK 2024-09-11T00:10:00.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:00 smithi019 ceph-mon[30859]: pgmap v551: 97 pgs: 97 active+clean; 851 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 616 op/s 2024-09-11T00:10:00.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:00 smithi019 ceph-mon[30859]: overall HEALTH_OK 2024-09-11T00:10:00.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:00 smithi131 ceph-mon[35491]: pgmap v551: 97 pgs: 97 active+clean; 851 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 616 op/s 2024-09-11T00:10:00.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:00 smithi131 ceph-mon[35491]: overall HEALTH_OK 2024-09-11T00:10:02.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:02 smithi135 ceph-mon[35432]: pgmap v552: 97 pgs: 97 active+clean; 864 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 510 op/s 2024-09-11T00:10:02.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:02 smithi019 ceph-mon[30859]: pgmap v552: 97 pgs: 97 active+clean; 864 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 510 op/s 2024-09-11T00:10:02.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:02 smithi131 ceph-mon[35491]: pgmap v552: 97 pgs: 97 active+clean; 864 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 510 op/s 2024-09-11T00:10:04.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:04 smithi135 ceph-mon[35432]: pgmap v553: 97 pgs: 97 active+clean; 860 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 536 op/s 2024-09-11T00:10:04.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:04.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:04 smithi019 ceph-mon[30859]: pgmap v553: 97 pgs: 97 active+clean; 860 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 536 op/s 2024-09-11T00:10:04.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:04.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:04 smithi131 ceph-mon[35491]: pgmap v553: 97 pgs: 97 active+clean; 860 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 536 op/s 2024-09-11T00:10:04.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:05.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:10:05.344 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:05.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-11T00:10:05.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:05.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:05.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:05.762 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:05.763 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:10:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-11T00:10:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:10:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.854+0000 7f49bd80d640 1 -- 172.21.15.19:0/1483599214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 msgr2=0x7f49b8107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.854+0000 7f49bd80d640 1 --2- 172.21.15.19:0/1483599214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 0x7f49b8107c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009900 tx=0x7f49a802a410 comp rx=0 tx=0).stop 2024-09-11T00:10:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.854+0000 7f49bd80d640 1 -- 172.21.15.19:0/1483599214 shutdown_connections 2024-09-11T00:10:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.855+0000 7f49bd80d640 1 --2- 172.21.15.19:0/1483599214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b8106f50 0x7f49b810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.855+0000 7f49bd80d640 1 --2- 172.21.15.19:0/1483599214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b81065d0 0x7f49b8106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.855+0000 7f49bd80d640 1 --2- 172.21.15.19:0/1483599214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 0x7f49b8107c90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.855+0000 7f49bd80d640 1 -- 172.21.15.19:0/1483599214 >> 172.21.15.19:0/1483599214 conn(0x7f49b80fca20 msgr2=0x7f49b80fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.855+0000 7f49bd80d640 1 -- 172.21.15.19:0/1483599214 shutdown_connections 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.855+0000 7f49bd80d640 1 -- 172.21.15.19:0/1483599214 wait complete. 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.855+0000 7f49bd80d640 1 Processor -- start 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49bd80d640 1 -- start start 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49bd80d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b81065d0 0x7f49b819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49bd80d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b8106f50 0x7f49b819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49bd80d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 0x7f49b81a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49bd80d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49b8110be0 con 0x7f49b8106f50 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49bd80d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49b8110a60 con 0x7f49b81078b0 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49bd80d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49b8110d60 con 0x7f49b81065d0 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b8106f50 0x7f49b819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b81065d0 0x7f49b819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49b77fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 0x7f49b81a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b8106f50 0x7f49b819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48054/0 (socket says 172.21.15.19:48054) 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b81065d0 0x7f49b819b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:34056/0 (socket says 172.21.15.19:34056) 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.856+0000 7f49b67fc640 1 -- 172.21.15.19:0/3894527742 learned_addr learned my addr 172.21.15.19:0/3894527742 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49b77fe640 1 -- 172.21.15.19:0/3894527742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b81065d0 msgr2=0x7f49b819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49b77fe640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b81065d0 0x7f49b819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49b77fe640 1 -- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b8106f50 msgr2=0x7f49b819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49b77fe640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b8106f50 0x7f49b819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49b77fe640 1 -- 172.21.15.19:0/3894527742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b81a1560 con 0x7f49b81078b0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b8106f50 0x7f49b819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49b77fe640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 0x7f49b81a0d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49b0005fd0 tx=0x7f49b00071c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49bc80b640 1 -- 172.21.15.19:0/3894527742 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0007bd0 con 0x7f49b81078b0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49bc80b640 1 -- 172.21.15.19:0/3894527742 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49b0007d70 con 0x7f49b81078b0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b81a1850 con 0x7f49b81078b0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49bc80b640 1 -- 172.21.15.19:0/3894527742 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0014410 con 0x7f49b81078b0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.857+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b81a7f10 con 0x7f49b81078b0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bc80b640 1 -- 172.21.15.19:0/3894527742 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f49b0005190 con 0x7f49b81078b0 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 Processor -- start 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 -- start start 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040a480 0x55759040a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x5575904167f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x557590419120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557590380e50 con 0x55759040a480 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557590370280 con 0x55759040ada0 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557590374090 con 0x557590416d30 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.860+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040a480 0x55759040a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x5575904167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040a480 0x55759040a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48062/0 (socket says 172.21.15.19:48062) 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 -- 172.21.15.19:0/3663524743 learned_addr learned my addr 172.21.15.19:0/3663524743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x557590419120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49bc80b640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a40b54d0 0x7f49a40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 -- 172.21.15.19:0/3663524743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 msgr2=0x557590419120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x557590419120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 -- 172.21.15.19:0/3663524743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 msgr2=0x5575904167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x5575904167f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 -- 172.21.15.19:0/3663524743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575900ce650 con 0x55759040a480 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49bc80b640 1 -- 172.21.15.19:0/3894527742 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f49b00e5620 con 0x7f49b81078b0 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b77fe640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a40b54d0 0x7f49a40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.861+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040a480 0x55759040a860 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f49a0013cd0 tx=0x7f49a0009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67481df5c25b173 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49adffb640 1 -- 172.21.15.19:0/3663524743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0013dc0 con 0x55759040a480 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49adffb640 1 -- 172.21.15.19:0/3663524743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49a0013120 con 0x55759040a480 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49adffb640 1 -- 172.21.15.19:0/3663524743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a00039b0 con 0x55759040a480 2024-09-11T00:10:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3663524743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040a480 msgr2=0x55759040a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49b77fe640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a40b54d0 0x7f49a40b7990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49b000afd0 tx=0x7f49b0005530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040a480 0x55759040a860 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f49a0013cd0 tx=0x7f49a0009c10 comp rx=0 tx=0).stop 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3663524743 shutdown_connections 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x557590419120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x5575904167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3663524743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040a480 0x55759040a860 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3663524743 >> 172.21.15.19:0/3663524743 conn(0x5575904082b0 msgr2=0x557590409450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.862+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3663524743 shutdown_connections 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.863+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3663524743 wait complete. 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.863+0000 7f49bfbe2740 1 -- start start 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.863+0000 7f49bfbe2740 1 Processor -- start 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040a480 0x557590416650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x557590413aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x5575904140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5575901d1700 con 0x55759040ada0 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55759030b110 con 0x55759040a480 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557590419950 con 0x557590416d30 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49bfbe2740 10 client.0 _ll_register_callbacks cb 0x557590324990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x557590413aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x557590413aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48076/0 (socket says 172.21.15.19:48076) 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 -- 172.21.15.19:0/3252909543 learned_addr learned my addr 172.21.15.19:0/3252909543 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x5575904140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040a480 0x557590416650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 -- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 msgr2=0x5575904140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x5575904140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 -- 172.21.15.19:0/3252909543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040a480 msgr2=0x557590416650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040a480 0x557590416650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 -- 172.21.15.19:0/3252909543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557590338c40 con 0x55759040ada0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x557590413aa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009900 tx=0x7f49a80314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8b572781e2c5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.864+0000 7f4996ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f4996ffd640 1 -- 172.21.15.19:0/3252909543 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8035040 con 0x55759040ada0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f4996ffd640 1 -- 172.21.15.19:0/3252909543 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f49a8031810 con 0x55759040ada0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49a0013120 con 0x55759040ada0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f4996ffd640 1 -- 172.21.15.19:0/3252909543 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f49a8004040 con 0x55759040ada0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 10 client.16368 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5575904252b0 con 0x55759040ada0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f4996ffd640 1 -- 172.21.15.19:0/3252909543 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49a0013120 con 0x55759040ada0 2024-09-11T00:10:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f4996ffd640 1 -- 172.21.15.19:0/3252909543 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f49a8004880 con 0x55759040ada0 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 10 client.16368 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 20 client.16368 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575904266c0 0x557590428b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 4 client.16368 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.865+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557590382da0 con 0x5575904266c0 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.866+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575904266c0 0x557590428b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.866+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575904266c0 0x557590428b20 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6384a633a56613b6 server_cookie=6eae9173d2e6214f in_seq=0 out_seq=0 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.866+0000 7f4996ffd640 10 client.16368 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.867+0000 7f4996ffd640 1 -- 172.21.15.19:0/3252909543 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557590382da0 con 0x5575904266c0 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.867+0000 7f4996ffd640 10 client.16368 handle_command_reply: tid=0 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.867+0000 7f49bfbe2740 1 client.16368 shutdown 2024-09-11T00:10:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.867+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 msgr2=0x557590413aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x557590413aa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009900 tx=0x7f49a80314a0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 shutdown_connections 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557590416d30 0x5575904140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5575904266c0 0x557590428b20 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x557590413aa0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3252909543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040a480 0x557590416650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 >> 172.21.15.19:0/3252909543 conn(0x5575904082b0 msgr2=0x55759040de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f4996ffd640 0 client.16368 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 shutdown_connections 2024-09-11T00:10:05.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3252909543 wait complete. 2024-09-11T00:10:05.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.868+0000 7f49bfbe2740 20 client.16368 trim_cache size 0 max 16384 2024-09-11T00:10:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.889+0000 7f49bfbe2740 1 Processor -- start 2024-09-11T00:10:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.889+0000 7f49bfbe2740 1 -- start start 2024-09-11T00:10:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.889+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x5575904032d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x557590409370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590416d30 0x5575904098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81b30b0 con 0x557590416d30 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81b08f0 con 0x55759040ada0 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81ae760 con 0x55759040a480 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590416d30 0x5575904098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590416d30 0x5575904098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48088/0 (socket says 172.21.15.19:48088) 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 -- 172.21.15.19:0/617169638 learned_addr learned my addr 172.21.15.19:0/617169638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x5575904032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x557590409370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 -- 172.21.15.19:0/617169638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 msgr2=0x5575904032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x5575904032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 -- 172.21.15.19:0/617169638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 msgr2=0x557590409370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x557590409370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 -- 172.21.15.19:0/617169638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557590414440 con 0x557590416d30 2024-09-11T00:10:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x557590409370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.890+0000 7f49b67fc640 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590416d30 0x5575904098b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006010 tx=0x7f49a000ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de41191a0ead45a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49ad7fa640 1 -- 172.21.15.19:0/617169638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0013460 con 0x557590416d30 2024-09-11T00:10:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49ad7fa640 1 -- 172.21.15.19:0/617169638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49a0005570 con 0x557590416d30 2024-09-11T00:10:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49ad7fa640 1 -- 172.21.15.19:0/617169638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0003d10 con 0x557590416d30 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49bfbe2740 1 -- 172.21.15.19:0/617169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590416d30 msgr2=0x5575904098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590416d30 0x5575904098b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006010 tx=0x7f49a000ff40 comp rx=0 tx=0).stop 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49bfbe2740 1 -- 172.21.15.19:0/617169638 shutdown_connections 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590416d30 0x5575904098b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55759040ada0 0x557590409370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/617169638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x5575904032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.891+0000 7f49bfbe2740 1 -- 172.21.15.19:0/617169638 >> 172.21.15.19:0/617169638 conn(0x5575904082b0 msgr2=0x55759040ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.892+0000 7f49bfbe2740 1 -- 172.21.15.19:0/617169638 shutdown_connections 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.892+0000 7f49bfbe2740 1 -- 172.21.15.19:0/617169638 wait complete. 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.892+0000 7f49bfbe2740 1 -- start start 2024-09-11T00:10:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.892+0000 7f49bfbe2740 1 Processor -- start 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x55759042ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x55759041ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49bfbe2740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557590416d30 0x55759041f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81aedb0 con 0x55759040ada0 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81b0220 con 0x557590416d30 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49bfbe2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81af480 con 0x55759040a480 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49bfbe2740 10 client.0 _ll_register_callbacks cb 0x7f49a8005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x55759042ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x55759041ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x55759042ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:34086/0 (socket says 172.21.15.19:34086) 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x55759041ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48104/0 (socket says 172.21.15.19:48104) 2024-09-11T00:10:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b67fc640 1 -- 172.21.15.19:0/3990719287 learned_addr learned my addr 172.21.15.19:0/3990719287 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557590416d30 0x55759041f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 -- 172.21.15.19:0/3990719287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 msgr2=0x55759042ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x55759042ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 -- 172.21.15.19:0/3990719287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557590416d30 msgr2=0x55759041f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557590416d30 0x55759041f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 -- 172.21.15.19:0/3990719287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557590419c50 con 0x55759040ada0 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f49b6ffd640 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x55759041ec30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f49a8006010 tx=0x7f49a8032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41e24f67da398b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.893+0000 7f4996ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f4996ffd640 1 -- 172.21.15.19:0/3990719287 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8035040 con 0x55759040ada0 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f4996ffd640 1 -- 172.21.15.19:0/3990719287 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7f49a8031510 con 0x55759040ada0 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49a0005570 con 0x55759040ada0 2024-09-11T00:10:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f4996ffd640 1 -- 172.21.15.19:0/3990719287 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f49a80038f0 con 0x55759040ada0 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 10 client.16374 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5575904939c0 con 0x55759040ada0 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f4996ffd640 1 -- 172.21.15.19:0/3990719287 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49a0005570 con 0x55759040ada0 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f4996ffd640 1 -- 172.21.15.19:0/3990719287 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f49a8005330 con 0x55759040ada0 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 10 client.16374 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 20 client.16374 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557590494170 0x557590496590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 4 client.16374 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.894+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55759037e850 con 0x557590494170 2024-09-11T00:10:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.895+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557590494170 0x557590496590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.895+0000 7f4996ffd640 10 client.16374 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.895+0000 7f49b67fc640 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557590494170 0x557590496590 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e302c6710a5ceaa8 server_cookie=5b0c2b938bd27720 in_seq=0 out_seq=0 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.895+0000 7f4996ffd640 1 -- 172.21.15.19:0/3990719287 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55759037e850 con 0x557590494170 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.895+0000 7f4996ffd640 10 client.16374 handle_command_reply: tid=0 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.895+0000 7f49bfbe2740 1 client.16374 shutdown 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 msgr2=0x55759041ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x55759041ec30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f49a8006010 tx=0x7f49a8032f90 comp rx=0 tx=0).stop 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 shutdown_connections 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557590416d30 0x55759041f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x557590494170 0x557590496590 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55759040ada0 0x55759041ec30 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 --2- 172.21.15.19:0/3990719287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55759040a480 0x55759042ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 >> 172.21.15.19:0/3990719287 conn(0x5575904082b0 msgr2=0x557590409370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f4996ffd640 0 client.16374 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 shutdown_connections 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 1 -- 172.21.15.19:0/3990719287 wait complete. 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.896+0000 7f49bfbe2740 20 client.16374 trim_cache size 0 max 16384 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:10:05.903 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.904 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.905 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.906 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.907 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.908 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:05.909 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:05.910 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:05.910 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:10:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a40b54d0 msgr2=0x7f49a40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a40b54d0 0x7f49a40b7990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49b000afd0 tx=0x7f49b0005530 comp rx=0 tx=0).stop 2024-09-11T00:10:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 msgr2=0x7f49b81a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 0x7f49b81a0d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49b0005fd0 tx=0x7f49b00071c0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 shutdown_connections 2024-09-11T00:10:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b81078b0 0x7f49b81a0d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a40b54d0 0x7f49a40b7990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b8106f50 0x7f49b819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 --2- 172.21.15.19:0/3894527742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b81065d0 0x7f49b819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 >> 172.21.15.19:0/3894527742 conn(0x7f49b80fca20 msgr2=0x7f49b80fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 shutdown_connections 2024-09-11T00:10:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:05.897+0000 7f49bd80d640 1 -- 172.21.15.19:0/3894527742 wait complete. 2024-09-11T00:10:06.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:06 smithi135 ceph-mon[35432]: Adjusting osd_memory_target on smithi131 to 176.0M 2024-09-11T00:10:06.675 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:06 smithi135 ceph-mon[35432]: Unable to set osd_memory_target on smithi131 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T00:10:06.676 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:06 smithi135 ceph-mon[35432]: pgmap v554: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-11T00:10:06.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:06 smithi019 ceph-mon[30859]: Adjusting osd_memory_target on smithi131 to 176.0M 2024-09-11T00:10:06.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:06 smithi019 ceph-mon[30859]: Unable to set osd_memory_target on smithi131 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T00:10:06.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:06 smithi019 ceph-mon[30859]: pgmap v554: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-11T00:10:06.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:06 smithi131 ceph-mon[35491]: Adjusting osd_memory_target on smithi131 to 176.0M 2024-09-11T00:10:06.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:06 smithi131 ceph-mon[35491]: Unable to set osd_memory_target on smithi131 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T00:10:06.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:06 smithi131 ceph-mon[35491]: pgmap v554: 97 pgs: 97 active+clean; 846 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-11T00:10:06.813 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:10:06.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:10:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:07.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.628+0000 7fef9287b640 1 -- 172.21.15.19:0/1137796331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 msgr2=0x7fef8c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.628+0000 7fef9287b640 1 --2- 172.21.15.19:0/1137796331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c1031a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009900 tx=0x7fef7c02a410 comp rx=0 tx=0).stop 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 -- 172.21.15.19:0/1137796331 shutdown_connections 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 --2- 172.21.15.19:0/1137796331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c109150 0x7fef8c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 --2- 172.21.15.19:0/1137796331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8c1087d0 0x7fef8c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 --2- 172.21.15.19:0/1137796331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c1031a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 -- 172.21.15.19:0/1137796331 >> 172.21.15.19:0/1137796331 conn(0x7fef8c0fe870 msgr2=0x7fef8c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 -- 172.21.15.19:0/1137796331 shutdown_connections 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 -- 172.21.15.19:0/1137796331 wait complete. 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 Processor -- start 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.629+0000 7fef9287b640 1 -- start start 2024-09-11T00:10:07.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef9287b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef9287b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8c1087d0 0x7fef8c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef9287b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c109150 0x7fef8c19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef9287b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c112e10 con 0x7fef8c102dc0 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef9287b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c112c90 con 0x7fef8c1087d0 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef9287b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c112f90 con 0x7fef8c109150 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48124/0 (socket says 172.21.15.19:48124) 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 -- 172.21.15.19:0/3793252900 learned_addr learned my addr 172.21.15.19:0/3793252900 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef90e18640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c109150 0x7fef8c19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8b7fe640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8c1087d0 0x7fef8c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 -- 172.21.15.19:0/3793252900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c109150 msgr2=0x7fef8c19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c109150 0x7fef8c19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 -- 172.21.15.19:0/3793252900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8c1087d0 msgr2=0x7fef8c1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8c1087d0 0x7fef8c1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 -- 172.21.15.19:0/3793252900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c19f430 con 0x7fef8c102dc0 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef90e18640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c109150 0x7fef8c19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8b7fe640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8c1087d0 0x7fef8c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef8bfff640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c199380 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fef7c005940 tx=0x7fef7c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.630+0000 7fef897fa640 1 -- 172.21.15.19:0/3793252900 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c03f030 con 0x7fef8c102dc0 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.631+0000 7fef9287b640 1 -- 172.21.15.19:0/3793252900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c19f6c0 con 0x7fef8c102dc0 2024-09-11T00:10:07.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.631+0000 7fef897fa640 1 -- 172.21.15.19:0/3793252900 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef7c0044c0 con 0x7fef8c102dc0 2024-09-11T00:10:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.631+0000 7fef897fa640 1 -- 172.21.15.19:0/3793252900 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c035070 con 0x7fef8c102dc0 2024-09-11T00:10:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.631+0000 7fef9287b640 1 -- 172.21.15.19:0/3793252900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c1a5de0 con 0x7fef8c102dc0 2024-09-11T00:10:07.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.632+0000 7fef9287b640 1 -- 172.21.15.19:0/3793252900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef8c1031a0 con 0x7fef8c102dc0 2024-09-11T00:10:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.633+0000 7fef897fa640 1 -- 172.21.15.19:0/3793252900 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fef7c03b9d0 con 0x7fef8c102dc0 2024-09-11T00:10:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.634+0000 7fef897fa640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fef740b5450 0x7fef740b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.634+0000 7fef8b7fe640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fef740b5450 0x7fef740b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.634+0000 7fef897fa640 1 -- 172.21.15.19:0/3793252900 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7fef7c106900 con 0x7fef8c102dc0 2024-09-11T00:10:07.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.635+0000 7fef8b7fe640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fef740b5450 0x7fef740b7910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0ffcd0 tx=0x7fef80005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:07.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.637+0000 7fef897fa640 1 -- 172.21.15.19:0/3793252900 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fef7c0cd4d0 con 0x7fef8c102dc0 2024-09-11T00:10:07.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:07 smithi019 ceph-mon[30859]: pgmap v555: 97 pgs: 97 active+clean; 838 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 458 op/s 2024-09-11T00:10:07.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:07 smithi131 ceph-mon[35491]: pgmap v555: 97 pgs: 97 active+clean; 838 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 458 op/s 2024-09-11T00:10:07.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.865+0000 7fef9287b640 1 -- 172.21.15.19:0/3793252900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef8c10af30 con 0x7fef8c102dc0 2024-09-11T00:10:07.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.871+0000 7fef897fa640 1 -- 172.21.15.19:0/3793252900 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11920 (secure 0 0 0) 0x7fef7c0ccdd0 con 0x7fef8c102dc0 2024-09-11T00:10:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:10:07.874 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":35,"btime":"2024-09-11T00:09:15:303339+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:09:15.054686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:10:07.874 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 35 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.875+0000 7fef72ffd640 1 -- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fef740b5450 msgr2=0x7fef740b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.875+0000 7fef72ffd640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fef740b5450 0x7fef740b7910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0ffcd0 tx=0x7fef80005f90 comp rx=0 tx=0).stop 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.875+0000 7fef72ffd640 1 -- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 msgr2=0x7fef8c199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.875+0000 7fef72ffd640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c199380 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fef7c005940 tx=0x7fef7c0040c0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.876+0000 7fef72ffd640 1 -- 172.21.15.19:0/3793252900 shutdown_connections 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.876+0000 7fef72ffd640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c109150 0x7fef8c19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.876+0000 7fef72ffd640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8c1087d0 0x7fef8c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.876+0000 7fef72ffd640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fef740b5450 0x7fef740b7910 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.876+0000 7fef72ffd640 1 --2- 172.21.15.19:0/3793252900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef8c102dc0 0x7fef8c199380 secure :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fef7c005940 tx=0x7fef7c0040c0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.876+0000 7fef72ffd640 1 -- 172.21.15.19:0/3793252900 >> 172.21.15.19:0/3793252900 conn(0x7fef8c0fe870 msgr2=0x7fef8c100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.877+0000 7fef72ffd640 1 -- 172.21.15.19:0/3793252900 shutdown_connections 2024-09-11T00:10:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:07.877+0000 7fef72ffd640 1 -- 172.21.15.19:0/3793252900 wait complete. 2024-09-11T00:10:07.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:07 smithi135 ceph-mon[35432]: pgmap v555: 97 pgs: 97 active+clean; 838 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 458 op/s 2024-09-11T00:10:08.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:08 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3793252900' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:08.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:10:08.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:08 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3793252900' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:08.826 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:08 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3793252900' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:08.869 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1594362882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618101c90 msgr2=0x7fd618102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1594362882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618101c90 0x7fd618102070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd600009900 tx=0x7fd60002a420 comp rx=0 tx=0).stop 2024-09-11T00:10:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1594362882 shutdown_connections 2024-09-11T00:10:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1594362882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618108020 0x7fd61810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1594362882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6181076a0 0x7fd618107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1594362882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618101c90 0x7fd618102070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1594362882 >> 172.21.15.19:0/1594362882 conn(0x7fd6180fd700 msgr2=0x7fd6180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1594362882 shutdown_connections 2024-09-11T00:10:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.430+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1594362882 wait complete. 2024-09-11T00:10:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.431+0000 7fd61dfa3640 1 Processor -- start 2024-09-11T00:10:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd61dfa3640 1 -- start start 2024-09-11T00:10:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd61dfa3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618101c90 0x7fd618108810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd61dfa3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6181076a0 0x7fd618108d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd61dfa3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618108020 0x7fd618109290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd61dfa3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd618112e00 con 0x7fd6181076a0 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd61dfa3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd618112c80 con 0x7fd618108020 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd61dfa3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd618112f80 con 0x7fd618101c90 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd6177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618101c90 0x7fd618108810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd6177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618101c90 0x7fd618108810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:34136/0 (socket says 172.21.15.19:34136) 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.432+0000 7fd6177fe640 1 -- 172.21.15.19:0/1799061298 learned_addr learned my addr 172.21.15.19:0/1799061298 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd616ffd640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6181076a0 0x7fd618108d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd617fff640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618108020 0x7fd618109290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd616ffd640 1 -- 172.21.15.19:0/1799061298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618101c90 msgr2=0x7fd618108810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd616ffd640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618101c90 0x7fd618108810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd616ffd640 1 -- 172.21.15.19:0/1799061298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618108020 msgr2=0x7fd618109290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd616ffd640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618108020 0x7fd618109290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd616ffd640 1 -- 172.21.15.19:0/1799061298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6181abb40 con 0x7fd6181076a0 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd617fff640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618108020 0x7fd618109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.433+0000 7fd6177fe640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618101c90 0x7fd618108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.434+0000 7fd616ffd640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6181076a0 0x7fd618108d50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd60800d6d0 tx=0x7fd60800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.434+0000 7fd614ff9640 1 -- 172.21.15.19:0/1799061298 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608017070 con 0x7fd6181076a0 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.434+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6181abe30 con 0x7fd6181076a0 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.434+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6181ac330 con 0x7fd6181076a0 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.434+0000 7fd614ff9640 1 -- 172.21.15.19:0/1799061298 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd608009820 con 0x7fd6181076a0 2024-09-11T00:10:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.434+0000 7fd614ff9640 1 -- 172.21.15.19:0/1799061298 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608020060 con 0x7fd6181076a0 2024-09-11T00:10:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.439+0000 7fd614ff9640 1 -- 172.21.15.19:0/1799061298 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fd608005220 con 0x7fd6181076a0 2024-09-11T00:10:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.439+0000 7fd620378740 1 Processor -- start 2024-09-11T00:10:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.439+0000 7fd620378740 1 -- start start 2024-09-11T00:10:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.439+0000 7fd620378740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.439+0000 7fd620378740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09ff1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd620378740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 0x55cd09ff4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd620378740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cd09f5bea0 con 0x55cd09fe5df0 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd620378740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cd09f4b2d0 con 0x55cd09fe54d0 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd620378740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cd09f4f0e0 con 0x55cd09ff1d80 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd617fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd616ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 0x55cd09ff4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd617fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:59666/0 (socket says 172.21.15.19:59666) 2024-09-11T00:10:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.440+0000 7fd617fff640 1 -- 172.21.15.19:0/1027130491 learned_addr learned my addr 172.21.15.19:0/1027130491 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:09.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd617fff640 1 -- 172.21.15.19:0/1027130491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 msgr2=0x55cd09ff4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd617fff640 1 --2- 172.21.15.19:0/1027130491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 0x55cd09ff4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd617fff640 1 -- 172.21.15.19:0/1027130491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 msgr2=0x55cd09ff1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd617fff640 1 --2- 172.21.15.19:0/1027130491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09ff1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd617fff640 1 -- 172.21.15.19:0/1027130491 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd09ca9650 con 0x55cd09fe54d0 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd614ff9640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6040b5450 0x7fd6040b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd6177fe640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6040b5450 0x7fd6040b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd614ff9640 1 -- 172.21.15.19:0/1799061298 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7fd6080e5870 con 0x7fd6181076a0 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.441+0000 7fd617fff640 1 --2- 172.21.15.19:0/1027130491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe58b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd610009fd0 tx=0x7fd610010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee4ac648a5183105 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.442+0000 7fd60dffb640 1 -- 172.21.15.19:0/1027130491 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610011700 con 0x55cd09fe54d0 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.442+0000 7fd60dffb640 1 -- 172.21.15.19:0/1027130491 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd610011d50 con 0x55cd09fe54d0 2024-09-11T00:10:09.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.442+0000 7fd60dffb640 1 -- 172.21.15.19:0/1027130491 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61000e3c0 con 0x55cd09fe54d0 2024-09-11T00:10:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 -- 172.21.15.19:0/1027130491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 msgr2=0x55cd09fe58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 --2- 172.21.15.19:0/1027130491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe58b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd610009fd0 tx=0x7fd610010860 comp rx=0 tx=0).stop 2024-09-11T00:10:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd6177fe640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6040b5450 0x7fd6040b7910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55cd09fe41e0 tx=0x7fd600009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 -- 172.21.15.19:0/1027130491 shutdown_connections 2024-09-11T00:10:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 --2- 172.21.15.19:0/1027130491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 0x55cd09ff4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 --2- 172.21.15.19:0/1027130491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09ff1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 --2- 172.21.15.19:0/1027130491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe58b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 -- 172.21.15.19:0/1027130491 >> 172.21.15.19:0/1027130491 conn(0x55cd09fe3300 msgr2=0x55cd09fe44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 -- 172.21.15.19:0/1027130491 shutdown_connections 2024-09-11T00:10:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.443+0000 7fd620378740 1 -- 172.21.15.19:0/1027130491 wait complete. 2024-09-11T00:10:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.444+0000 7fd620378740 1 -- start start 2024-09-11T00:10:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.444+0000 7fd620378740 1 Processor -- start 2024-09-11T00:10:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.444+0000 7fd620378740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe54d0 0x55cd09ff16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd620378740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09feeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd620378740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09ff1d80 0x55cd09fef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd620378740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cd09dac700 con 0x55cd09fe5df0 2024-09-11T00:10:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd620378740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cd09ee6160 con 0x55cd09ff1d80 2024-09-11T00:10:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd620378740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cd09ff4a00 con 0x55cd09fe54d0 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd620378740 10 client.0 _ll_register_callbacks cb 0x55cd09eff9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe54d0 0x55cd09ff16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd617fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09ff1d80 0x55cd09fef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe54d0 0x55cd09ff16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:34158/0 (socket says 172.21.15.19:34158) 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 -- 172.21.15.19:0/2313241542 learned_addr learned my addr 172.21.15.19:0/2313241542 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 -- 172.21.15.19:0/2313241542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09ff1d80 msgr2=0x55cd09fef1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09ff1d80 0x55cd09fef1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 -- 172.21.15.19:0/2313241542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 msgr2=0x55cd09feeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09feeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd6177fe640 1 -- 172.21.15.19:0/2313241542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd09f13c90 con 0x55cd09fe54d0 2024-09-11T00:10:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.445+0000 7fd617fff640 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09ff1d80 0x55cd09fef1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.446+0000 7fd6177fe640 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe54d0 0x55cd09ff16e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd600006010 tx=0x7fd60002a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41c0d1cb2d18cfb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.446+0000 7fd5f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:10:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.446+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/2313241542 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60004d020 con 0x55cd09fe54d0 2024-09-11T00:10:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.446+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd610011d50 con 0x55cd09fe54d0 2024-09-11T00:10:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.446+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/2313241542 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7fd600049680 con 0x55cd09fe54d0 2024-09-11T00:10:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.451+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/2313241542 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd600058050 con 0x55cd09fe54d0 2024-09-11T00:10:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.451+0000 7fd620378740 10 client.25963 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.451+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cd0a000490 con 0x55cd09fe54d0 2024-09-11T00:10:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/2313241542 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd600049d30 con 0x55cd09fe54d0 2024-09-11T00:10:09.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/2313241542 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd60003cc40 con 0x55cd09fe54d0 2024-09-11T00:10:09.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd620378740 10 client.25963 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:09.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd620378740 10 client.25963 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:10:09.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd620378740 20 client.25963 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:09.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd620378740 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a001e20 0x55cd0a0042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd620378740 4 client.25963 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:09.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.452+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd610011d50 con 0x55cd0a001e20 2024-09-11T00:10:09.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.455+0000 7fd616ffd640 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a001e20 0x55cd0a0042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.456+0000 7fd616ffd640 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a001e20 0x55cd0a0042a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24357fa2d7c7b4e9 server_cookie=8cafb7f195ee1c29 in_seq=0 out_seq=0 2024-09-11T00:10:09.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.456+0000 7fd5f6ffd640 10 client.25963 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:09.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.460+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/2313241542 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd610011d50 con 0x55cd0a001e20 2024-09-11T00:10:09.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.460+0000 7fd5f6ffd640 10 client.25963 handle_command_reply: tid=0 2024-09-11T00:10:09.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.460+0000 7fd620378740 1 client.25963 shutdown 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.460+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe54d0 msgr2=0x55cd09ff16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.460+0000 7fd620378740 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe54d0 0x55cd09ff16e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd600006010 tx=0x7fd60002a420 comp rx=0 tx=0).stop 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 shutdown_connections 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a001e20 0x55cd0a0042a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09ff1d80 0x55cd09fef1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09feeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 --2- 172.21.15.19:0/2313241542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe54d0 0x55cd09ff16e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 >> 172.21.15.19:0/2313241542 conn(0x55cd09fe3300 msgr2=0x55cd09fe8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd5f6ffd640 0 client.25963 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 shutdown_connections 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 1 -- 172.21.15.19:0/2313241542 wait complete. 2024-09-11T00:10:09.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.461+0000 7fd620378740 20 client.25963 trim_cache size 0 max 16384 2024-09-11T00:10:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.482+0000 7fd620378740 1 Processor -- start 2024-09-11T00:10:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.482+0000 7fd620378740 1 -- start start 2024-09-11T00:10:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd620378740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd620378740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe5df0 0x55cd09fe9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd620378740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09ff1d80 0x55cd09fea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd620378740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f8011010 con 0x55cd09ff1d80 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd620378740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f800e850 con 0x55cd09fe54d0 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd620378740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f800c6c0 con 0x55cd09fe5df0 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd617fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09ff1d80 0x55cd09fea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd616ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe5df0 0x55cd09fe9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd616ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe5df0 0x55cd09fe9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:34166/0 (socket says 172.21.15.19:34166) 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd617fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09ff1d80 0x55cd09fea2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48170/0 (socket says 172.21.15.19:48170) 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.483+0000 7fd616ffd640 1 -- 172.21.15.19:0/266746587 learned_addr learned my addr 172.21.15.19:0/266746587 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd617fff640 1 -- 172.21.15.19:0/266746587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe5df0 msgr2=0x55cd09fe9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd617fff640 1 --2- 172.21.15.19:0/266746587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe5df0 0x55cd09fe9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd617fff640 1 -- 172.21.15.19:0/266746587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 msgr2=0x55cd09fe2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd617fff640 1 --2- 172.21.15.19:0/266746587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd617fff640 1 -- 172.21.15.19:0/266746587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd09fefa80 con 0x55cd09ff1d80 2024-09-11T00:10:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd617fff640 1 --2- 172.21.15.19:0/266746587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09ff1d80 0x55cd09fea2d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd610006010 tx=0x7fd610009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94a7718aa7b037b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd60d7fa640 1 -- 172.21.15.19:0/266746587 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610004ce0 con 0x55cd09ff1d80 2024-09-11T00:10:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd60d7fa640 1 -- 172.21.15.19:0/266746587 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6100119b0 con 0x55cd09ff1d80 2024-09-11T00:10:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.484+0000 7fd60d7fa640 1 -- 172.21.15.19:0/266746587 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610005580 con 0x55cd09ff1d80 2024-09-11T00:10:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 -- 172.21.15.19:0/266746587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09ff1d80 msgr2=0x55cd09fea2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 --2- 172.21.15.19:0/266746587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09ff1d80 0x55cd09fea2d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd610006010 tx=0x7fd610009cd0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 -- 172.21.15.19:0/266746587 shutdown_connections 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 --2- 172.21.15.19:0/266746587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09ff1d80 0x55cd09fea2d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 --2- 172.21.15.19:0/266746587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09fe5df0 0x55cd09fe9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 --2- 172.21.15.19:0/266746587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09fe2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 -- 172.21.15.19:0/266746587 >> 172.21.15.19:0/266746587 conn(0x55cd09fe3300 msgr2=0x55cd09fe43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 -- 172.21.15.19:0/266746587 shutdown_connections 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.485+0000 7fd620378740 1 -- 172.21.15.19:0/266746587 wait complete. 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.486+0000 7fd620378740 1 -- start start 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.486+0000 7fd620378740 1 Processor -- start 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.486+0000 7fd620378740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09ff9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd620378740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09ffa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd620378740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 0x55cd09ff4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09ff9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09ff9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:59692/0 (socket says 172.21.15.19:59692) 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 -- 172.21.15.19:0/1079973659 learned_addr learned my addr 172.21.15.19:0/1079973659 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f800cd10 con 0x55cd09fe5df0 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f800e180 con 0x55cd09fe54d0 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f800d3e0 con 0x55cd09ff1d80 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd616ffd640 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09ffa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd620378740 10 client.0 _ll_register_callbacks cb 0x7fd600040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 -- 172.21.15.19:0/1079973659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 msgr2=0x55cd09ff4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 0x55cd09ff4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 -- 172.21.15.19:0/1079973659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 msgr2=0x55cd09ffa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09ffa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.487+0000 7fd6177fe640 1 -- 172.21.15.19:0/1079973659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd09ffe100 con 0x55cd09fe54d0 2024-09-11T00:10:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.488+0000 7fd6177fe640 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09ff9d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd600004700 tx=0x7fd600031d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb49371a9a7bc17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.488+0000 7fd5f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:10:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.488+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/1079973659 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd600060020 con 0x55cd09fe54d0 2024-09-11T00:10:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.489+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/1079973659 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8441+0+0 (secure 0 0 0) 0x7fd600049890 con 0x55cd09fe54d0 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.489+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6100119b0 con 0x55cd09fe54d0 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.489+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/1079973659 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd60006b050 con 0x55cd09fe54d0 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.489+0000 7fd620378740 10 client.25748 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.489+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cd0a06f190 con 0x55cd09fe54d0 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/1079973659 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6100119b0 con 0x55cd09fe54d0 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/1079973659 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd60003c950 con 0x55cd09fe54d0 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd620378740 10 client.25748 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd620378740 10 client.25748 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd620378740 20 client.25748 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd620378740 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a06f910 0x55cd0a071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd620378740 4 client.25748 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:10:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd09f5ddf0 con 0x55cd0a06f910 2024-09-11T00:10:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.490+0000 7fd616ffd640 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a06f910 0x55cd0a071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.492+0000 7fd616ffd640 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a06f910 0x55cd0a071d30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=403f970b1cad92ae server_cookie=dafc35d25c75b776 in_seq=0 out_seq=0 2024-09-11T00:10:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.492+0000 7fd5f6ffd640 10 client.25748 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd5f6ffd640 1 -- 172.21.15.19:0/1079973659 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd09f5ddf0 con 0x55cd0a06f910 2024-09-11T00:10:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd5f6ffd640 10 client.25748 handle_command_reply: tid=0 2024-09-11T00:10:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 client.25748 shutdown 2024-09-11T00:10:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 msgr2=0x55cd09ff9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09ff9d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd600004700 tx=0x7fd600031d50 comp rx=0 tx=0).stop 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 shutdown_connections 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55cd0a06f910 0x55cd0a071d30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd09ff1d80 0x55cd09ff4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd5f6ffd640 0 client.25748 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cd09fe5df0 0x55cd09ffa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 --2- 172.21.15.19:0/1079973659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd09fe54d0 0x55cd09ff9d30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.493+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 >> 172.21.15.19:0/1079973659 conn(0x55cd09fe3300 msgr2=0x55cd09fe9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.494+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 shutdown_connections 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.494+0000 7fd620378740 1 -- 172.21.15.19:0/1079973659 wait complete. 2024-09-11T00:10:09.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.494+0000 7fd620378740 20 client.25748 trim_cache size 0 max 16384 2024-09-11T00:10:09.498 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:10:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6040b5450 msgr2=0x7fd6040b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6040b5450 0x7fd6040b7910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55cd09fe41e0 tx=0x7fd600009560 comp rx=0 tx=0).stop 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6181076a0 msgr2=0x7fd618108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6181076a0 0x7fd618108d50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd60800d6d0 tx=0x7fd60800db90 comp rx=0 tx=0).stop 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 shutdown_connections 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd618108020 0x7fd618109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6040b5450 0x7fd6040b7910 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6181076a0 0x7fd618108d50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 --2- 172.21.15.19:0/1799061298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd618101c90 0x7fd618108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 >> 172.21.15.19:0/1799061298 conn(0x7fd6180fd700 msgr2=0x7fd618103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.495+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 shutdown_connections 2024-09-11T00:10:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:09.496+0000 7fd61dfa3640 1 -- 172.21.15.19:0/1799061298 wait complete. 2024-09-11T00:10:09.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:09 smithi019 ceph-mon[30859]: pgmap v556: 97 pgs: 97 active+clean; 848 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 449 op/s 2024-09-11T00:10:09.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:09 smithi131 ceph-mon[35491]: pgmap v556: 97 pgs: 97 active+clean; 848 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 449 op/s 2024-09-11T00:10:09.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:09 smithi135 ceph-mon[35432]: pgmap v556: 97 pgs: 97 active+clean; 848 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 449 op/s 2024-09-11T00:10:10.264 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:10:10.642 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.254+0000 7f3a08037640 1 -- 172.21.15.19:0/1406093257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001013f0 msgr2=0x7f3a001132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.254+0000 7f3a08037640 1 --2- 172.21.15.19:0/1406093257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001013f0 0x7f3a001132b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009900 tx=0x7f39f002a440 comp rx=0 tx=0).stop 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.255+0000 7f3a08037640 1 -- 172.21.15.19:0/1406093257 shutdown_connections 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.255+0000 7f3a08037640 1 --2- 172.21.15.19:0/1406093257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001137f0 0x7f3a00115be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.255+0000 7f3a08037640 1 --2- 172.21.15.19:0/1406093257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001013f0 0x7f3a001132b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.255+0000 7f3a08037640 1 --2- 172.21.15.19:0/1406093257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a00100ad0 0x7f3a00100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.255+0000 7f3a08037640 1 -- 172.21.15.19:0/1406093257 >> 172.21.15.19:0/1406093257 conn(0x7f3a000fca20 msgr2=0x7f3a000fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.256+0000 7f3a08037640 1 -- 172.21.15.19:0/1406093257 shutdown_connections 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.256+0000 7f3a08037640 1 -- 172.21.15.19:0/1406093257 wait complete. 2024-09-11T00:10:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.257+0000 7f3a08037640 1 Processor -- start 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.257+0000 7f3a08037640 1 -- start start 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a08037640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100ad0 0x7f3a0019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a08037640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a001013f0 0x7f3a0019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a05dd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100ad0 0x7f3a0019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a05dd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100ad0 0x7f3a0019f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48204/0 (socket says 172.21.15.19:48204) 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a05dd3640 1 -- 172.21.15.19:0/4156874302 learned_addr learned my addr 172.21.15.19:0/4156874302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a08037640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001137f0 0x7f3a001a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00119420 con 0x7f3a00100ad0 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a001192a0 con 0x7f3a001013f0 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.258+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a001195a0 con 0x7f3a001137f0 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.259+0000 7f3a065d4640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001137f0 0x7f3a001a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.259+0000 7f3a055d2640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a001013f0 0x7f3a0019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.259+0000 7f3a065d4640 1 -- 172.21.15.19:0/4156874302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a001013f0 msgr2=0x7f3a0019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.259+0000 7f3a065d4640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a001013f0 0x7f3a0019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.259+0000 7f3a065d4640 1 -- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100ad0 msgr2=0x7f3a0019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.259+0000 7f3a065d4640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100ad0 0x7f3a0019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.259+0000 7f3a065d4640 1 -- 172.21.15.19:0/4156874302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a001a57a0 con 0x7f3a001137f0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.260+0000 7f3a065d4640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001137f0 0x7f3a001a4fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39f800bdf0 tx=0x7f39f800bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.260+0000 7f39f6ffd640 1 -- 172.21.15.19:0/4156874302 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8019070 con 0x7f3a001137f0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.260+0000 7f39f6ffd640 1 -- 172.21.15.19:0/4156874302 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f80148f0 con 0x7f3a001137f0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.260+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a001a5a90 con 0x7f3a001137f0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.261+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a001ac150 con 0x7f3a001137f0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.261+0000 7f39f6ffd640 1 -- 172.21.15.19:0/4156874302 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8012840 con 0x7f3a001137f0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.265+0000 7f3a0a40c740 1 Processor -- start 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.266+0000 7f39f6ffd640 1 -- 172.21.15.19:0/4156874302 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f39f8014440 con 0x7f3a001137f0 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f39f6ffd640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39ec0b5550 0x7f39ec0b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f39f6ffd640 1 -- 172.21.15.19:0/4156874302 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f39f80e5860 con 0x7f3a001137f0 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a055d2640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39ec0b5550 0x7f39ec0b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a0a40c740 1 -- start start 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2d0f0 0x55698de2d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2da10 0x55698de39460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55698dda3ea0 con 0x55698de2d0f0 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55698dd932d0 con 0x55698de399a0 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.268+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55698dd970e0 con 0x55698de2da10 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.269+0000 7f3a055d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2da10 0x55698de39460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.269+0000 7f3a055d2640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39ec0b5550 0x7f39ec0b7a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39f0004650 tx=0x7f39f0000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.269+0000 7f3a055d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2da10 0x55698de39460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:34212/0 (socket says 172.21.15.19:34212) 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.269+0000 7f3a055d2640 1 -- 172.21.15.19:0/3279832719 learned_addr learned my addr 172.21.15.19:0/3279832719 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a05dd3640 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2d0f0 0x55698de2d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a065d4640 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a055d2640 1 -- 172.21.15.19:0/3279832719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 msgr2=0x55698de3bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a055d2640 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a055d2640 1 -- 172.21.15.19:0/3279832719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2d0f0 msgr2=0x55698de2d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a055d2640 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2d0f0 0x55698de2d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a055d2640 1 -- 172.21.15.19:0/3279832719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698daf1650 con 0x55698de2da10 2024-09-11T00:10:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a065d4640 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:11.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.270+0000 7f3a055d2640 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2da10 0x55698de39460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39f0032000 tx=0x7f39f0044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f2ee8db24d614e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:11.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.271+0000 7f39ebfff640 1 -- 172.21.15.19:0/3279832719 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0004980 con 0x55698de2da10 2024-09-11T00:10:11.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.271+0000 7f39ebfff640 1 -- 172.21.15.19:0/3279832719 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f0044070 con 0x55698de2da10 2024-09-11T00:10:11.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.271+0000 7f39ebfff640 1 -- 172.21.15.19:0/3279832719 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f004adf0 con 0x55698de2da10 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.273+0000 7f3a0a40c740 1 -- 172.21.15.19:0/3279832719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2da10 msgr2=0x55698de39460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.273+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2da10 0x55698de39460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39f0032000 tx=0x7f39f0044000 comp rx=0 tx=0).stop 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.273+0000 7f3a0a40c740 1 -- 172.21.15.19:0/3279832719 shutdown_connections 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.273+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.274+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2da10 0x55698de39460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.274+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/3279832719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2d0f0 0x55698de2d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.274+0000 7f3a0a40c740 1 -- 172.21.15.19:0/3279832719 >> 172.21.15.19:0/3279832719 conn(0x55698de2af20 msgr2=0x55698de2c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.274+0000 7f3a0a40c740 1 -- 172.21.15.19:0/3279832719 shutdown_connections 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.274+0000 7f3a0a40c740 1 -- 172.21.15.19:0/3279832719 wait complete. 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.274+0000 7f3a0a40c740 1 -- start start 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.275+0000 7f3a0a40c740 1 Processor -- start 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.276+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de392f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.276+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de36740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.276+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de36da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.276+0000 7f3a05dd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.276+0000 7f3a05dd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:34226/0 (socket says 172.21.15.19:34226) 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.276+0000 7f3a05dd3640 1 -- 172.21.15.19:0/207381694 learned_addr learned my addr 172.21.15.19:0/207381694 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.277+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55698dbf4700 con 0x55698de2da10 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.277+0000 7f3a065d4640 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de36da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.277+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55698dd2e160 con 0x55698de399a0 2024-09-11T00:10:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.277+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55698de3c5c0 con 0x55698de2d0f0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.277+0000 7f3a0a40c740 10 client.0 _ll_register_callbacks cb 0x55698dd479e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.277+0000 7f3a055d2640 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de36740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f3a065d4640 1 -- 172.21.15.19:0/207381694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 msgr2=0x55698de392f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f3a065d4640 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de392f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f3a065d4640 1 -- 172.21.15.19:0/207381694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 msgr2=0x55698de36740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f3a065d4640 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de36740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f3a065d4640 1 -- 172.21.15.19:0/207381694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698dd5bc90 con 0x55698de399a0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f3a065d4640 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de36da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39f80e2f70 tx=0x7f39f80abc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5282e1c0d3902d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f39e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.278+0000 7f39e97fa640 1 -- 172.21.15.19:0/207381694 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f80b0020 con 0x55698de399a0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.279+0000 7f39e97fa640 1 -- 172.21.15.19:0/207381694 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f39f80b4fa0 con 0x55698de399a0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.279+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39f0044070 con 0x55698de399a0 2024-09-11T00:10:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.279+0000 7f39e97fa640 1 -- 172.21.15.19:0/207381694 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f39f80abd50 con 0x55698de399a0 2024-09-11T00:10:11.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.279+0000 7f3a0a40c740 10 client.25757 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:11.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.279+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55698de47fb0 con 0x55698de399a0 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.280+0000 7f39e97fa640 1 -- 172.21.15.19:0/207381694 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f80b0780 con 0x55698de399a0 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.281+0000 7f39e97fa640 1 -- 172.21.15.19:0/207381694 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f39f8014aa0 con 0x55698de399a0 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.281+0000 7f3a0a40c740 10 client.25757 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.281+0000 7f3a0a40c740 10 client.25757 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.281+0000 7f3a0a40c740 20 client.25757 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.281+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698de493a0 0x55698de4b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.281+0000 7f3a0a40c740 4 client.25757 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.281+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f39f0044070 con 0x55698de493a0 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.282+0000 7f3a05dd3640 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698de493a0 0x55698de4b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.283+0000 7f39e97fa640 10 client.25757 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:11.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.283+0000 7f3a05dd3640 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698de493a0 0x55698de4b800 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10186505a2bf5640 server_cookie=89ef9204f6fb1d7a in_seq=0 out_seq=0 2024-09-11T00:10:11.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.284+0000 7f39e97fa640 1 -- 172.21.15.19:0/207381694 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f39f0044070 con 0x55698de493a0 2024-09-11T00:10:11.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.284+0000 7f39e97fa640 10 client.25757 handle_command_reply: tid=0 2024-09-11T00:10:11.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 client.25757 shutdown 2024-09-11T00:10:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 msgr2=0x55698de36da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de36da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39f80e2f70 tx=0x7f39f80abc50 comp rx=0 tx=0).stop 2024-09-11T00:10:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 shutdown_connections 2024-09-11T00:10:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698de493a0 0x55698de4b800 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de36da0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de36740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/207381694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de392f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 >> 172.21.15.19:0/207381694 conn(0x55698de2af20 msgr2=0x55698de30a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.285+0000 7f39e97fa640 0 client.25757 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.286+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 shutdown_connections 2024-09-11T00:10:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.286+0000 7f3a0a40c740 1 -- 172.21.15.19:0/207381694 wait complete. 2024-09-11T00:10:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.286+0000 7f3a0a40c740 20 client.25757 trim_cache size 0 max 16384 2024-09-11T00:10:11.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 Processor -- start 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 -- start start 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de2d0f0 0x55698de2a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de38480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de399a0 0x55698de3ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39e4010fe0 con 0x55698de2da10 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39e400e820 con 0x55698de2d0f0 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.310+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39e400c690 con 0x55698de399a0 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a05dd3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de2d0f0 0x55698de2a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a05dd3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de2d0f0 0x55698de2a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:59734/0 (socket says 172.21.15.19:59734) 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a05dd3640 1 -- 172.21.15.19:0/4105503174 learned_addr learned my addr 172.21.15.19:0/4105503174 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a055d2640 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de38480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a065d4640 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de399a0 0x55698de3ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a055d2640 1 -- 172.21.15.19:0/4105503174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de399a0 msgr2=0x55698de3ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a055d2640 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de399a0 0x55698de3ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a055d2640 1 -- 172.21.15.19:0/4105503174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de2d0f0 msgr2=0x55698de2a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a055d2640 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de2d0f0 0x55698de2a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.311+0000 7f3a055d2640 1 -- 172.21.15.19:0/4105503174 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698de2d840 con 0x55698de2da10 2024-09-11T00:10:11.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.312+0000 7f3a055d2640 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de38480 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009850 tx=0x7f39f004a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a57acb4dab9de2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:11.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.312+0000 7f39eb7fe640 1 -- 172.21.15.19:0/4105503174 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0060070 con 0x55698de2da10 2024-09-11T00:10:11.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.312+0000 7f39eb7fe640 1 -- 172.21.15.19:0/4105503174 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f004a6b0 con 0x55698de2da10 2024-09-11T00:10:11.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.312+0000 7f39eb7fe640 1 -- 172.21.15.19:0/4105503174 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f005b690 con 0x55698de2da10 2024-09-11T00:10:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 -- 172.21.15.19:0/4105503174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 msgr2=0x55698de38480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de38480 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009850 tx=0x7f39f004a9d0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 -- 172.21.15.19:0/4105503174 shutdown_connections 2024-09-11T00:10:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de399a0 0x55698de3ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de38480 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/4105503174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de2d0f0 0x55698de2a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 -- 172.21.15.19:0/4105503174 >> 172.21.15.19:0/4105503174 conn(0x55698de2af20 msgr2=0x55698de37d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 -- 172.21.15.19:0/4105503174 shutdown_connections 2024-09-11T00:10:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.314+0000 7f3a0a40c740 1 -- 172.21.15.19:0/4105503174 wait complete. 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.315+0000 7f3a0a40c740 1 -- start start 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.315+0000 7f3a0a40c740 1 Processor -- start 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de41ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de42010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a0a40c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39e400cce0 con 0x55698de2da10 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39e400e150 con 0x55698de399a0 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a0a40c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39e400d3b0 con 0x55698de2d0f0 2024-09-11T00:10:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a0a40c740 10 client.0 _ll_register_callbacks cb 0x7f39f80a7cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a065d4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a065d4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:59742/0 (socket says 172.21.15.19:59742) 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a05dd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de41ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a065d4640 1 -- 172.21.15.19:0/14921446 learned_addr learned my addr 172.21.15.19:0/14921446 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.316+0000 7f3a055d2640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de42010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a05dd3640 1 -- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 msgr2=0x55698de3c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a05dd3640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a05dd3640 1 -- 172.21.15.19:0/14921446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 msgr2=0x55698de42010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a05dd3640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de42010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a05dd3640 1 -- 172.21.15.19:0/14921446 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698de3cee0 con 0x55698de2d0f0 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a065d4640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:11.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a055d2640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de42010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:11.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f3a05dd3640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de41ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0058c0 tx=0x7f39fc014bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=248f82b2015d8641 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:11.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.317+0000 7f39e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.318+0000 7f39e97fa640 1 -- 172.21.15.19:0/14921446 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc014320 con 0x55698de2d0f0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.318+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39f004a6b0 con 0x55698de2d0f0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.318+0000 7f39e97fa640 1 -- 172.21.15.19:0/14921446 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f39fc004030 con 0x55698de2d0f0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.318+0000 7f39e97fa640 1 -- 172.21.15.19:0/14921446 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f39fc004230 con 0x55698de2d0f0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.319+0000 7f3a0a40c740 10 client.25984 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.319+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55698deb6cc0 con 0x55698de2d0f0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f39e97fa640 1 -- 172.21.15.19:0/14921446 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f004a6b0 con 0x55698de2d0f0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f39e97fa640 1 -- 172.21.15.19:0/14921446 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f39fc02a020 con 0x55698de2d0f0 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f3a0a40c740 10 client.25984 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:11.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f3a0a40c740 10 client.25984 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:10:11.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f3a0a40c740 20 client.25984 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:11.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698deb74a0 0x55698deb98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:11.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f3a0a40c740 4 client.25984 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:10:11.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.320+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55698dda5df0 con 0x55698deb74a0 2024-09-11T00:10:11.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.323+0000 7f3a055d2640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698deb74a0 0x55698deb98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:11.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.324+0000 7f3a055d2640 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698deb74a0 0x55698deb98c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f9ef9d2bdcbf48d server_cookie=5e7d9b7f16e298e1 in_seq=0 out_seq=0 2024-09-11T00:10:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.324+0000 7f39e97fa640 10 client.25984 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.325+0000 7f39e97fa640 1 -- 172.21.15.19:0/14921446 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55698dda5df0 con 0x55698deb74a0 2024-09-11T00:10:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.325+0000 7f39e97fa640 10 client.25984 handle_command_reply: tid=0 2024-09-11T00:10:11.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.325+0000 7f3a0a40c740 1 client.25984 shutdown 2024-09-11T00:10:11.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 msgr2=0x55698de41ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de41ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0058c0 tx=0x7f39fc014bc0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 shutdown_connections 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55698deb74a0 0x55698deb98c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55698de399a0 0x55698de3c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55698de2da10 0x55698de42010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 --2- 172.21.15.19:0/14921446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55698de2d0f0 0x55698de41ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 >> 172.21.15.19:0/14921446 conn(0x55698de2af20 msgr2=0x55698de2c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.327+0000 7f39e97fa640 0 client.25984 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.328+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 shutdown_connections 2024-09-11T00:10:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.328+0000 7f3a0a40c740 1 -- 172.21.15.19:0/14921446 wait complete. 2024-09-11T00:10:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.328+0000 7f3a0a40c740 20 client.25984 trim_cache size 0 max 16384 2024-09-11T00:10:11.332 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:10:11.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.330+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39ec0b5550 msgr2=0x7f39ec0b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.330+0000 7f3a08037640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39ec0b5550 0x7f39ec0b7a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39f0004650 tx=0x7f39f0000bc0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001137f0 msgr2=0x7f3a001a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001137f0 0x7f3a001a4fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39f800bdf0 tx=0x7f39f800bee0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 shutdown_connections 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a001137f0 0x7f3a001a4fd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a001013f0 0x7f3a0019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39ec0b5550 0x7f39ec0b7a10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 --2- 172.21.15.19:0/4156874302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100ad0 0x7f3a0019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.331+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 >> 172.21.15.19:0/4156874302 conn(0x7f3a000fca20 msgr2=0x7f3a00107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.332+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 shutdown_connections 2024-09-11T00:10:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:11.332+0000 7f3a08037640 1 -- 172.21.15.19:0/4156874302 wait complete. 2024-09-11T00:10:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:11 smithi019 ceph-mon[30859]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T00:10:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:11 smithi019 ceph-mon[30859]: pgmap v558: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 852 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-09-11T00:10:11.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:11 smithi131 ceph-mon[35491]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T00:10:11.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:11 smithi131 ceph-mon[35491]: pgmap v558: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 852 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-09-11T00:10:11.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:11 smithi135 ceph-mon[35432]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T00:10:11.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:11 smithi135 ceph-mon[35432]: pgmap v558: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 852 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-09-11T00:10:11.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:10:12.126 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-11T00:10:12.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T00:10:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:12.514 DEBUG:teuthology.parallel:result is None 2024-09-11T00:10:12.514 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T00:10:12.546 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T00:10:12.546 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-11T00:10:12.560 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-11T00:10:12.560 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T00:10:12.560 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T00:10:12.560 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-11T00:10:12.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-11T00:10:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 -- 172.21.15.19:0/306393395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280101cd0 msgr2=0x7f82801020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 --2- 172.21.15.19:0/306393395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280101cd0 0x7f82801020b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8270009900 tx=0x7f827002a410 comp rx=0 tx=0).stop 2024-09-11T00:10:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 -- 172.21.15.19:0/306393395 shutdown_connections 2024-09-11T00:10:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 --2- 172.21.15.19:0/306393395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8280108060 0x7f828010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 --2- 172.21.15.19:0/306393395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82801076e0 0x7f8280107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 --2- 172.21.15.19:0/306393395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280101cd0 0x7f82801020b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 -- 172.21.15.19:0/306393395 >> 172.21.15.19:0/306393395 conn(0x7f82800fd700 msgr2=0x7f82800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 -- 172.21.15.19:0/306393395 shutdown_connections 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.808+0000 7f82849e6640 1 -- 172.21.15.19:0/306393395 wait complete. 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 Processor -- start 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 -- start start 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8280101cd0 0x7f8280199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82801076e0 0x7f82801997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280108060 0x7f828019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8280112e00 con 0x7f8280108060 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8280112c80 con 0x7f8280101cd0 2024-09-11T00:10:13.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f82849e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8280112f80 con 0x7f82801076e0 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f827ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280108060 0x7f828019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f827ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280108060 0x7f828019eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48214/0 (socket says 172.21.15.19:48214) 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f827ed9d640 1 -- 172.21.15.19:0/840421722 learned_addr learned my addr 172.21.15.19:0/840421722 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f827e59c640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8280101cd0 0x7f8280199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.809+0000 7f8275d9b640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82801076e0 0x7f82801997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f827ed9d640 1 -- 172.21.15.19:0/840421722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82801076e0 msgr2=0x7f82801997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f827ed9d640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82801076e0 0x7f82801997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f827ed9d640 1 -- 172.21.15.19:0/840421722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8280101cd0 msgr2=0x7f8280199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f827ed9d640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8280101cd0 0x7f8280199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f827ed9d640 1 -- 172.21.15.19:0/840421722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828019f340 con 0x7f8280108060 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f827ed9d640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280108060 0x7f828019eb70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f827800eaa0 tx=0x7f827800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f8277fff640 1 -- 172.21.15.19:0/840421722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827800cdb0 con 0x7f8280108060 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828019f630 con 0x7f8280108060 2024-09-11T00:10:13.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f8277fff640 1 -- 172.21.15.19:0/840421722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8278005020 con 0x7f8280108060 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f8277fff640 1 -- 172.21.15.19:0/840421722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780116d0 con 0x7f8280108060 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.810+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82801a5cf0 con 0x7f8280108060 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.812+0000 7f8286dbb740 1 Processor -- start 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8277fff640 1 -- 172.21.15.19:0/840421722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f827800f040 con 0x7f8280108060 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8286dbb740 1 -- start start 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470da840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470dd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8286dbb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555947044ea0 con 0x5559470ce4d0 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8286dbb740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5559470342d0 con 0x5559470dad80 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.813+0000 7f8286dbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5559470380e0 con 0x5559470cedf0 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48228/0 (socket says 172.21.15.19:48228) 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 -- 172.21.15.19:0/692813650 learned_addr learned my addr 172.21.15.19:0/692813650 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f827e59c640 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470da840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 -- 172.21.15.19:0/692813650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 msgr2=0x5559470da840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470da840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 -- 172.21.15.19:0/692813650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 msgr2=0x5559470dd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470dd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 -- 172.21.15.19:0/692813650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555946d92650 con 0x5559470ce4d0 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8277fff640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f826c0b5450 0x7f826c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8275d9b640 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470ce8b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8268012630 tx=0x7f826800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a5395a501cecf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f827e59c640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f826c0b5450 0x7f826c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8277fff640 1 -- 172.21.15.19:0/840421722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f82780e5d30 con 0x7f8280108060 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8274d99640 1 -- 172.21.15.19:0/692813650 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268005020 con 0x5559470ce4d0 2024-09-11T00:10:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8274d99640 1 -- 172.21.15.19:0/692813650 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8268005670 con 0x5559470ce4d0 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.814+0000 7f8274d99640 1 -- 172.21.15.19:0/692813650 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826800e770 con 0x5559470ce4d0 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 -- 172.21.15.19:0/692813650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 msgr2=0x5559470ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f827e59c640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f826c0b5450 0x7f826c0b7910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8270031440 tx=0x7f8270005c00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470ce8b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8268012630 tx=0x7f826800b8c0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 -- 172.21.15.19:0/692813650 shutdown_connections 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470da840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 --2- 172.21.15.19:0/692813650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470ce8b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 -- 172.21.15.19:0/692813650 >> 172.21.15.19:0/692813650 conn(0x5559470cc300 msgr2=0x5559470cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 -- 172.21.15.19:0/692813650 shutdown_connections 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.815+0000 7f8286dbb740 1 -- 172.21.15.19:0/692813650 wait complete. 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 -- start start 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 Processor -- start 2024-09-11T00:10:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470ce4d0 0x5559470da690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470dad80 0x5559470d8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555946e95700 con 0x5559470dad80 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x555946fcf160 con 0x5559470ce4d0 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5559470dda00 con 0x5559470cedf0 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f8286dbb740 10 client.0 _ll_register_callbacks cb 0x555946fe89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f827ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470dad80 0x5559470d8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f827ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470dad80 0x5559470d8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48230/0 (socket says 172.21.15.19:48230) 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f827ed9d640 1 -- 172.21.15.19:0/2067062571 learned_addr learned my addr 172.21.15.19:0/2067062571 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.816+0000 7f827e59c640 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470ce4d0 0x5559470da690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8275d9b640 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f827ed9d640 1 -- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 msgr2=0x5559470d7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f827ed9d640 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470d7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f827ed9d640 1 -- 172.21.15.19:0/2067062571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470ce4d0 msgr2=0x5559470da690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f827ed9d640 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470ce4d0 0x5559470da690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f827ed9d640 1 -- 172.21.15.19:0/2067062571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555946ffcc90 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f827ed9d640 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470dad80 0x5559470d8110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f82780abf80 tx=0x7f8278005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735be5afdf1b3373 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8265ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8265ffb640 1 -- 172.21.15.19:0/2067062571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827801f030 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8265ffb640 1 -- 172.21.15.19:0/2067062571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f82780cf070 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8268005670 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8265ffb640 1 -- 172.21.15.19:0/2067062571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f82780b5760 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8286dbb740 10 client.16419 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5559470e9360 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.817+0000 7f8265ffb640 1 -- 172.21.15.19:0/2067062571 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8268005670 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8265ffb640 1 -- 172.21.15.19:0/2067062571 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f82780a7bd0 con 0x5559470dad80 2024-09-11T00:10:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8286dbb740 10 client.16419 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8286dbb740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8286dbb740 20 client.16419 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8286dbb740 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5559470ea8c0 0x5559470eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8286dbb740 4 client.16419 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555947046df0 con 0x5559470ea8c0 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f827e59c640 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5559470ea8c0 0x5559470eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f8265ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.818+0000 7f827e59c640 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5559470ea8c0 0x5559470eccb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acff662ab31e066d server_cookie=1743aac259f13d3d in_seq=0 out_seq=0 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8265ffb640 1 -- 172.21.15.19:0/2067062571 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555947046df0 con 0x5559470ea8c0 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8265ffb640 10 client.16419 handle_command_reply: tid=0 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 client.16419 shutdown 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470dad80 msgr2=0x5559470d8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470dad80 0x5559470d8110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f82780abf80 tx=0x7f8278005450 comp rx=0 tx=0).stop 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 shutdown_connections 2024-09-11T00:10:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5559470ea8c0 0x5559470eccb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470dad80 0x5559470d8110 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470cedf0 0x5559470d7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 --2- 172.21.15.19:0/2067062571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470ce4d0 0x5559470da690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 >> 172.21.15.19:0/2067062571 conn(0x5559470cc300 msgr2=0x5559470d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8265ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 shutdown_connections 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.819+0000 7f8286dbb740 1 -- 172.21.15.19:0/2067062571 wait complete. 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.820+0000 7f8286dbb740 20 client.16419 trim_cache size 0 max 16384 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 Processor -- start 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 -- start start 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470cedf0 0x5559470d9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470dad80 0x5559470dc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82801b0f20 con 0x5559470ce4d0 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f82801ae760 con 0x5559470cedf0 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8286dbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82801ac5d0 con 0x5559470dad80 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48242/0 (socket says 172.21.15.19:48242) 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 -- 172.21.15.19:0/910783931 learned_addr learned my addr 172.21.15.19:0/910783931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827ed9d640 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470dad80 0x5559470dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8275d9b640 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470cedf0 0x5559470d9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 -- 172.21.15.19:0/910783931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470dad80 msgr2=0x5559470dc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470dad80 0x5559470dc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 -- 172.21.15.19:0/910783931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470cedf0 msgr2=0x5559470d9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470cedf0 0x5559470d9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 -- 172.21.15.19:0/910783931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559470ecb00 con 0x5559470ce4d0 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f8275d9b640 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470cedf0 0x5559470d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.833+0000 7f827e59c640 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470cbc10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8270032fd0 tx=0x7f827003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5838f51ea61becb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8267fff640 1 -- 172.21.15.19:0/910783931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270035040 con 0x5559470ce4d0 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8267fff640 1 -- 172.21.15.19:0/910783931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82700043c0 con 0x5559470ce4d0 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8267fff640 1 -- 172.21.15.19:0/910783931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270004d40 con 0x5559470ce4d0 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 -- 172.21.15.19:0/910783931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 msgr2=0x5559470cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470cbc10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8270032fd0 tx=0x7f827003f000 comp rx=0 tx=0).stop 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 -- 172.21.15.19:0/910783931 shutdown_connections 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470dad80 0x5559470dc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470cedf0 0x5559470d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 --2- 172.21.15.19:0/910783931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470ce4d0 0x5559470cbc10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 -- 172.21.15.19:0/910783931 >> 172.21.15.19:0/910783931 conn(0x5559470cc300 msgr2=0x5559470d9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 -- 172.21.15.19:0/910783931 shutdown_connections 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.834+0000 7f8286dbb740 1 -- 172.21.15.19:0/910783931 wait complete. 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 -- start start 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 Processor -- start 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470ce4d0 0x5559470e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470cedf0 0x5559470e3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82801acc20 con 0x5559470cedf0 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f82801ae090 con 0x5559470dad80 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82801ad2f0 con 0x5559470ce4d0 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8286dbb740 10 client.0 _ll_register_callbacks cb 0x7f82780a88d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470cedf0 0x5559470e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470cedf0 0x5559470e3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48248/0 (socket says 172.21.15.19:48248) 2024-09-11T00:10:13.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 -- 172.21.15.19:0/690749647 learned_addr learned my addr 172.21.15.19:0/690749647 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f827e59c640 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470ce4d0 0x5559470e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f827ed9d640 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470ddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 -- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470ce4d0 msgr2=0x5559470e2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470ce4d0 0x5559470e2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 -- 172.21.15.19:0/690749647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 msgr2=0x5559470ddc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470ddc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.835+0000 7f8275d9b640 1 -- 172.21.15.19:0/690749647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559470de480 con 0x5559470cedf0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8275d9b640 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470cedf0 0x5559470e3420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8268012630 tx=0x7f826800b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aacde12eb9ca9fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8265ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8265ffb640 1 -- 172.21.15.19:0/690749647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268005240 con 0x5559470cedf0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8265ffb640 1 -- 172.21.15.19:0/690749647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f82680053e0 con 0x5559470cedf0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82700043c0 con 0x5559470cedf0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8265ffb640 1 -- 172.21.15.19:0/690749647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f82680055e0 con 0x5559470cedf0 2024-09-11T00:10:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 10 client.16425 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55594715c650 con 0x5559470cedf0 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8265ffb640 1 -- 172.21.15.19:0/690749647 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82700043c0 con 0x5559470cedf0 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8265ffb640 1 -- 172.21.15.19:0/690749647 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f826802f070 con 0x5559470cedf0 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 10 client.16425 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 20 client.16425 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55594715cb50 0x55594715ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 4 client.16425 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.836+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559470428a0 con 0x55594715cb50 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f827e59c640 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55594715cb50 0x55594715ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f827e59c640 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55594715cb50 0x55594715ef70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62216d13787c2f0a server_cookie=f20fe57e9b0bdc7f in_seq=0 out_seq=0 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8265ffb640 10 client.16425 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8265ffb640 1 -- 172.21.15.19:0/690749647 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559470428a0 con 0x55594715cb50 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8265ffb640 10 client.16425 handle_command_reply: tid=0 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 client.16425 shutdown 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470cedf0 msgr2=0x5559470e3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470cedf0 0x5559470e3420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8268012630 tx=0x7f826800b7a0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 shutdown_connections 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559470dad80 0x5559470ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55594715cb50 0x55594715ef70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5559470cedf0 0x5559470e3420 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 --2- 172.21.15.19:0/690749647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559470ce4d0 0x5559470e2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8265ffb640 0 client.16425 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.837+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 >> 172.21.15.19:0/690749647 conn(0x5559470cc300 msgr2=0x5559470d9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:13.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 shutdown_connections 2024-09-11T00:10:13.094 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:10:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f8286dbb740 1 -- 172.21.15.19:0/690749647 wait complete. 2024-09-11T00:10:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f8286dbb740 20 client.16425 trim_cache size 0 max 16384 2024-09-11T00:10:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f826c0b5450 msgr2=0x7f826c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f826c0b5450 0x7f826c0b7910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8270031440 tx=0x7f8270005c00 comp rx=0 tx=0).stop 2024-09-11T00:10:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280108060 msgr2=0x7f828019eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280108060 0x7f828019eb70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f827800eaa0 tx=0x7f827800ef60 comp rx=0 tx=0).stop 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 shutdown_connections 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f826c0b5450 0x7f826c0b7910 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8280108060 0x7f828019eb70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82801076e0 0x7f82801997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 --2- 172.21.15.19:0/840421722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8280101cd0 0x7f8280199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 >> 172.21.15.19:0/840421722 conn(0x7f82800fd700 msgr2=0x7f82800ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 shutdown_connections 2024-09-11T00:10:13.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:12.838+0000 7f82849e6640 1 -- 172.21.15.19:0/840421722 wait complete. 2024-09-11T00:10:14.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:13 smithi019 ceph-mon[30859]: pgmap v559: 97 pgs: 18 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 71 active+clean; 856 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 448 op/s 2024-09-11T00:10:14.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:13 smithi131 ceph-mon[35491]: pgmap v559: 97 pgs: 18 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 71 active+clean; 856 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 448 op/s 2024-09-11T00:10:14.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:13 smithi135 ceph-mon[35432]: pgmap v559: 97 pgs: 18 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 71 active+clean; 856 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 448 op/s 2024-09-11T00:10:15.075 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:10:15.075 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:10:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:15.734 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:15 smithi019 ceph-mon[30859]: pgmap v560: 97 pgs: 18 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 71 active+clean; 859 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 442 op/s 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 -- 172.21.15.19:0/775875815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c102de0 msgr2=0x7fb16c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 --2- 172.21.15.19:0/775875815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c102de0 0x7fb16c1031c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb168009900 tx=0x7fb16802a410 comp rx=0 tx=0).stop 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 -- 172.21.15.19:0/775875815 shutdown_connections 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 --2- 172.21.15.19:0/775875815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb16c109170 0x7fb16c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 --2- 172.21.15.19:0/775875815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb16c1087f0 0x7fb16c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 --2- 172.21.15.19:0/775875815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c102de0 0x7fb16c1031c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 -- 172.21.15.19:0/775875815 >> 172.21.15.19:0/775875815 conn(0x7fb16c0fe830 msgr2=0x7fb16c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 -- 172.21.15.19:0/775875815 shutdown_connections 2024-09-11T00:10:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.820+0000 7fb173e5e640 1 -- 172.21.15.19:0/775875815 wait complete. 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 Processor -- start 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 -- start start 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb16c102de0 0x7fb16c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c1087f0 0x7fb16c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb16c109170 0x7fb16c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c112e30 con 0x7fb16c1087f0 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c112cb0 con 0x7fb16c109170 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb173e5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c112fb0 con 0x7fb16c102de0 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c1087f0 0x7fb16c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c1087f0 0x7fb16c1997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48264/0 (socket says 172.21.15.19:48264) 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 -- 172.21.15.19:0/1428502588 learned_addr learned my addr 172.21.15.19:0/1428502588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb171bfa640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb16c102de0 0x7fb16c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 -- 172.21.15.19:0/1428502588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb16c102de0 msgr2=0x7fb16c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb16c102de0 0x7fb16c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1723fb640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb16c109170 0x7fb16c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 -- 172.21.15.19:0/1428502588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb16c109170 msgr2=0x7fb16c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb16c109170 0x7fb16c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.821+0000 7fb1713f9640 1 -- 172.21.15.19:0/1428502588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c19f310 con 0x7fb16c1087f0 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.822+0000 7fb1713f9640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c1087f0 0x7fb16c1997a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00e9f0 tx=0x7fb15c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.822+0000 7fb162ffd640 1 -- 172.21.15.19:0/1428502588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00cd80 con 0x7fb16c1087f0 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.822+0000 7fb162ffd640 1 -- 172.21.15.19:0/1428502588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb15c0054d0 con 0x7fb16c1087f0 2024-09-11T00:10:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.822+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c19f600 con 0x7fb16c1087f0 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.822+0000 7fb162ffd640 1 -- 172.21.15.19:0/1428502588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c010690 con 0x7fb16c1087f0 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.822+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a5cc0 con 0x7fb16c1087f0 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 Processor -- start 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 -- start start 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e3ee0 0x5594996e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb162ffd640 1 -- 172.21.15.19:0/1428502588 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fb15c004e90 con 0x7fb16c1087f0 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996f4ba0 0x5594996f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55949965ae60 con 0x5594996e3ee0 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55949964a290 con 0x5594996e4800 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb176233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55949964e0a0 con 0x5594996f4ba0 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb1723fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e3ee0 0x5594996e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb1723fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e3ee0 0x5594996e42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48272/0 (socket says 172.21.15.19:48272) 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb1723fb640 1 -- 172.21.15.19:0/3760190771 learned_addr learned my addr 172.21.15.19:0/3760190771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb171bfa640 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.825+0000 7fb1713f9640 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996f4ba0 0x5594996f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb1723fb640 1 -- 172.21.15.19:0/3760190771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996f4ba0 msgr2=0x5594996f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb1723fb640 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996f4ba0 0x5594996f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb1723fb640 1 -- 172.21.15.19:0/3760190771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 msgr2=0x5594996f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb1723fb640 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb1723fb640 1 -- 172.21.15.19:0/3760190771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594993a8930 con 0x5594996e3ee0 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb1713f9640 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996f4ba0 0x5594996f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb1723fb640 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e3ee0 0x5594996e42c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb164008dd0 tx=0x7fb16400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7debd2dd93145795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb157fff640 1 -- 172.21.15.19:0/3760190771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164018680 con 0x5594996e3ee0 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb162ffd640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb1580b54d0 0x7fb1580b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb157fff640 1 -- 172.21.15.19:0/3760190771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb164018cd0 con 0x5594996e3ee0 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb157fff640 1 -- 172.21.15.19:0/3760190771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16400fdd0 con 0x5594996e3ee0 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb171bfa640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb1580b54d0 0x7fb1580b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.826+0000 7fb162ffd640 1 -- 172.21.15.19:0/1428502588 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7fb15c0e6450 con 0x7fb16c1087f0 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 -- 172.21.15.19:0/3760190771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e3ee0 msgr2=0x5594996e42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb171bfa640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb1580b54d0 0x7fb1580b7990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb168031440 tx=0x7fb168005db0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e3ee0 0x5594996e42c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb164008dd0 tx=0x7fb16400d710 comp rx=0 tx=0).stop 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 -- 172.21.15.19:0/3760190771 shutdown_connections 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996f4ba0 0x5594996f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 --2- 172.21.15.19:0/3760190771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e3ee0 0x5594996e42c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 -- 172.21.15.19:0/3760190771 >> 172.21.15.19:0/3760190771 conn(0x5594996e1d10 msgr2=0x5594996e2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 -- 172.21.15.19:0/3760190771 shutdown_connections 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 -- 172.21.15.19:0/3760190771 wait complete. 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 -- start start 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.827+0000 7fb176233740 1 Processor -- start 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb176233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb176233740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e4800 0x5594996f2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb176233740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996f4ba0 0x5594996f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb176233740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5594994ab890 con 0x5594996e4800 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb176233740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5594995e4d40 con 0x5594996f4ba0 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb176233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5594996f7850 con 0x5594996e3ee0 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb176233740 10 client.0 _ll_register_callbacks cb 0x559499648c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e4800 0x5594996f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e4800 0x5594996f2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48276/0 (socket says 172.21.15.19:48276) 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 -- 172.21.15.19:0/4179575985 learned_addr learned my addr 172.21.15.19:0/4179575985 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb171bfa640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1723fb640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996f4ba0 0x5594996f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 -- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 msgr2=0x5594996f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 -- 172.21.15.19:0/4179575985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996f4ba0 msgr2=0x5594996f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996f4ba0 0x5594996f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 -- 172.21.15.19:0/4179575985 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559499700d00 con 0x5594996e4800 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1723fb640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996f4ba0 0x5594996f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1713f9640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e4800 0x5594996f2170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c6a0 tx=0x7fb15c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea374ee201649ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.828+0000 7fb1557fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb1557fa640 1 -- 172.21.15.19:0/4179575985 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0ac240 con 0x5594996e4800 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb1557fa640 1 -- 172.21.15.19:0/4179575985 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7fb15c0b59f0 con 0x5594996e4800 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb164018cd0 con 0x5594996e4800 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb1557fa640 1 -- 172.21.15.19:0/4179575985 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb15c0a8060 con 0x5594996e4800 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 10 client.16437 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559499703710 con 0x5594996e4800 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb1557fa640 1 -- 172.21.15.19:0/4179575985 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb164018cd0 con 0x5594996e4800 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb1557fa640 1 -- 172.21.15.19:0/4179575985 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb15c0a8240 con 0x5594996e4800 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 10 client.16437 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 20 client.16437 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499704c20 0x559499707040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 4 client.16437 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.829+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55949965cdb0 con 0x559499704c20 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.830+0000 7fb171bfa640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499704c20 0x559499707040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.830+0000 7fb171bfa640 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499704c20 0x559499707040 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8daaa3614524489 server_cookie=485e60133672cf52 in_seq=0 out_seq=0 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.830+0000 7fb1557fa640 10 client.16437 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb1557fa640 1 -- 172.21.15.19:0/4179575985 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55949965cdb0 con 0x559499704c20 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb1557fa640 10 client.16437 handle_command_reply: tid=0 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 client.16437 shutdown 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e4800 msgr2=0x5594996f2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e4800 0x5594996f2170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c6a0 tx=0x7fb15c0048f0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 shutdown_connections 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996f4ba0 0x5594996f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499704c20 0x559499707040 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996e4800 0x5594996f2170 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 --2- 172.21.15.19:0/4179575985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 >> 172.21.15.19:0/4179575985 conn(0x5594996e1d10 msgr2=0x5594996e0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb1557fa640 0 client.16437 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 shutdown_connections 2024-09-11T00:10:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 1 -- 172.21.15.19:0/4179575985 wait complete. 2024-09-11T00:10:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.831+0000 7fb176233740 20 client.16437 trim_cache size 0 max 16384 2024-09-11T00:10:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 Processor -- start 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 -- start start 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996ef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1aed10 con 0x5594996f4ba0 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1ac550 con 0x5594996e4800 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.849+0000 7fb176233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1aa3e0 con 0x5594996e3ee0 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996e5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48284/0 (socket says 172.21.15.19:48284) 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 -- 172.21.15.19:0/3639691028 learned_addr learned my addr 172.21.15.19:0/3639691028 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb171bfa640 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1713f9640 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 -- 172.21.15.19:0/3639691028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 msgr2=0x5594996ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 -- 172.21.15.19:0/3639691028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 msgr2=0x5594996f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 -- 172.21.15.19:0/3639691028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594997076c0 con 0x5594996f4ba0 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1713f9640 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1723fb640 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996e5f40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f80 tx=0x7fb164008a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca540cd37edf0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1577fe640 1 -- 172.21.15.19:0/3639691028 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164028070 con 0x5594996f4ba0 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1577fe640 1 -- 172.21.15.19:0/3639691028 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb164004c10 con 0x5594996f4ba0 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.850+0000 7fb1577fe640 1 -- 172.21.15.19:0/3639691028 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1640186e0 con 0x5594996f4ba0 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 -- 172.21.15.19:0/3639691028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 msgr2=0x5594996e5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996e5f40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f80 tx=0x7fb164008a40 comp rx=0 tx=0).stop 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 -- 172.21.15.19:0/3639691028 shutdown_connections 2024-09-11T00:10:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996e5f40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e4800 0x5594996f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 --2- 172.21.15.19:0/3639691028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e3ee0 0x5594996ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 -- 172.21.15.19:0/3639691028 >> 172.21.15.19:0/3639691028 conn(0x5594996e1d10 msgr2=0x5594996f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 -- 172.21.15.19:0/3639691028 shutdown_connections 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 -- 172.21.15.19:0/3639691028 wait complete. 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 -- start start 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.851+0000 7fb176233740 1 Processor -- start 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb176233740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e3ee0 0x5594996fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb176233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e4800 0x5594996fd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb176233740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb176233740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1aaa30 con 0x5594996f4ba0 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb176233740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1abe80 con 0x5594996e3ee0 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb176233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1ab0e0 con 0x5594996e4800 2024-09-11T00:10:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb176233740 10 client.0 _ll_register_callbacks cb 0x7fb15c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996f9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48290/0 (socket says 172.21.15.19:48290) 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 -- 172.21.15.19:0/2939217435 learned_addr learned my addr 172.21.15.19:0/2939217435 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1713f9640 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e4800 0x5594996fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb171bfa640 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e3ee0 0x5594996fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 -- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e4800 msgr2=0x5594996fd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e4800 0x5594996fd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 -- 172.21.15.19:0/2939217435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e3ee0 msgr2=0x5594996fcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e3ee0 0x5594996fcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.852+0000 7fb1723fb640 1 -- 172.21.15.19:0/2939217435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594996fd760 con 0x5594996f4ba0 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb1723fb640 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996f9ab0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb164008cc0 tx=0x7fb164005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdf7312667b1faf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb1557fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb1557fa640 1 -- 172.21.15.19:0/2939217435 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164028070 con 0x5594996f4ba0 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb1557fa640 1 -- 172.21.15.19:0/2939217435 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7fb164018690 con 0x5594996f4ba0 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb164004c10 con 0x5594996f4ba0 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb1557fa640 1 -- 172.21.15.19:0/2939217435 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb1640059c0 con 0x5594996f4ba0 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 10 client.16443 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559499772000 con 0x5594996f4ba0 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb1557fa640 1 -- 172.21.15.19:0/2939217435 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb164004c10 con 0x5594996f4ba0 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb1557fa640 1 -- 172.21.15.19:0/2939217435 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb164035020 con 0x5594996f4ba0 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 10 client.16443 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 20 client.16443 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499772500 0x559499774920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 4 client.16443 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.853+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559499658860 con 0x559499772500 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.854+0000 7fb171bfa640 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499772500 0x559499774920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.854+0000 7fb1557fa640 10 client.16443 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.854+0000 7fb171bfa640 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499772500 0x559499774920 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a8ae3801eb53b4 server_cookie=c63f2e7da311049e in_seq=0 out_seq=0 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb1557fa640 1 -- 172.21.15.19:0/2939217435 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559499658860 con 0x559499772500 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb1557fa640 10 client.16443 handle_command_reply: tid=0 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 client.16443 shutdown 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 msgr2=0x5594996f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996f9ab0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb164008cc0 tx=0x7fb164005560 comp rx=0 tx=0).stop 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 shutdown_connections 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x559499772500 0x559499774920 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5594996f4ba0 0x5594996f9ab0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594996e4800 0x5594996fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb1557fa640 0 client.16443 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 --2- 172.21.15.19:0/2939217435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594996e3ee0 0x5594996fcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 >> 172.21.15.19:0/2939217435 conn(0x5594996e1d10 msgr2=0x5594996e7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 shutdown_connections 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 1 -- 172.21.15.19:0/2939217435 wait complete. 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.856+0000 7fb176233740 20 client.16443 trim_cache size 0 max 16384 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "04e44eaf-9077-464d-9dfd-e4df0cb597dd", 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:10:15.865 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:10:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb1580b54d0 msgr2=0x7fb1580b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb1580b54d0 0x7fb1580b7990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb168031440 tx=0x7fb168005db0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c1087f0 msgr2=0x7fb16c1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c1087f0 0x7fb16c1997a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00e9f0 tx=0x7fb15c00edf0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 shutdown_connections 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb16c109170 0x7fb16c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fb1580b54d0 0x7fb1580b7990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb16c1087f0 0x7fb16c1997a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 --2- 172.21.15.19:0/1428502588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb16c102de0 0x7fb16c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 >> 172.21.15.19:0/1428502588 conn(0x7fb16c0fe830 msgr2=0x7fb16c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 shutdown_connections 2024-09-11T00:10:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:15.857+0000 7fb173e5e640 1 -- 172.21.15.19:0/1428502588 wait complete. 2024-09-11T00:10:16.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:15 smithi131 ceph-mon[35491]: pgmap v560: 97 pgs: 18 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 71 active+clean; 859 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 442 op/s 2024-09-11T00:10:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:15 smithi135 ceph-mon[35432]: pgmap v560: 97 pgs: 18 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 71 active+clean; 859 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 442 op/s 2024-09-11T00:10:16.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:10:16.831 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:16.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:16 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:10:16.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:16 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:10:16.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:16 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:10:16.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:16 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:10:17.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:16 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:10:17.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:16 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:10:17.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:16 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:10:17.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:16 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:10:17.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:16 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:10:17.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:16 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:10:17.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:16 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:10:17.177 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:16 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 -- 172.21.15.19:0/2695506901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca41087d0 msgr2=0x7f4ca4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/2695506901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca41087d0 0x7f4ca4108c10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009900 tx=0x7f4c9802a410 comp rx=0 tx=0).stop 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 -- 172.21.15.19:0/2695506901 shutdown_connections 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/2695506901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca4109150 0x7f4ca410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/2695506901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca41087d0 0x7f4ca4108c10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/2695506901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca4102dc0 0x7f4ca41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 -- 172.21.15.19:0/2695506901 >> 172.21.15.19:0/2695506901 conn(0x7f4ca40fe830 msgr2=0x7f4ca4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 -- 172.21.15.19:0/2695506901 shutdown_connections 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.335+0000 7f4cac0e4640 1 -- 172.21.15.19:0/2695506901 wait complete. 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 Processor -- start 2024-09-11T00:10:17.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 -- start start 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca4102dc0 0x7f4ca4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca41087d0 0x7f4ca4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca4109150 0x7f4ca419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4112e10 con 0x7f4ca4109150 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4112c90 con 0x7f4ca4102dc0 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4cac0e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4112f90 con 0x7f4ca41087d0 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca4109150 0x7f4ca419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca4109150 0x7f4ca419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48318/0 (socket says 172.21.15.19:48318) 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 -- 172.21.15.19:0/452620629 learned_addr learned my addr 172.21.15.19:0/452620629 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca4102dc0 0x7f4ca4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4ca967f640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca41087d0 0x7f4ca4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 -- 172.21.15.19:0/452620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca41087d0 msgr2=0x7f4ca4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca41087d0 0x7f4ca4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 -- 172.21.15.19:0/452620629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca4102dc0 msgr2=0x7f4ca4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca4102dc0 0x7f4ca4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.336+0000 7f4caa681640 1 -- 172.21.15.19:0/452620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca419f3b0 con 0x7f4ca4109150 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.337+0000 7f4caa681640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca4109150 0x7f4ca419ebe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400eaa0 tx=0x7f4c9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.337+0000 7f4ca2ffd640 1 -- 172.21.15.19:0/452620629 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400cdb0 con 0x7f4ca4109150 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.337+0000 7f4ca2ffd640 1 -- 172.21.15.19:0/452620629 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c94005020 con 0x7f4ca4109150 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.337+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca419f6a0 con 0x7f4ca4109150 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.337+0000 7f4ca2ffd640 1 -- 172.21.15.19:0/452620629 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c940116d0 con 0x7f4ca4109150 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.337+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca41a5f30 con 0x7f4ca4109150 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.339+0000 7f4cae4b9740 1 Processor -- start 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.339+0000 7f4ca2ffd640 1 -- 172.21.15.19:0/452620629 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f4c9400f040 con 0x7f4ca4109150 2024-09-11T00:10:17.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4cae4b9740 1 -- start start 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1b480 0x55b572b1b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1bda0 0x55b572b277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b572a91e50 con 0x55b572b27d30 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55b572a81280 con 0x55b572b1bda0 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b572a85090 con 0x55b572b1b480 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca967f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca967f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48320/0 (socket says 172.21.15.19:48320) 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca967f640 1 -- 172.21.15.19:0/1819895156 learned_addr learned my addr 172.21.15.19:0/1819895156 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca967f640 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1b480 0x55b572b1b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1bda0 0x55b572b277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca2ffd640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4c8c0b54d0 0x7f4c8c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca967f640 1 -- 172.21.15.19:0/1819895156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1b480 msgr2=0x55b572b1b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.340+0000 7f4ca967f640 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1b480 0x55b572b1b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4ca967f640 1 -- 172.21.15.19:0/1819895156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1bda0 msgr2=0x55b572b277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4ca967f640 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1bda0 0x55b572b277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4ca967f640 1 -- 172.21.15.19:0/1819895156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5727df650 con 0x55b572b27d30 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4caa681640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4c8c0b54d0 0x7f4c8c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1bda0 0x55b572b277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4ca2ffd640 1 -- 172.21.15.19:0/452620629 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f4c940e5d30 con 0x7f4ca4109150 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4ca967f640 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2a120 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4c980096c0 tx=0x7f4c98005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369ea7dd79c399da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4c8bfff640 1 -- 172.21.15.19:0/1819895156 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98035040 con 0x55b572b27d30 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4c8bfff640 1 -- 172.21.15.19:0/1819895156 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c98004030 con 0x55b572b27d30 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.341+0000 7f4c8bfff640 1 -- 172.21.15.19:0/1819895156 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98003970 con 0x55b572b27d30 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 -- 172.21.15.19:0/1819895156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 msgr2=0x55b572b2a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2a120 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4c980096c0 tx=0x7f4c98005b50 comp rx=0 tx=0).stop 2024-09-11T00:10:17.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4caa681640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4c8c0b54d0 0x7f4c8c0b7990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4c940e3550 tx=0x7f4c940783b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 -- 172.21.15.19:0/1819895156 shutdown_connections 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2a120 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1bda0 0x55b572b277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/1819895156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1b480 0x55b572b1b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 -- 172.21.15.19:0/1819895156 >> 172.21.15.19:0/1819895156 conn(0x55b572b192b0 msgr2=0x55b572b1a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 -- 172.21.15.19:0/1819895156 shutdown_connections 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 -- 172.21.15.19:0/1819895156 wait complete. 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 -- start start 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.342+0000 7f4cae4b9740 1 Processor -- start 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b24af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b25170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b5728e2700 con 0x55b572b1bda0 2024-09-11T00:10:17.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55b572a1c110 con 0x55b572b1b480 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b572b2a950 con 0x55b572b27d30 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4cae4b9740 10 client.0 _ll_register_callbacks cb 0x55b572a35990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b24af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b24af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48324/0 (socket says 172.21.15.19:48324) 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 -- 172.21.15.19:0/393349032 learned_addr learned my addr 172.21.15.19:0/393349032 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca967f640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca967f640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b25170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 -- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 msgr2=0x55b572b25170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b25170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 -- 172.21.15.19:0/393349032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 msgr2=0x55b572b276a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b276a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca9e80640 1 -- 172.21.15.19:0/393349032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b572a49c40 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.343+0000 7f4ca967f640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b24af0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00baa0 tx=0x7f4c9c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608a3a61a3d66ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4c897fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4c897fa640 1 -- 172.21.15.19:0/393349032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c01b640 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4c897fa640 1 -- 172.21.15.19:0/393349032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f4c9c01b7e0 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c98004030 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4c897fa640 1 -- 172.21.15.19:0/393349032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4c9c01b9e0 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 10 client.16455 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b572b36390 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4c897fa640 1 -- 172.21.15.19:0/393349032 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c98004030 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4c897fa640 1 -- 172.21.15.19:0/393349032 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4c9c019020 con 0x55b572b1bda0 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 10 client.16455 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:17.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 20 client.16455 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572b37850 0x55b572b39cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 4 client.16455 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.344+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b572a93da0 con 0x55b572b37850 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.345+0000 7f4ca967f640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572b37850 0x55b572b39cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.345+0000 7f4ca967f640 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572b37850 0x55b572b39cb0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be98a811b6249be6 server_cookie=43e3778885ecb331 in_seq=0 out_seq=0 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.345+0000 7f4c897fa640 10 client.16455 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4c897fa640 1 -- 172.21.15.19:0/393349032 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b572a93da0 con 0x55b572b37850 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4c897fa640 10 client.16455 handle_command_reply: tid=0 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 client.16455 shutdown 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 msgr2=0x55b572b24af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b24af0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00baa0 tx=0x7f4c9c00bf60 comp rx=0 tx=0).stop 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 shutdown_connections 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b25170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572b37850 0x55b572b39cb0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b24af0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4c897fa640 0 client.16455 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/393349032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 >> 172.21.15.19:0/393349032 conn(0x55b572b192b0 msgr2=0x55b572b1ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 shutdown_connections 2024-09-11T00:10:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 1 -- 172.21.15.19:0/393349032 wait complete. 2024-09-11T00:10:17.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.346+0000 7f4cae4b9740 20 client.16455 trim_cache size 0 max 16384 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 Processor -- start 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 -- start start 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b1aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b18bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41b1070 con 0x55b572b1bda0 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41ae8b0 con 0x55b572b1b480 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.364+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41ac720 con 0x55b572b27d30 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b142d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48332/0 (socket says 172.21.15.19:48332) 2024-09-11T00:10:17.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 -- 172.21.15.19:0/652532481 learned_addr learned my addr 172.21.15.19:0/652532481 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 -- 172.21.15.19:0/652532481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 msgr2=0x55b572b18bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca967f640 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b18bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b18bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 -- 172.21.15.19:0/652532481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 msgr2=0x55b572b1aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b1aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 -- 172.21.15.19:0/652532481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b572b23a50 con 0x55b572b1bda0 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca967f640 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b18bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b142d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c010 tx=0x7f4c9c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5322e62ae3e16f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4c8b7fe640 1 -- 172.21.15.19:0/652532481 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c028040 con 0x55b572b1bda0 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4c8b7fe640 1 -- 172.21.15.19:0/652532481 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c9c01bd80 con 0x55b572b1bda0 2024-09-11T00:10:17.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.365+0000 7f4c8b7fe640 1 -- 172.21.15.19:0/652532481 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c02e430 con 0x55b572b1bda0 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 -- 172.21.15.19:0/652532481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 msgr2=0x55b572b142d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b142d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c010 tx=0x7f4c9c005670 comp rx=0 tx=0).stop 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 -- 172.21.15.19:0/652532481 shutdown_connections 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b27d30 0x55b572b18bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b1bda0 0x55b572b142d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/652532481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b1aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 -- 172.21.15.19:0/652532481 >> 172.21.15.19:0/652532481 conn(0x55b572b192b0 msgr2=0x55b572b1a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 -- 172.21.15.19:0/652532481 shutdown_connections 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 -- 172.21.15.19:0/652532481 wait complete. 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 -- start start 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.366+0000 7f4cae4b9740 1 Processor -- start 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b2fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1bda0 0x55b572b30160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4cae4b9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41acd70 con 0x55b572b27d30 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41ae1e0 con 0x55b572b1b480 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4cae4b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41ad440 con 0x55b572b1bda0 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4cae4b9740 10 client.0 _ll_register_callbacks cb 0x7f4c9c004080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48338/0 (socket says 172.21.15.19:48338) 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 -- 172.21.15.19:0/3350595514 learned_addr learned my addr 172.21.15.19:0/3350595514 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1bda0 0x55b572b30160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b2fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 -- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1bda0 msgr2=0x55b572b30160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1bda0 0x55b572b30160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 -- 172.21.15.19:0/3350595514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 msgr2=0x55b572b2fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b2fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.367+0000 7f4ca967f640 1 -- 172.21.15.19:0/3350595514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b572b2b140 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4ca967f640 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2abd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4c98031600 tx=0x7f4c98005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7128bdcc90c6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4c897fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4c897fa640 1 -- 172.21.15.19:0/3350595514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98035040 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4c897fa640 1 -- 172.21.15.19:0/3350595514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8485+0+0 (secure 0 0 0) 0x7f4c98031c30 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c9c01bd80 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4c897fa640 1 -- 172.21.15.19:0/3350595514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4c98003680 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 10 client.16461 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b572ba4fa0 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4c897fa640 1 -- 172.21.15.19:0/3350595514 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c9c01bd80 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4c897fa640 1 -- 172.21.15.19:0/3350595514 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4c9803a040 con 0x55b572b27d30 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 10 client.16461 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 10 client.16461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:17.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 20 client.16461 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572ba5330 0x55b572ba7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 4 client.16461 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:10:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.368+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b572a8f850 con 0x55b572ba5330 2024-09-11T00:10:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572ba5330 0x55b572ba7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4ca9e80640 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572ba5330 0x55b572ba7720 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f25c008c22e39734 server_cookie=776ee6ecc63bca43 in_seq=0 out_seq=0 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4c897fa640 10 client.16461 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4c897fa640 1 -- 172.21.15.19:0/3350595514 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x55b572a8f850 con 0x55b572ba5330 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4c897fa640 10 client.16461 handle_command_reply: tid=0 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4cae4b9740 1 client.16461 shutdown 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 msgr2=0x55b572b2abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.369+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2abd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4c98031600 tx=0x7f4c98005dd0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 shutdown_connections 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b572ba5330 0x55b572ba7720 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b572b27d30 0x55b572b2abd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b572b1bda0 0x55b572b30160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4c897fa640 0 client.16461 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 --2- 172.21.15.19:0/3350595514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b572b1b480 0x55b572b2fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 >> 172.21.15.19:0/3350595514 conn(0x55b572b192b0 msgr2=0x55b572b26120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 shutdown_connections 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 1 -- 172.21.15.19:0/3350595514 wait complete. 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cae4b9740 20 client.16461 trim_cache size 0 max 16384 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:10:17.376 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "04e44eaf-9077-464d-9dfd-e4df0cb597dd", 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:10:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.381 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:17.383 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:10:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4c8c0b54d0 msgr2=0x7f4c8c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4c8c0b54d0 0x7f4c8c0b7990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4c940e3550 tx=0x7f4c940783b0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca4109150 msgr2=0x7f4ca419ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca4109150 0x7f4ca419ebe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400eaa0 tx=0x7f4c9400ef60 comp rx=0 tx=0).stop 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 shutdown_connections 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f4c8c0b54d0 0x7f4c8c0b7990 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ca4109150 0x7f4ca419ebe0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca41087d0 0x7f4ca4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 --2- 172.21.15.19:0/452620629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca4102dc0 0x7f4ca4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.370+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 >> 172.21.15.19:0/452620629 conn(0x7f4ca40fe830 msgr2=0x7f4ca4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.371+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 shutdown_connections 2024-09-11T00:10:17.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:17.371+0000 7f4cac0e4640 1 -- 172.21.15.19:0/452620629 wait complete. 2024-09-11T00:10:18.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:17 smithi019 ceph-mon[30859]: pgmap v561: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 401 op/s 2024-09-11T00:10:18.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:17 smithi131 ceph-mon[35491]: pgmap v561: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 401 op/s 2024-09-11T00:10:18.087 INFO:tasks.cephfs.filesystem:scrub status for tag:04e44eaf-9077-464d-9dfd-e4df0cb597dd - {'path': '/', 'tag': '04e44eaf-9077-464d-9dfd-e4df0cb597dd', 'options': 'recursive,force'} 2024-09-11T00:10:18.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:17 smithi135 ceph-mon[35432]: pgmap v561: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 401 op/s 2024-09-11T00:10:20.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:19 smithi019 ceph-mon[30859]: pgmap v562: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 306 op/s 2024-09-11T00:10:20.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:19 smithi019 ceph-mon[30859]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T00:10:20.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:19 smithi131 ceph-mon[35491]: pgmap v562: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 306 op/s 2024-09-11T00:10:20.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:19 smithi131 ceph-mon[35491]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T00:10:20.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:19 smithi135 ceph-mon[35432]: pgmap v562: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 306 op/s 2024-09-11T00:10:20.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:19 smithi135 ceph-mon[35432]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T00:10:21.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:20 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:10:21.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:20 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:10:21.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:20 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:10:22.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:21 smithi019 ceph-mon[30859]: pgmap v564: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-11T00:10:22.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:21 smithi131 ceph-mon[35491]: pgmap v564: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-11T00:10:22.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:21 smithi135 ceph-mon[35432]: pgmap v564: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-11T00:10:24.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:23 smithi019 ceph-mon[30859]: pgmap v565: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 453 KiB/s wr, 101 op/s 2024-09-11T00:10:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:23 smithi131 ceph-mon[35491]: pgmap v565: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 453 KiB/s wr, 101 op/s 2024-09-11T00:10:24.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:23 smithi135 ceph-mon[35432]: pgmap v565: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 453 KiB/s wr, 101 op/s 2024-09-11T00:10:26.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:25 smithi131 ceph-mon[35491]: pgmap v566: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 104 KiB/s wr, 69 op/s 2024-09-11T00:10:26.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:25 smithi135 ceph-mon[35432]: pgmap v566: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 104 KiB/s wr, 69 op/s 2024-09-11T00:10:26.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:25 smithi019 ceph-mon[30859]: pgmap v566: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 104 KiB/s wr, 69 op/s 2024-09-11T00:10:28.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:27 smithi131 ceph-mon[35491]: pgmap v567: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 25 op/s 2024-09-11T00:10:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:27 smithi135 ceph-mon[35432]: pgmap v567: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 25 op/s 2024-09-11T00:10:28.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:27 smithi019 ceph-mon[30859]: pgmap v567: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 25 op/s 2024-09-11T00:10:30.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:29 smithi131 ceph-mon[35491]: pgmap v568: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-09-11T00:10:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:29 smithi135 ceph-mon[35432]: pgmap v568: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-09-11T00:10:30.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:29 smithi019 ceph-mon[30859]: pgmap v568: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-09-11T00:10:32.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:31 smithi131 ceph-mon[35491]: pgmap v569: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 9 op/s 2024-09-11T00:10:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:31 smithi135 ceph-mon[35432]: pgmap v569: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 9 op/s 2024-09-11T00:10:32.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:31 smithi019 ceph-mon[30859]: pgmap v569: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 9 op/s 2024-09-11T00:10:34.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:33 smithi131 ceph-mon[35491]: pgmap v570: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-09-11T00:10:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:33 smithi135 ceph-mon[35432]: pgmap v570: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-09-11T00:10:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:33 smithi019 ceph-mon[30859]: pgmap v570: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-09-11T00:10:36.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:35 smithi131 ceph-mon[35491]: pgmap v571: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-11T00:10:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:35 smithi135 ceph-mon[35432]: pgmap v571: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-11T00:10:36.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:35 smithi019 ceph-mon[30859]: pgmap v571: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-11T00:10:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:37 smithi135 ceph-mon[35432]: pgmap v572: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-11T00:10:38.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:37 smithi019 ceph-mon[30859]: pgmap v572: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-11T00:10:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:37 smithi131 ceph-mon[35491]: pgmap v572: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-11T00:10:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:39 smithi135 ceph-mon[35432]: pgmap v573: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:40.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:39 smithi019 ceph-mon[30859]: pgmap v573: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:39 smithi131 ceph-mon[35491]: pgmap v573: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:41 smithi135 ceph-mon[35432]: pgmap v574: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:42.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:41 smithi019 ceph-mon[30859]: pgmap v574: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:42.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:41 smithi131 ceph-mon[35491]: pgmap v574: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:44.102 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:43 smithi131 ceph-mon[35491]: pgmap v575: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-11T00:10:44.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:43 smithi135 ceph-mon[35432]: pgmap v575: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-11T00:10:44.331 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:43 smithi019 ceph-mon[30859]: pgmap v575: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-11T00:10:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:45 smithi135 ceph-mon[35432]: pgmap v576: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:46.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:45 smithi019 ceph-mon[30859]: pgmap v576: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:45 smithi131 ceph-mon[35491]: pgmap v576: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:10:48.075 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:47 smithi019 ceph-mon[30859]: pgmap v577: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:10:48.088 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:10:48.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:47 smithi135 ceph-mon[35432]: pgmap v577: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:10:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:47 smithi131 ceph-mon[35491]: pgmap v577: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:10:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:48.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/1850332482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c281087d0 msgr2=0x7f9c28108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/1850332482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c281087d0 0x7f9c28108c10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c1802a410 comp rx=0 tx=0).stop 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/1850332482 shutdown_connections 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/1850332482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c28109150 0x7f9c2810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/1850332482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c281087d0 0x7f9c28108c10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/1850332482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c28102dc0 0x7f9c281031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/1850332482 >> 172.21.15.19:0/1850332482 conn(0x7f9c280fe830 msgr2=0x7f9c28100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/1850332482 shutdown_connections 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.906+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/1850332482 wait complete. 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 Processor -- start 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 -- start start 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c28102dc0 0x7f9c281993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c281087d0 0x7f9c28199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c28109150 0x7f9c2819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28112e50 con 0x7f9c28109150 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28112cd0 con 0x7f9c28102dc0 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2f9ca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28112fd0 con 0x7f9c281087d0 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2df67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c28109150 0x7f9c2819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2df67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c28109150 0x7f9c2819eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53858/0 (socket says 172.21.15.19:53858) 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.907+0000 7f9c2df67640 1 -- 172.21.15.19:0/3545648006 learned_addr learned my addr 172.21.15.19:0/3545648006 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2d766640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c28102dc0 0x7f9c281993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c281087d0 0x7f9c28199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2df67640 1 -- 172.21.15.19:0/3545648006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c281087d0 msgr2=0x7f9c28199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2df67640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c281087d0 0x7f9c28199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2df67640 1 -- 172.21.15.19:0/3545648006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c28102dc0 msgr2=0x7f9c281993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2df67640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c28102dc0 0x7f9c281993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2df67640 1 -- 172.21.15.19:0/3545648006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2819f470 con 0x7f9c28109150 2024-09-11T00:10:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2df67640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c28109150 0x7f9c2819eca0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000b970 tx=0x7f9c2000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c1e7fc640 1 -- 172.21.15.19:0/3545648006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20019070 con 0x7f9c28109150 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c1e7fc640 1 -- 172.21.15.19:0/3545648006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c20014440 con 0x7f9c28109150 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2819f760 con 0x7f9c28109150 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c1e7fc640 1 -- 172.21.15.19:0/3545648006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200075d0 con 0x7f9c28109150 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.908+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c281a5e20 con 0x7f9c28109150 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.911+0000 7f9c31d9f740 1 Processor -- start 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.911+0000 7f9c1e7fc640 1 -- 172.21.15.19:0/3545648006 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f9c200145f0 con 0x7f9c28109150 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.911+0000 7f9c31d9f740 1 -- start start 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d87499860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561d8740fe50 con 0x561d87499da0 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561d873ff280 con 0x561d87499480 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561d87403090 con 0x561d874aa140 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53874/0 (socket says 172.21.15.19:53874) 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 -- 172.21.15.19:0/485686227 learned_addr learned my addr 172.21.15.19:0/485686227 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d87499860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 -- 172.21.15.19:0/485686227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 msgr2=0x561d874ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 -- 172.21.15.19:0/485686227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 msgr2=0x561d87499860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d87499860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 -- 172.21.15.19:0/485686227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d8715d650 con 0x561d87499da0 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d87499860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c1e7fc640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c140b5450 0x7f9c140b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2d766640 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a9c00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009aa0 tx=0x7f9c24009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c870dc0b313c9a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c140b5450 0x7f9c140b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.912+0000 7f9c1e7fc640 1 -- 172.21.15.19:0/3545648006 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f9c200e5670 con 0x7f9c28109150 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.913+0000 7f9c137fe640 1 -- 172.21.15.19:0/485686227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24017070 con 0x561d87499da0 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.913+0000 7f9c137fe640 1 -- 172.21.15.19:0/485686227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c24013470 con 0x561d87499da0 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.913+0000 7f9c137fe640 1 -- 172.21.15.19:0/485686227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24012610 con 0x561d87499da0 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.913+0000 7f9c31d9f740 1 -- 172.21.15.19:0/485686227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 msgr2=0x561d874a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.913+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c140b5450 0x7f9c140b7910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c18031440 tx=0x7f9c18005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.913+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a9c00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009aa0 tx=0x7f9c24009f60 comp rx=0 tx=0).stop 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 -- 172.21.15.19:0/485686227 shutdown_connections 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a9c00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/485686227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d87499860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 -- 172.21.15.19:0/485686227 >> 172.21.15.19:0/485686227 conn(0x561d874972b0 msgr2=0x561d87498450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 -- 172.21.15.19:0/485686227 shutdown_connections 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 -- 172.21.15.19:0/485686227 wait complete. 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 -- start start 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.914+0000 7f9c31d9f740 1 Processor -- start 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874a7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561d87260700 con 0x561d87499da0 2024-09-11T00:10:48.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561d8739a110 con 0x561d87499480 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561d874acdf0 con 0x561d874aa140 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c31d9f740 10 client.0 _ll_register_callbacks cb 0x561d873b3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53886/0 (socket says 172.21.15.19:53886) 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 -- 172.21.15.19:0/558342402 learned_addr learned my addr 172.21.15.19:0/558342402 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2df67640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2d766640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 -- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 msgr2=0x561d874a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874a7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 -- 172.21.15.19:0/558342402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 msgr2=0x561d874a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 -- 172.21.15.19:0/558342402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d873c7c40 con 0x561d87499da0 2024-09-11T00:10:48.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2df67640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a6e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9c18033000 tx=0x7f9c18005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6153c9c8827b9989 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.915+0000 7f9c10ff9640 1 -- 172.21.15.19:0/558342402 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18050020 con 0x561d87499da0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c24013470 con 0x561d87499da0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c10ff9640 1 -- 172.21.15.19:0/558342402 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f9c180037f0 con 0x561d87499da0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c10ff9640 1 -- 172.21.15.19:0/558342402 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9c18035040 con 0x561d87499da0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 10 client.16473 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561d874b86f0 con 0x561d87499da0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c10ff9640 1 -- 172.21.15.19:0/558342402 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c24013470 con 0x561d87499da0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c10ff9640 1 -- 172.21.15.19:0/558342402 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9c1803eaa0 con 0x561d87499da0 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 10 client.16473 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 20 client.16473 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:48.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d874bc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 4 client.16473 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.916+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d87411da0 con 0x561d874b9bc0 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.917+0000 7f9c2d766640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d874bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.917+0000 7f9c2d766640 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d874bc020 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62698e9ff680c771 server_cookie=bf9dba0799ccb00e in_seq=0 out_seq=0 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.917+0000 7f9c10ff9640 10 client.16473 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c10ff9640 1 -- 172.21.15.19:0/558342402 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d87411da0 con 0x561d874b9bc0 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c10ff9640 10 client.16473 handle_command_reply: tid=0 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 client.16473 shutdown 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 msgr2=0x561d874a6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a6e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9c18033000 tx=0x7f9c18005b50 comp rx=0 tx=0).stop 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 shutdown_connections 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d874bc020 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c10ff9640 0 client.16473 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874a6e00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/558342402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 >> 172.21.15.19:0/558342402 conn(0x561d874972b0 msgr2=0x561d8749cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 shutdown_connections 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 1 -- 172.21.15.19:0/558342402 wait complete. 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.918+0000 7f9c31d9f740 20 client.16473 trim_cache size 0 max 16384 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 Processor -- start 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 -- start start 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d87499480 0x561d874b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499da0 0x561d87492340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d874aa140 0x561d874c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281aee30 con 0x561d874aa140 2024-09-11T00:10:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281ac670 con 0x561d87499da0 2024-09-11T00:10:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281aa4c0 con 0x561d87499480 2024-09-11T00:10:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d874aa140 0x561d874c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d874aa140 0x561d874c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53898/0 (socket says 172.21.15.19:53898) 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 -- 172.21.15.19:0/4251769062 learned_addr learned my addr 172.21.15.19:0/4251769062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2d766640 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d87499480 0x561d874b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499da0 0x561d87492340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 -- 172.21.15.19:0/4251769062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d87499480 msgr2=0x561d874b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d87499480 0x561d874b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 -- 172.21.15.19:0/4251769062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499da0 msgr2=0x561d87492340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499da0 0x561d87492340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 -- 172.21.15.19:0/4251769062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d874970e0 con 0x561d874aa140 2024-09-11T00:10:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.936+0000 7f9c2df67640 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d874aa140 0x561d874c18f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9c200a8e60 tx=0x7f9c20004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9d7bd191e5b277 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c12ffd640 1 -- 172.21.15.19:0/4251769062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200ab700 con 0x561d874aa140 2024-09-11T00:10:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c12ffd640 1 -- 172.21.15.19:0/4251769062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c200abbf0 con 0x561d874aa140 2024-09-11T00:10:48.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c12ffd640 1 -- 172.21.15.19:0/4251769062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200b4c40 con 0x561d874aa140 2024-09-11T00:10:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 -- 172.21.15.19:0/4251769062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d874aa140 msgr2=0x561d874c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d874aa140 0x561d874c18f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9c200a8e60 tx=0x7f9c20004b50 comp rx=0 tx=0).stop 2024-09-11T00:10:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 -- 172.21.15.19:0/4251769062 shutdown_connections 2024-09-11T00:10:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d874aa140 0x561d874c18f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499da0 0x561d87492340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/4251769062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d87499480 0x561d874b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 -- 172.21.15.19:0/4251769062 >> 172.21.15.19:0/4251769062 conn(0x561d874972b0 msgr2=0x561d874abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 -- 172.21.15.19:0/4251769062 shutdown_connections 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.937+0000 7f9c31d9f740 1 -- 172.21.15.19:0/4251769062 wait complete. 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 -- start start 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 Processor -- start 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281aab30 con 0x561d87499da0 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281abfa0 con 0x561d87499480 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281ab200 con 0x561d874aa140 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.938+0000 7f9c31d9f740 10 client.0 _ll_register_callbacks cb 0x7f9c18009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53906/0 (socket says 172.21.15.19:53906) 2024-09-11T00:10:48.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 -- 172.21.15.19:0/2080832021 learned_addr learned my addr 172.21.15.19:0/2080832021 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2d766640 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2df67640 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 -- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 msgr2=0x561d874af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 -- 172.21.15.19:0/2080832021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 msgr2=0x561d874b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 -- 172.21.15.19:0/2080832021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d874af6c0 con 0x561d87499da0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c2cf65640 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874b27a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9c1803b570 tx=0x7f9c18032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675e0f0182dfcd35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c10ff9640 1 -- 172.21.15.19:0/2080832021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18064060 con 0x561d87499da0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c10ff9640 1 -- 172.21.15.19:0/2080832021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f9c18005240 con 0x561d87499da0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c200abbf0 con 0x561d87499da0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c10ff9640 1 -- 172.21.15.19:0/2080832021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9c18050070 con 0x561d87499da0 2024-09-11T00:10:48.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c31d9f740 10 client.16479 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.939+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561d87527470 con 0x561d87499da0 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c10ff9640 1 -- 172.21.15.19:0/2080832021 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c200abbf0 con 0x561d87499da0 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c10ff9640 1 -- 172.21.15.19:0/2080832021 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9c180035f0 con 0x561d87499da0 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c31d9f740 10 client.16479 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c31d9f740 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c31d9f740 20 client.16479 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d87529c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c31d9f740 4 client.16479 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561d8740d850 con 0x561d874b9bc0 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.940+0000 7f9c2d766640 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d87529c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c2d766640 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d87529c30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9492c4a80d3b848 server_cookie=c079460031e391eb in_seq=0 out_seq=0 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c10ff9640 10 client.16479 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:48.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c10ff9640 1 -- 172.21.15.19:0/2080832021 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x561d8740d850 con 0x561d874b9bc0 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c10ff9640 10 client.16479 handle_command_reply: tid=0 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 client.16479 shutdown 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 msgr2=0x561d874b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874b27a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9c1803b570 tx=0x7f9c18032f90 comp rx=0 tx=0).stop 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 shutdown_connections 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d874aa140 0x561d874af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x561d874b9bc0 0x561d87529c30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561d87499da0 0x561d874b27a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 --2- 172.21.15.19:0/2080832021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d87499480 0x561d874b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 >> 172.21.15.19:0/2080832021 conn(0x561d874972b0 msgr2=0x561d874a8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c10ff9640 0 client.16479 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 shutdown_connections 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 1 -- 172.21.15.19:0/2080832021 wait complete. 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.941+0000 7f9c31d9f740 20 client.16479 trim_cache size 0 max 16384 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:10:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:10:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:10:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:48.968 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c140b5450 msgr2=0x7f9c140b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c140b5450 0x7f9c140b7910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c18031440 tx=0x7f9c18005e80 comp rx=0 tx=0).stop 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c28109150 msgr2=0x7f9c2819eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c28109150 0x7f9c2819eca0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000b970 tx=0x7f9c2000bd70 comp rx=0 tx=0).stop 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 shutdown_connections 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9c140b5450 0x7f9c140b7910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c28109150 0x7f9c2819eca0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c281087d0 0x7f9c28199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 --2- 172.21.15.19:0/3545648006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c28102dc0 0x7f9c281993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 >> 172.21.15.19:0/3545648006 conn(0x7f9c280fe830 msgr2=0x7f9c28100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 shutdown_connections 2024-09-11T00:10:48.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:48.942+0000 7f9c2f9ca640 1 -- 172.21.15.19:0/3545648006 wait complete. 2024-09-11T00:10:49.965 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:10:49.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:10:50.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:49 smithi135 ceph-mon[35432]: pgmap v578: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:10:50.225 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:50.265 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:49 smithi019 ceph-mon[30859]: pgmap v578: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:10:50.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:49 smithi131 ceph-mon[35491]: pgmap v578: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:10:50.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.763+0000 7fa464dd3640 1 -- 172.21.15.19:0/3738049248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 msgr2=0x7fa4601020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.763+0000 7fa464dd3640 1 --2- 172.21.15.19:0/3738049248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa4601020b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa450009900 tx=0x7fa45002a410 comp rx=0 tx=0).stop 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 -- 172.21.15.19:0/3738049248 shutdown_connections 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 --2- 172.21.15.19:0/3738049248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460108060 0x7fa46010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 --2- 172.21.15.19:0/3738049248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4601076e0 0x7fa460107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 --2- 172.21.15.19:0/3738049248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa4601020b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 -- 172.21.15.19:0/3738049248 >> 172.21.15.19:0/3738049248 conn(0x7fa4600fd700 msgr2=0x7fa4600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 -- 172.21.15.19:0/3738049248 shutdown_connections 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 -- 172.21.15.19:0/3738049248 wait complete. 2024-09-11T00:10:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 Processor -- start 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.764+0000 7fa464dd3640 1 -- start start 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa464dd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa460199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa464dd3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4601076e0 0x7fa460199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa464dd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa460108060 0x7fa46019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa464dd3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa460112dd0 con 0x7fa460101cd0 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa464dd3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa460112c50 con 0x7fa4601076e0 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa464dd3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa460112f50 con 0x7fa460108060 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa460199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa460199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53928/0 (socket says 172.21.15.19:53928) 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 -- 172.21.15.19:0/1798447019 learned_addr learned my addr 172.21.15.19:0/1798447019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45ed9d640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa460108060 0x7fa46019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45dd9b640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4601076e0 0x7fa460199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 -- 172.21.15.19:0/1798447019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa460108060 msgr2=0x7fa46019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa460108060 0x7fa46019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 -- 172.21.15.19:0/1798447019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4601076e0 msgr2=0x7fa460199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4601076e0 0x7fa460199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 -- 172.21.15.19:0/1798447019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46019f2b0 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.765+0000 7fa45e59c640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa460199200 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa450005940 tx=0x7fa4500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.766+0000 7fa44f7fe640 1 -- 172.21.15.19:0/1798447019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45003f030 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.766+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46019f540 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.766+0000 7fa44f7fe640 1 -- 172.21.15.19:0/1798447019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa450003cb0 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.766+0000 7fa44f7fe640 1 -- 172.21.15.19:0/1798447019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450035070 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.766+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a5c60 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.767+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4601020b0 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.768+0000 7fa44f7fe640 1 -- 172.21.15.19:0/1798447019 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fa45003bbf0 con 0x7fa460101cd0 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.769+0000 7fa44f7fe640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4480b5450 0x7fa4480b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:50.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.769+0000 7fa45dd9b640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4480b5450 0x7fa4480b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.769+0000 7fa44f7fe640 1 -- 172.21.15.19:0/1798447019 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fa450106d80 con 0x7fa460101cd0 2024-09-11T00:10:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.770+0000 7fa45dd9b640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4480b5450 0x7fa4480b7910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa454005e10 tx=0x7fa454005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:50.772+0000 7fa44f7fe640 1 -- 172.21.15.19:0/1798447019 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa4500cd950 con 0x7fa460101cd0 2024-09-11T00:10:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.000+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa46019a330 con 0x7fa460101cd0 2024-09-11T00:10:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.001+0000 7fa44f7fe640 1 -- 172.21.15.19:0/1798447019 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11920 (secure 0 0 0) 0x7fa4500cd250 con 0x7fa460101cd0 2024-09-11T00:10:51.003 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:10:51.003 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":35,"btime":"2024-09-11T00:09:15:303339+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:09:15.054686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:10:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 35 2024-09-11T00:10:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4480b5450 msgr2=0x7fa4480b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4480b5450 0x7fa4480b7910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa454005e10 tx=0x7fa454005da0 comp rx=0 tx=0).stop 2024-09-11T00:10:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 msgr2=0x7fa460199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa460199200 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa450005940 tx=0x7fa4500042f0 comp rx=0 tx=0).stop 2024-09-11T00:10:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 shutdown_connections 2024-09-11T00:10:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa460108060 0x7fa46019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4601076e0 0x7fa460199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:51.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fa4480b5450 0x7fa4480b7910 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:51.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 --2- 172.21.15.19:0/1798447019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa460101cd0 0x7fa460199200 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:51.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 >> 172.21.15.19:0/1798447019 conn(0x7fa4600fd700 msgr2=0x7fa4600ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:51.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 shutdown_connections 2024-09-11T00:10:51.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:51.003+0000 7fa464dd3640 1 -- 172.21.15.19:0/1798447019 wait complete. 2024-09-11T00:10:51.761 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:10:52.025 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:52.146 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:51 smithi019 ceph-mon[30859]: pgmap v579: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:10:52.147 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:51 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1798447019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:51 smithi135 ceph-mon[35432]: pgmap v579: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:10:52.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:51 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1798447019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:51 smithi131 ceph-mon[35491]: pgmap v579: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:10:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:51 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1798447019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 -- 172.21.15.19:0/593343246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 msgr2=0x7f9ab8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 --2- 172.21.15.19:0/593343246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8103f90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009900 tx=0x7f9aa802a410 comp rx=0 tx=0).stop 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 -- 172.21.15.19:0/593343246 shutdown_connections 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 --2- 172.21.15.19:0/593343246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab810d160 0x7f9ab810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 --2- 172.21.15.19:0/593343246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab81045b0 0x7f9ab810cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 --2- 172.21.15.19:0/593343246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8103f90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 -- 172.21.15.19:0/593343246 >> 172.21.15.19:0/593343246 conn(0x7f9ab80fd700 msgr2=0x7f9ab80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 -- 172.21.15.19:0/593343246 shutdown_connections 2024-09-11T00:10:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 -- 172.21.15.19:0/593343246 wait complete. 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 Processor -- start 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.515+0000 7f9abeadf640 1 -- start start 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abeadf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abeadf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab81045b0 0x7f9ab81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abeadf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab810d160 0x7f9ab819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abeadf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8112da0 con 0x7f9ab8103bb0 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abeadf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8112c20 con 0x7f9ab81045b0 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abeadf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8112f20 con 0x7f9ab810d160 2024-09-11T00:10:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58074/0 (socket says 172.21.15.19:58074) 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 -- 172.21.15.19:0/69674960 learned_addr learned my addr 172.21.15.19:0/69674960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab81045b0 0x7f9ab81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abd07c640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab810d160 0x7f9ab819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 -- 172.21.15.19:0/69674960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab810d160 msgr2=0x7f9ab819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab810d160 0x7f9ab819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 -- 172.21.15.19:0/69674960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab81045b0 msgr2=0x7f9ab81997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab81045b0 0x7f9ab81997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 -- 172.21.15.19:0/69674960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab819f320 con 0x7f9ab8103bb0 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abd07c640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab810d160 0x7f9ab819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.516+0000 7f9abc87b640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8199270 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8005940 tx=0x7f9aa80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.517+0000 7f9ab5ffb640 1 -- 172.21.15.19:0/69674960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa803f030 con 0x7f9ab8103bb0 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.517+0000 7f9ab5ffb640 1 -- 172.21.15.19:0/69674960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aa8003cb0 con 0x7f9ab8103bb0 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.517+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab819f5b0 con 0x7f9ab8103bb0 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.517+0000 7f9ab5ffb640 1 -- 172.21.15.19:0/69674960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8035070 con 0x7f9ab8103bb0 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.517+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab81a5cd0 con 0x7f9ab8103bb0 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.519+0000 7f9ac0eb4740 1 Processor -- start 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ac0eb4740 1 -- start start 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade818b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade81df0 0x5602ade91c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade94580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5602addf7ea0 con 0x5602ade92190 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5602adde72d0 con 0x5602ade81df0 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602addeb0e0 con 0x5602ade814d0 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade94580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58086/0 (socket says 172.21.15.19:58086) 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 -- 172.21.15.19:0/2033739677 learned_addr learned my addr 172.21.15.19:0/2033739677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9abd07c640 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade818b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab5ffb640 1 -- 172.21.15.19:0/69674960 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f9aa8003800 con 0x7f9ab8103bb0 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 -- 172.21.15.19:0/2033739677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 msgr2=0x5602ade818b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade818b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 -- 172.21.15.19:0/2033739677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade81df0 msgr2=0x5602ade91c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade81df0 0x5602ade91c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.520+0000 7f9ab7fff640 1 -- 172.21.15.19:0/2033739677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602adb45650 con 0x5602ade92190 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.521+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade94580 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00b770 tx=0x7f9aac00bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69424d8adad9fdbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.521+0000 7f9a9effd640 1 -- 172.21.15.19:0/2033739677 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac003dd0 con 0x5602ade92190 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.521+0000 7f9a9effd640 1 -- 172.21.15.19:0/2033739677 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aac015070 con 0x5602ade92190 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.521+0000 7f9a9effd640 1 -- 172.21.15.19:0/2033739677 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac004dd0 con 0x5602ade92190 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.521+0000 7f9ab5ffb640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9aa00b54d0 0x7f9aa00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.521+0000 7f9abd07c640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9aa00b54d0 0x7f9aa00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.521+0000 7f9ab5ffb640 1 -- 172.21.15.19:0/69674960 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f9aa8106a40 con 0x7f9ab8103bb0 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2033739677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 msgr2=0x5602ade94580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade94580 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00b770 tx=0x7f9aac00bc30 comp rx=0 tx=0).stop 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9abd07c640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9aa00b54d0 0x7f9aa00b7990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0005fd0 tx=0x7f9ab0009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2033739677 shutdown_connections 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade94580 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade81df0 0x5602ade91c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2033739677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade818b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2033739677 >> 172.21.15.19:0/2033739677 conn(0x5602ade7f300 msgr2=0x5602ade804a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2033739677 shutdown_connections 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2033739677 wait complete. 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 -- start start 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.522+0000 7f9ac0eb4740 1 Processor -- start 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade814d0 0x5602ade91ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade8ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade8f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5602adc48700 con 0x5602ade92190 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5602add82160 con 0x5602ade814d0 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602ade94e40 con 0x5602ade81df0 2024-09-11T00:10:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 10 client.0 _ll_register_callbacks cb 0x5602add9b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade8f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade8f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58094/0 (socket says 172.21.15.19:58094) 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 -- 172.21.15.19:0/2935128844 learned_addr learned my addr 172.21.15.19:0/2935128844 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade8ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abc87b640 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade814d0 0x5602ade91ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 -- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 msgr2=0x5602ade8ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade8ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 -- 172.21.15.19:0/2935128844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade814d0 msgr2=0x5602ade91ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade814d0 0x5602ade91ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 -- 172.21.15.19:0/2935128844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602addafc90 con 0x5602ade92190 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9abd07c640 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade8f5f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0011cc0 tx=0x7f9ab0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c020df125d49f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9a97fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:52.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9a97fff640 1 -- 172.21.15.19:0/2935128844 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab001ed30 con 0x5602ade92190 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9a97fff640 1 -- 172.21.15.19:0/2935128844 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f9ab001f410 con 0x5602ade92190 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.523+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aac015070 con 0x5602ade92190 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9a97fff640 1 -- 172.21.15.19:0/2935128844 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9ab0011e70 con 0x5602ade92190 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 10 client.16497 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5602adea0850 con 0x5602ade92190 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9a97fff640 1 -- 172.21.15.19:0/2935128844 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aac015070 con 0x5602ade92190 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9a97fff640 1 -- 172.21.15.19:0/2935128844 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9ab000f040 con 0x5602ade92190 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 10 client.16497 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 10 client.16497 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 20 client.16497 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adea1d00 0x5602adea4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 4 client.16497 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602addf9df0 con 0x5602adea1d00 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.524+0000 7f9abc87b640 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adea1d00 0x5602adea4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.525+0000 7f9abc87b640 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adea1d00 0x5602adea4110 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89511d6d3383a0e7 server_cookie=867a5254f77fa10e in_seq=0 out_seq=0 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.525+0000 7f9a97fff640 10 client.16497 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.525+0000 7f9a97fff640 1 -- 172.21.15.19:0/2935128844 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602addf9df0 con 0x5602adea1d00 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.525+0000 7f9a97fff640 10 client.16497 handle_command_reply: tid=0 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 client.16497 shutdown 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 msgr2=0x5602ade8f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade8f5f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0011cc0 tx=0x7f9ab0004a40 comp rx=0 tx=0).stop 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 shutdown_connections 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adea1d00 0x5602adea4110 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade92190 0x5602ade8f5f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade8ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9a97fff640 0 client.16497 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:52.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/2935128844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade814d0 0x5602ade91ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 >> 172.21.15.19:0/2935128844 conn(0x5602ade7f300 msgr2=0x5602ade84ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:52.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 shutdown_connections 2024-09-11T00:10:52.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/2935128844 wait complete. 2024-09-11T00:10:52.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.526+0000 7f9ac0eb4740 20 client.16497 trim_cache size 0 max 16384 2024-09-11T00:10:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.539+0000 7f9ac0eb4740 1 Processor -- start 2024-09-11T00:10:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.539+0000 7f9ac0eb4740 1 -- start start 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.539+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.539+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade81df0 0x5602adea99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.539+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602adea9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.539+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81aec90 con 0x5602ade81df0 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.539+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81ac4d0 con 0x5602ade92190 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81aa340 con 0x5602ade814d0 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade81df0 0x5602adea99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade81df0 0x5602adea99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58098/0 (socket says 172.21.15.19:58098) 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 -- 172.21.15.19:0/4160283854 learned_addr learned my addr 172.21.15.19:0/4160283854 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9abc87b640 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 -- 172.21.15.19:0/4160283854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 msgr2=0x5602ade9e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade9e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 -- 172.21.15.19:0/4160283854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 msgr2=0x5602adea9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9abd07c640 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602adea9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602adea9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 -- 172.21.15.19:0/4160283854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ade7fd80 con 0x5602ade81df0 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade81df0 0x5602adea99e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0039c0 tx=0x7f9aac004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aeeb5bd30014107 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9a9e7fc640 1 -- 172.21.15.19:0/4160283854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac029070 con 0x5602ade81df0 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9a9e7fc640 1 -- 172.21.15.19:0/4160283854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aac015070 con 0x5602ade81df0 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.540+0000 7f9a9e7fc640 1 -- 172.21.15.19:0/4160283854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac024430 con 0x5602ade81df0 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4160283854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade81df0 msgr2=0x5602adea99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade81df0 0x5602adea99e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0039c0 tx=0x7f9aac004970 comp rx=0 tx=0).stop 2024-09-11T00:10:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4160283854 shutdown_connections 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602adea9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade81df0 0x5602adea99e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4160283854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade814d0 0x5602ade9e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4160283854 >> 172.21.15.19:0/4160283854 conn(0x5602ade7f300 msgr2=0x5602ade93fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4160283854 shutdown_connections 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4160283854 wait complete. 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.541+0000 7f9ac0eb4740 1 -- start start 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 1 Processor -- start 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade814d0 0x5602ade9a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade9ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602ade97320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81aa990 con 0x5602ade814d0 2024-09-11T00:10:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81abe00 con 0x5602ade92190 2024-09-11T00:10:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81ab060 con 0x5602ade81df0 2024-09-11T00:10:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ac0eb4740 10 client.0 _ll_register_callbacks cb 0x7f9ab0009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade814d0 0x5602ade9a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade814d0 0x5602ade9a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58112/0 (socket says 172.21.15.19:58112) 2024-09-11T00:10:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 -- 172.21.15.19:0/4084606863 learned_addr learned my addr 172.21.15.19:0/4084606863 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abd07c640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602ade97320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade9ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 -- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 msgr2=0x5602ade9ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade9ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 -- 172.21.15.19:0/4084606863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 msgr2=0x5602ade97320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602ade97320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9abc87b640 1 -- 172.21.15.19:0/4084606863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ade97b20 con 0x5602ade814d0 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.542+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade9ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9abc87b640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade814d0 0x5602ade9a5b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8005ec0 tx=0x7f9aa8003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb33e6838c0fbdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9a97fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9a97fff640 1 -- 172.21.15.19:0/4084606863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8049040 con 0x5602ade814d0 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9a97fff640 1 -- 172.21.15.19:0/4084606863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f9aa80cd370 con 0x5602ade814d0 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aac015070 con 0x5602ade814d0 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9a97fff640 1 -- 172.21.15.19:0/4084606863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9aa80cc680 con 0x5602ade814d0 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 10 client.16503 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5602adf0f990 con 0x5602ade814d0 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9a97fff640 1 -- 172.21.15.19:0/4084606863 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aac015070 con 0x5602ade814d0 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9a97fff640 1 -- 172.21.15.19:0/4084606863 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9aa80b2ce0 con 0x5602ade814d0 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 10 client.16503 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 10 client.16503 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 20 client.16503 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adf10110 0x5602adf12530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.543+0000 7f9ac0eb4740 4 client.16503 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.544+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5602addf58a0 con 0x5602adf10110 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.544+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adf10110 0x5602adf12530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.544+0000 7f9ab7fff640 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adf10110 0x5602adf12530 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de29259f4628f2fa server_cookie=4790cbcd48262043 in_seq=0 out_seq=0 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.544+0000 7f9a97fff640 10 client.16503 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.544+0000 7f9a97fff640 1 -- 172.21.15.19:0/4084606863 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5602addf58a0 con 0x5602adf10110 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.544+0000 7f9a97fff640 10 client.16503 handle_command_reply: tid=0 2024-09-11T00:10:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.544+0000 7f9ac0eb4740 1 client.16503 shutdown 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade814d0 msgr2=0x5602ade9a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade814d0 0x5602ade9a5b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8005ec0 tx=0x7f9aa8003c30 comp rx=0 tx=0).stop 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 shutdown_connections 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5602adf10110 0x5602adf12530 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602ade92190 0x5602ade97320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602ade81df0 0x5602ade9ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9a97fff640 0 client.16503 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 --2- 172.21.15.19:0/4084606863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5602ade814d0 0x5602ade9a5b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 >> 172.21.15.19:0/4084606863 conn(0x5602ade7f300 msgr2=0x5602ade90550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 shutdown_connections 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 1 -- 172.21.15.19:0/4084606863 wait complete. 2024-09-11T00:10:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9ac0eb4740 20 client.16503 trim_cache size 0 max 16384 2024-09-11T00:10:52.564 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:10:52.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9aa00b54d0 msgr2=0x7f9aa00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.545+0000 7f9abeadf640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9aa00b54d0 0x7f9aa00b7990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0005fd0 tx=0x7f9ab0009800 comp rx=0 tx=0).stop 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 msgr2=0x7f9ab8199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8199270 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8005940 tx=0x7f9aa80042f0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 shutdown_connections 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab810d160 0x7f9ab819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab81045b0 0x7f9ab81997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f9aa00b54d0 0x7f9aa00b7990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 --2- 172.21.15.19:0/69674960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ab8103bb0 0x7f9ab8199270 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 >> 172.21.15.19:0/69674960 conn(0x7f9ab80fd700 msgr2=0x7f9ab80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 shutdown_connections 2024-09-11T00:10:52.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:52.546+0000 7f9abeadf640 1 -- 172.21.15.19:0/69674960 wait complete. 2024-09-11T00:10:53.257 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:10:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:53.924 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:53 smithi019 ceph-mon[30859]: pgmap v580: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-11T00:10:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 -- 172.21.15.19:0/3078668273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04109120 msgr2=0x7fdf0410f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/3078668273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04109120 0x7fdf0410f920 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009ca0 tx=0x7fdefc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 -- 172.21.15.19:0/3078668273 shutdown_connections 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/3078668273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04109120 0x7fdf0410f920 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/3078668273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf041087a0 0x7fdf04108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/3078668273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf04102d90 0x7fdf04103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 -- 172.21.15.19:0/3078668273 >> 172.21.15.19:0/3078668273 conn(0x7fdf040fe820 msgr2=0x7fdf04100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 -- 172.21.15.19:0/3078668273 shutdown_connections 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 -- 172.21.15.19:0/3078668273 wait complete. 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 Processor -- start 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.157+0000 7fdf09cb1640 1 -- start start 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf09cb1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04102d90 0x7fdf040754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf09cb1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf041087a0 0x7fdf040759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf09cb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf04109120 0x7fdf04075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf09cb1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04112da0 con 0x7fdf04102d90 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf09cb1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04112c20 con 0x7fdf041087a0 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf09cb1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04112f20 con 0x7fdf04109120 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04102d90 0x7fdf040754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04102d90 0x7fdf040754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58130/0 (socket says 172.21.15.19:58130) 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 -- 172.21.15.19:0/182483615 learned_addr learned my addr 172.21.15.19:0/182483615 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf041087a0 0x7fdf040759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf03fff640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf04109120 0x7fdf04075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 -- 172.21.15.19:0/182483615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf04109120 msgr2=0x7fdf04075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf04109120 0x7fdf04075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 -- 172.21.15.19:0/182483615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf041087a0 msgr2=0x7fdf040759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf041087a0 0x7fdf040759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 -- 172.21.15.19:0/182483615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf041a7510 con 0x7fdf04102d90 2024-09-11T00:10:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf041087a0 0x7fdf040759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf037fe640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04102d90 0x7fdf040754a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c920 tx=0x7fdef400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.158+0000 7fdf00ff9640 1 -- 172.21.15.19:0/182483615 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007c70 con 0x7fdf04102d90 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.159+0000 7fdf00ff9640 1 -- 172.21.15.19:0/182483615 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdef4007e10 con 0x7fdf04102d90 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.159+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf041a7800 con 0x7fdf04102d90 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.159+0000 7fdf00ff9640 1 -- 172.21.15.19:0/182483615 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4018820 con 0x7fdf04102d90 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.159+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf041a7d90 con 0x7fdf04102d90 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 Processor -- start 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf00ff9640 1 -- 172.21.15.19:0/182483615 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fdef400f450 con 0x7fdf04102d90 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 -- start start 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b92214d0 0x55d7b92218b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b922d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b922dd80 0x55d7b9230170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d7b9197ea0 con 0x55d7b9221df0 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d7b91872d0 con 0x55d7b922dd80 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.161+0000 7fdf0c086740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d7b918b0e0 con 0x55d7b92214d0 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b922d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b922d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58140/0 (socket says 172.21.15.19:58140) 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 -- 172.21.15.19:0/3524803377 learned_addr learned my addr 172.21.15.19:0/3524803377 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b922dd80 0x55d7b9230170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf03fff640 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b92214d0 0x55d7b92218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 -- 172.21.15.19:0/3524803377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b92214d0 msgr2=0x55d7b92218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b92214d0 0x55d7b92218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 -- 172.21.15.19:0/3524803377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b922dd80 msgr2=0x55d7b9230170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b922dd80 0x55d7b9230170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 -- 172.21.15.19:0/3524803377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b8ee5650 con 0x55d7b9221df0 2024-09-11T00:10:54.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf037fe640 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b922d840 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdef40e3820 tx=0x7fdef40ee540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a85d9fe897b109 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf00ff9640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdef00b54d0 0x7fdef00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdef9ffb640 1 -- 172.21.15.19:0/3524803377 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef40f9070 con 0x55d7b9221df0 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdf03fff640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdef00b54d0 0x7fdef00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdef9ffb640 1 -- 172.21.15.19:0/3524803377 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdef40eee30 con 0x55d7b9221df0 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.162+0000 7fdef9ffb640 1 -- 172.21.15.19:0/3524803377 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef40abd50 con 0x55d7b9221df0 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf00ff9640 1 -- 172.21.15.19:0/182483615 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fdef40e6070 con 0x7fdf04102d90 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 -- 172.21.15.19:0/3524803377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 msgr2=0x55d7b922d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf03fff640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdef00b54d0 0x7fdef00b7990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdefc02f500 tx=0x7fdefc031af0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b922d840 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdef40e3820 tx=0x7fdef40ee540 comp rx=0 tx=0).stop 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 -- 172.21.15.19:0/3524803377 shutdown_connections 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b922dd80 0x55d7b9230170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b922d840 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3524803377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b92214d0 0x55d7b92218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 -- 172.21.15.19:0/3524803377 >> 172.21.15.19:0/3524803377 conn(0x55d7b921f300 msgr2=0x55d7b92204a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 -- 172.21.15.19:0/3524803377 shutdown_connections 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.163+0000 7fdf0c086740 1 -- 172.21.15.19:0/3524803377 wait complete. 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 -- start start 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 Processor -- start 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b92214d0 0x55d7b922d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b9221df0 0x55d7b922aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d7b8fe8700 con 0x55d7b92214d0 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d7b9122160 con 0x55d7b9221df0 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d7b9230a00 con 0x55d7b922dd80 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf0c086740 10 client.0 _ll_register_callbacks cb 0x55d7b913b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b92214d0 0x55d7b922d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b92214d0 0x55d7b922d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58146/0 (socket says 172.21.15.19:58146) 2024-09-11T00:10:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf037fe640 1 -- 172.21.15.19:0/3905401403 learned_addr learned my addr 172.21.15.19:0/3905401403 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf03fff640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b9221df0 0x55d7b922aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf037fe640 1 -- 172.21.15.19:0/3905401403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 msgr2=0x55d7b922b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf037fe640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf037fe640 1 -- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b9221df0 msgr2=0x55d7b922aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.164+0000 7fdf037fe640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b9221df0 0x55d7b922aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf037fe640 1 -- 172.21.15.19:0/3905401403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b914fc90 con 0x55d7b92214d0 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf03fff640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf037fe640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b92214d0 0x55d7b922d670 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdef40f7040 tx=0x7fdef4007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21a62525bf3152b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdee2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdee2ffd640 1 -- 172.21.15.19:0/3905401403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef40abd50 con 0x55d7b92214d0 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdee2ffd640 1 -- 172.21.15.19:0/3905401403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fdef401f300 con 0x55d7b92214d0 2024-09-11T00:10:54.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdef40eee30 con 0x55d7b92214d0 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdee2ffd640 1 -- 172.21.15.19:0/3905401403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdef40ac3b0 con 0x55d7b92214d0 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 10 client.16515 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d7b923c330 con 0x55d7b92214d0 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdee2ffd640 1 -- 172.21.15.19:0/3905401403 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdef40eee30 con 0x55d7b92214d0 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdee2ffd640 1 -- 172.21.15.19:0/3905401403 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fdef40a6ce0 con 0x55d7b92214d0 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 10 client.16515 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 10 client.16515 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 20 client.16515 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b923d680 0x55d7b923fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 4 client.16515 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.165+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7b9199df0 con 0x55d7b923d680 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.166+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b923d680 0x55d7b923fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.166+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b923d680 0x55d7b923fa70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83fcc4ca7fc6d4f7 server_cookie=3dec1e92b9e6d24f in_seq=0 out_seq=0 2024-09-11T00:10:54.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.166+0000 7fdee2ffd640 10 client.16515 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdee2ffd640 1 -- 172.21.15.19:0/3905401403 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7b9199df0 con 0x55d7b923d680 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdee2ffd640 10 client.16515 handle_command_reply: tid=0 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 client.16515 shutdown 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b92214d0 msgr2=0x55d7b922d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b92214d0 0x55d7b922d670 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdef40f7040 tx=0x7fdef4007730 comp rx=0 tx=0).stop 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 shutdown_connections 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b923d680 0x55d7b923fa70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b9221df0 0x55d7b922aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdee2ffd640 0 client.16515 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 --2- 172.21.15.19:0/3905401403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b92214d0 0x55d7b922d670 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 >> 172.21.15.19:0/3905401403 conn(0x55d7b921f300 msgr2=0x55d7b9224ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:54.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 shutdown_connections 2024-09-11T00:10:54.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 1 -- 172.21.15.19:0/3905401403 wait complete. 2024-09-11T00:10:54.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.167+0000 7fdf0c086740 20 client.16515 trim_cache size 0 max 16384 2024-09-11T00:10:54.184 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:53 smithi135 ceph-mon[35432]: pgmap v580: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-11T00:10:54.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 Processor -- start 2024-09-11T00:10:54.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 -- start start 2024-09-11T00:10:54.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b92209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b921ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf041b3020 con 0x55d7b9221df0 2024-09-11T00:10:54.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf041b0860 con 0x55d7b92214d0 2024-09-11T00:10:54.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf0c086740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf041ae6d0 con 0x55d7b922dd80 2024-09-11T00:10:54.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b921ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b921ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58160/0 (socket says 172.21.15.19:58160) 2024-09-11T00:10:54.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 -- 172.21.15.19:0/2320721095 learned_addr learned my addr 172.21.15.19:0/2320721095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:54.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf037fe640 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b92209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf03fff640 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 -- 172.21.15.19:0/2320721095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 msgr2=0x55d7b922f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 -- 172.21.15.19:0/2320721095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 msgr2=0x55d7b92209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b92209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf02ffd640 1 -- 172.21.15.19:0/2320721095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b9228fc0 con 0x55d7b9221df0 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.181+0000 7fdf03fff640 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b921ec10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdf04076f90 tx=0x7fdeec012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319683235a9dc8ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdef97fa640 1 -- 172.21.15.19:0/2320721095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec008da0 con 0x55d7b9221df0 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdef97fa640 1 -- 172.21.15.19:0/2320721095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec012110 con 0x55d7b9221df0 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdef97fa640 1 -- 172.21.15.19:0/2320721095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec003db0 con 0x55d7b9221df0 2024-09-11T00:10:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf0c086740 1 -- 172.21.15.19:0/2320721095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 msgr2=0x55d7b921ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b921ec10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdf04076f90 tx=0x7fdeec012820 comp rx=0 tx=0).stop 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf0c086740 1 -- 172.21.15.19:0/2320721095 shutdown_connections 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b922dd80 0x55d7b922f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b9221df0 0x55d7b921ec10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2320721095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b92209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.182+0000 7fdf0c086740 1 -- 172.21.15.19:0/2320721095 >> 172.21.15.19:0/2320721095 conn(0x55d7b921f300 msgr2=0x55d7b922c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 -- 172.21.15.19:0/2320721095 shutdown_connections 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 -- 172.21.15.19:0/2320721095 wait complete. 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 -- start start 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 Processor -- start 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b923f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b9221df0 0x55d7b923f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b922dd80 0x55d7b92a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf041aed20 con 0x55d7b922dd80 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf041b0190 con 0x55d7b92214d0 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf041af3f0 con 0x55d7b9221df0 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf0c086740 10 client.0 _ll_register_callbacks cb 0x7fdef40f7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.183+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b922dd80 0x55d7b92a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b922dd80 0x55d7b92a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58170/0 (socket says 172.21.15.19:58170) 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 -- 172.21.15.19:0/2579288227 learned_addr learned my addr 172.21.15.19:0/2579288227 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf037fe640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b923f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf02ffd640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b9221df0 0x55d7b923f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 -- 172.21.15.19:0/2579288227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b9221df0 msgr2=0x55d7b923f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b9221df0 0x55d7b923f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 -- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 msgr2=0x55d7b923f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b923f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 -- 172.21.15.19:0/2579288227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b92a9850 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf037fe640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b923f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf03fff640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b922dd80 0x55d7b92a91e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdefc035000 tx=0x7fdefc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0743ed7fdc574a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdee2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdee2ffd640 1 -- 172.21.15.19:0/2579288227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc004040 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec012110 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdee2ffd640 1 -- 172.21.15.19:0/2579288227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fdefc0041e0 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdee2ffd640 1 -- 172.21.15.19:0/2579288227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdefc0043e0 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf0c086740 10 client.16521 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.184+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d7b92aaad0 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdee2ffd640 1 -- 172.21.15.19:0/2579288227 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec012110 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdee2ffd640 1 -- 172.21.15.19:0/2579288227 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fdefc044040 con 0x55d7b922dd80 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdf0c086740 10 client.16521 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:54.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdf0c086740 10 client.16521 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdf0c086740 20 client.16521 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b92ab2e0 0x55d7b92ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdf0c086740 4 client.16521 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d7b91958a0 con 0x55d7b92ab2e0 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.185+0000 7fdf037fe640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b92ab2e0 0x55d7b92ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdee2ffd640 10 client.16521 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf037fe640 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b92ab2e0 0x55d7b92ad700 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c9c613daaf8f00d server_cookie=ac474d90494fd987 in_seq=0 out_seq=0 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdee2ffd640 1 -- 172.21.15.19:0/2579288227 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d7b91958a0 con 0x55d7b92ab2e0 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdee2ffd640 10 client.16521 handle_command_reply: tid=0 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 client.16521 shutdown 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b922dd80 msgr2=0x55d7b92a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b922dd80 0x55d7b92a91e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdefc035000 tx=0x7fdefc0095c0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 shutdown_connections 2024-09-11T00:10:54.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x55d7b92ab2e0 0x55d7b92ad700 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdee2ffd640 0 client.16521 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d7b922dd80 0x55d7b92a91e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b9221df0 0x55d7b923f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 --2- 172.21.15.19:0/2579288227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7b92214d0 0x55d7b923f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 >> 172.21.15.19:0/2579288227 conn(0x55d7b921f300 msgr2=0x55d7b9229210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 shutdown_connections 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 1 -- 172.21.15.19:0/2579288227 wait complete. 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.186+0000 7fdf0c086740 20 client.16521 trim_cache size 0 max 16384 2024-09-11T00:10:54.198 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:10:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdef00b54d0 msgr2=0x7fdef00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdef00b54d0 0x7fdef00b7990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdefc02f500 tx=0x7fdefc031af0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04102d90 msgr2=0x7fdf040754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04102d90 0x7fdf040754a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c920 tx=0x7fdef400cde0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 shutdown_connections 2024-09-11T00:10:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf04109120 0x7fdf04075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf041087a0 0x7fdf040759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fdef00b54d0 0x7fdef00b7990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 --2- 172.21.15.19:0/182483615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf04102d90 0x7fdf040754a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 >> 172.21.15.19:0/182483615 conn(0x7fdf040fe820 msgr2=0x7fdf040fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 shutdown_connections 2024-09-11T00:10:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:54.187+0000 7fdf09cb1640 1 -- 172.21.15.19:0/182483615 wait complete. 2024-09-11T00:10:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:53 smithi131 ceph-mon[35491]: pgmap v580: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-11T00:10:54.925 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:10:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 -- 172.21.15.19:0/3036983526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8107780 msgr2=0x7feff8107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 --2- 172.21.15.19:0/3036983526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8107780 0x7feff8107be0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec02a410 comp rx=0 tx=0).stop 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 -- 172.21.15.19:0/3036983526 shutdown_connections 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 --2- 172.21.15.19:0/3036983526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8108120 0x7feff810e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 --2- 172.21.15.19:0/3036983526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8107780 0x7feff8107be0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 --2- 172.21.15.19:0/3036983526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff8102920 0x7feff8102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 -- 172.21.15.19:0/3036983526 >> 172.21.15.19:0/3036983526 conn(0x7feff8076f50 msgr2=0x7feff8077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 -- 172.21.15.19:0/3036983526 shutdown_connections 2024-09-11T00:10:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 -- 172.21.15.19:0/3036983526 wait complete. 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 Processor -- start 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.684+0000 7feffe534640 1 -- start start 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffe534640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8102920 0x7feff819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffe534640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff8107780 0x7feff819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffe534640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108120 0x7feff819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffe534640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feff8111ca0 con 0x7feff8108120 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffe534640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feff8111b20 con 0x7feff8107780 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffe534640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feff8111e20 con 0x7feff8102920 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108120 0x7feff819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108120 0x7feff819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58200/0 (socket says 172.21.15.19:58200) 2024-09-11T00:10:55.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 -- 172.21.15.19:0/1320674713 learned_addr learned my addr 172.21.15.19:0/1320674713 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feff7fff640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8102920 0x7feff819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feff77fe640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff8107780 0x7feff819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 -- 172.21.15.19:0/1320674713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8102920 msgr2=0x7feff819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8102920 0x7feff819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 -- 172.21.15.19:0/1320674713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff8107780 msgr2=0x7feff819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff8107780 0x7feff819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 -- 172.21.15.19:0/1320674713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff81a5490 con 0x7feff8108120 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feff7fff640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8102920 0x7feff819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feffcad1640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108120 0x7feff819ab50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7feff000eaa0 tx=0x7feff000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.685+0000 7feff57fa640 1 -- 172.21.15.19:0/1320674713 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff000cdb0 con 0x7feff8108120 2024-09-11T00:10:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.686+0000 7feff57fa640 1 -- 172.21.15.19:0/1320674713 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feff0005020 con 0x7feff8108120 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.686+0000 7feff57fa640 1 -- 172.21.15.19:0/1320674713 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff00116d0 con 0x7feff8108120 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.686+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff81a5780 con 0x7feff8108120 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.686+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff81a5c90 con 0x7feff8108120 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.688+0000 7ff000909740 1 Processor -- start 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.688+0000 7feff57fa640 1 -- 172.21.15.19:0/1320674713 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7feff000f040 con 0x7feff8108120 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.688+0000 7ff000909740 1 -- start start 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7ff000909740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557a0f0 0x55f39557a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7ff000909740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f39558a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7ff000909740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39558adb0 0x55f39558d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7ff000909740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f3954f0ea0 con 0x55f39557a0f0 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7ff000909740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f3954e02d0 con 0x55f39558adb0 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7ff000909740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f3954e40e0 con 0x55f39557aa10 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557a0f0 0x55f39557a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557a0f0 0x55f39557a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58208/0 (socket says 172.21.15.19:58208) 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 -- 172.21.15.19:0/2951447606 learned_addr learned my addr 172.21.15.19:0/2951447606 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff7fff640 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f39558a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39558adb0 0x55f39558d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 -- 172.21.15.19:0/2951447606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 msgr2=0x55f39558a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f39558a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 -- 172.21.15.19:0/2951447606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39558adb0 msgr2=0x55f39558d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39558adb0 0x55f39558d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 -- 172.21.15.19:0/2951447606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39523e650 con 0x55f39557a0f0 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff57fa640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fefe00b5450 0x7fefe00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff77fe640 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557a0f0 0x55f39557a4d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fefec005940 tx=0x7fefec0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae9b7e440ac3488 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.689+0000 7feff7fff640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fefe00b5450 0x7fefe00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7feff57fa640 1 -- 172.21.15.19:0/1320674713 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7feff00e5e50 con 0x7feff8108120 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7fefde7fc640 1 -- 172.21.15.19:0/2951447606 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec035050 con 0x55f39557a0f0 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7fefde7fc640 1 -- 172.21.15.19:0/2951447606 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefec0316f0 con 0x55f39557a0f0 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7fefde7fc640 1 -- 172.21.15.19:0/2951447606 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec0046c0 con 0x55f39557a0f0 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 -- 172.21.15.19:0/2951447606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557a0f0 msgr2=0x55f39557a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7feff7fff640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fefe00b5450 0x7fefe00b7910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55f39557e330 tx=0x7fefe80084c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557a0f0 0x55f39557a4d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fefec005940 tx=0x7fefec0058b0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 -- 172.21.15.19:0/2951447606 shutdown_connections 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39558adb0 0x55f39558d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f39558a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 --2- 172.21.15.19:0/2951447606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557a0f0 0x55f39557a4d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 -- 172.21.15.19:0/2951447606 >> 172.21.15.19:0/2951447606 conn(0x55f395577f20 msgr2=0x55f3955790c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.690+0000 7ff000909740 1 -- 172.21.15.19:0/2951447606 shutdown_connections 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 -- 172.21.15.19:0/2951447606 wait complete. 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 -- start start 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 Processor -- start 2024-09-11T00:10:55.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f39558a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f395587b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955881b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f395341700 con 0x55f39558adb0 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f39547b160 con 0x55f39557a0f0 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f39558da00 con 0x55f39557aa10 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7ff000909740 10 client.0 _ll_register_callbacks cb 0x55f3954949e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7feffcad1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955881b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7feffcad1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955881b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58224/0 (socket says 172.21.15.19:58224) 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.691+0000 7feffcad1640 1 -- 172.21.15.19:0/2161600178 learned_addr learned my addr 172.21.15.19:0/2161600178 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feff7fff640 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f39558a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feff77fe640 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f395587b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feffcad1640 1 -- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 msgr2=0x55f395587b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feffcad1640 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f395587b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feffcad1640 1 -- 172.21.15.19:0/2161600178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 msgr2=0x55f39558a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feffcad1640 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f39558a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feffcad1640 1 -- 172.21.15.19:0/2161600178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3954a8c90 con 0x55f39558adb0 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7feffcad1640 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955881b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7feff00ac250 tx=0x7feff0005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae9ae6a9bcef241 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7fefd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7fefd77fe640 1 -- 172.21.15.19:0/2161600178 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff001f030 con 0x55f39558adb0 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7fefd77fe640 1 -- 172.21.15.19:0/2161600178 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7feff00cf070 con 0x55f39558adb0 2024-09-11T00:10:55.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefec0316f0 con 0x55f39558adb0 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7fefd77fe640 1 -- 172.21.15.19:0/2161600178 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7feff00ac2c0 con 0x55f39558adb0 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7ff000909740 10 client.16533 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.692+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f3955993d0 con 0x55f39558adb0 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7fefd77fe640 1 -- 172.21.15.19:0/2161600178 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefec0316f0 con 0x55f39558adb0 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7fefd77fe640 1 -- 172.21.15.19:0/2161600178 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7feff00e3ce0 con 0x55f39558adb0 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7ff000909740 10 client.16533 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7ff000909740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7ff000909740 20 client.16533 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7ff000909740 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f39559a8e0 0x55f39559cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7ff000909740 4 client.16533 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:55.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3954f2df0 con 0x55f39559a8e0 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7feff7fff640 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f39559a8e0 0x55f39559cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7fefd77fe640 10 client.16533 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.693+0000 7feff7fff640 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f39559a8e0 0x55f39559cd20 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6cbd2da83d48189 server_cookie=a0d9dc087a94647e in_seq=0 out_seq=0 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7fefd77fe640 1 -- 172.21.15.19:0/2161600178 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3954f2df0 con 0x55f39559a8e0 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7fefd77fe640 10 client.16533 handle_command_reply: tid=0 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 client.16533 shutdown 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 msgr2=0x55f3955881b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955881b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7feff00ac250 tx=0x7feff0005450 comp rx=0 tx=0).stop 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 shutdown_connections 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f39559a8e0 0x55f39559cd20 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955881b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557aa10 0x55f395587b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7fefd77fe640 0 client.16533 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:55.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 --2- 172.21.15.19:0/2161600178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f39558a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.694+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 >> 172.21.15.19:0/2161600178 conn(0x55f395577f20 msgr2=0x55f39557da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:55.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.695+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 shutdown_connections 2024-09-11T00:10:55.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.695+0000 7ff000909740 1 -- 172.21.15.19:0/2161600178 wait complete. 2024-09-11T00:10:55.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.695+0000 7ff000909740 20 client.16533 trim_cache size 0 max 16384 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 Processor -- start 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 -- start start 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557a0f0 0x55f395596c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557aa10 0x55f3955796f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feff81aec20 con 0x55f39558adb0 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feff81ac460 con 0x55f39557aa10 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7ff000909740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feff81aa2d0 con 0x55f39557a0f0 2024-09-11T00:10:55.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.708+0000 7feffcad1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955a25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58226/0 (socket says 172.21.15.19:58226) 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 -- 172.21.15.19:0/3528042120 learned_addr learned my addr 172.21.15.19:0/3528042120 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feff7fff640 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557a0f0 0x55f395596c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feff77fe640 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557aa10 0x55f3955796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 -- 172.21.15.19:0/3528042120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557a0f0 msgr2=0x55f395596c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557a0f0 0x55f395596c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 -- 172.21.15.19:0/3528042120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557aa10 msgr2=0x55f3955796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557aa10 0x55f3955796f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 -- 172.21.15.19:0/3528042120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f395586030 con 0x55f39558adb0 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feff77fe640 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557aa10 0x55f3955796f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7feffcad1640 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955a25f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7feff00abfc0 tx=0x7feff0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09437b6e35e88cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7fefddffb640 1 -- 172.21.15.19:0/3528042120 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff001f070 con 0x55f39558adb0 2024-09-11T00:10:55.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7fefddffb640 1 -- 172.21.15.19:0/3528042120 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feff00abdd0 con 0x55f39558adb0 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.709+0000 7fefddffb640 1 -- 172.21.15.19:0/3528042120 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff00054f0 con 0x55f39558adb0 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 -- 172.21.15.19:0/3528042120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 msgr2=0x55f3955a25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955a25f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7feff00abfc0 tx=0x7feff0000f40 comp rx=0 tx=0).stop 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 -- 172.21.15.19:0/3528042120 shutdown_connections 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39558adb0 0x55f3955a25f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557aa10 0x55f3955796f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 --2- 172.21.15.19:0/3528042120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39557a0f0 0x55f395596c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 -- 172.21.15.19:0/3528042120 >> 172.21.15.19:0/3528042120 conn(0x55f395577f20 msgr2=0x55f395578fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 -- 172.21.15.19:0/3528042120 shutdown_connections 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 -- 172.21.15.19:0/3528042120 wait complete. 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.710+0000 7ff000909740 1 -- start start 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 1 Processor -- start 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f395593600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557aa10 0x55f39558fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39558adb0 0x55f3955903f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feff81aa920 con 0x55f39557aa10 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feff81abd90 con 0x55f39557a0f0 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feff81aaff0 con 0x55f39558adb0 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7ff000909740 10 client.0 _ll_register_callbacks cb 0x7feff0009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557aa10 0x55f39558fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557aa10 0x55f39558fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58234/0 (socket says 172.21.15.19:58234) 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 -- 172.21.15.19:0/1574071623 learned_addr learned my addr 172.21.15.19:0/1574071623 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff7fff640 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f395593600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feffcad1640 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39558adb0 0x55f3955903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 -- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39558adb0 msgr2=0x55f3955903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39558adb0 0x55f3955903f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 -- 172.21.15.19:0/1574071623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 msgr2=0x55f395593600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f395593600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 -- 172.21.15.19:0/1574071623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f395607800 con 0x55f39557aa10 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7feff77fe640 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557aa10 0x55f39558fc60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85181606cc3e0571 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.711+0000 7fefd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7fefd77fe640 1 -- 172.21.15.19:0/1574071623 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec04c070 con 0x55f39557aa10 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7fefd77fe640 1 -- 172.21.15.19:0/1574071623 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fefec005250 con 0x55f39557aa10 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feff00abdd0 con 0x55f39557aa10 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7fefd77fe640 1 -- 172.21.15.19:0/1574071623 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fefec058050 con 0x55f39557aa10 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 10 client.16539 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f3956089c0 con 0x55f39557aa10 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7fefd77fe640 1 -- 172.21.15.19:0/1574071623 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feff00abdd0 con 0x55f39557aa10 2024-09-11T00:10:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7fefd77fe640 1 -- 172.21.15.19:0/1574071623 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fefec031cc0 con 0x55f39557aa10 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 10 client.16539 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 20 client.16539 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f395608d30 0x55f39560b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 4 client.16539 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.712+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3954ee8a0 con 0x55f395608d30 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7feff7fff640 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f395608d30 0x55f39560b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7fefd77fe640 10 client.16539 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7feff7fff640 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f395608d30 0x55f39560b150 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9d3285024ad5283 server_cookie=7ea1cbe0661a9a88 in_seq=0 out_seq=0 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7fefd77fe640 1 -- 172.21.15.19:0/1574071623 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3954ee8a0 con 0x55f395608d30 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7fefd77fe640 10 client.16539 handle_command_reply: tid=0 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7ff000909740 1 client.16539 shutdown 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557aa10 msgr2=0x55f39558fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.713+0000 7ff000909740 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557aa10 0x55f39558fc60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec031400 comp rx=0 tx=0).stop 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 shutdown_connections 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f39558adb0 0x55f3955903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f395608d30 0x55f39560b150 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f39557aa10 0x55f39558fc60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 --2- 172.21.15.19:0/1574071623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f39557a0f0 0x55f395593600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 >> 172.21.15.19:0/1574071623 conn(0x55f395577f20 msgr2=0x55f395589160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7fefd77fe640 0 client.16539 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 shutdown_connections 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 1 -- 172.21.15.19:0/1574071623 wait complete. 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7ff000909740 20 client.16539 trim_cache size 0 max 16384 2024-09-11T00:10:55.731 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:10:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fefe00b5450 msgr2=0x7fefe00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7feffe534640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fefe00b5450 0x7fefe00b7910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55f39557e330 tx=0x7fefe80084c0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108120 msgr2=0x7feff819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.714+0000 7feffe534640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108120 0x7feff819ab50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7feff000eaa0 tx=0x7feff000ef60 comp rx=0 tx=0).stop 2024-09-11T00:10:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 shutdown_connections 2024-09-11T00:10:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fefe00b5450 0x7fefe00b7910 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108120 0x7feff819ab50 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff8107780 0x7feff819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 --2- 172.21.15.19:0/1320674713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8102920 0x7feff819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 >> 172.21.15.19:0/1320674713 conn(0x7feff8076f50 msgr2=0x7feff8100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 shutdown_connections 2024-09-11T00:10:55.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:55.715+0000 7feffe534640 1 -- 172.21.15.19:0/1320674713 wait complete. 2024-09-11T00:10:56.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:55 smithi019 ceph-mon[30859]: pgmap v581: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-11T00:10:56.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:55 smithi135 ceph-mon[35432]: pgmap v581: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-11T00:10:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:55 smithi131 ceph-mon[35491]: pgmap v581: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-11T00:10:57.436 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:10:57.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:10:57.706 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:58.134 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:57 smithi019 ceph-mon[30859]: pgmap v582: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:10:58.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:57 smithi135 ceph-mon[35432]: pgmap v582: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 -- 172.21.15.19:0/2965258015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f241045b0 msgr2=0x7f6f2410cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 --2- 172.21.15.19:0/2965258015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f241045b0 0x7f6f2410cb90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009900 tx=0x7f6f0c02a410 comp rx=0 tx=0).stop 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 -- 172.21.15.19:0/2965258015 shutdown_connections 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 --2- 172.21.15.19:0/2965258015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f2410d160 0x7f6f2410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 --2- 172.21.15.19:0/2965258015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f241045b0 0x7f6f2410cb90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 --2- 172.21.15.19:0/2965258015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f24103bb0 0x7f6f24103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 -- 172.21.15.19:0/2965258015 >> 172.21.15.19:0/2965258015 conn(0x7f6f240fd700 msgr2=0x7f6f240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 -- 172.21.15.19:0/2965258015 shutdown_connections 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.218+0000 7f6f28a94640 1 -- 172.21.15.19:0/2965258015 wait complete. 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.219+0000 7f6f28a94640 1 Processor -- start 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.219+0000 7f6f28a94640 1 -- start start 2024-09-11T00:10:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f28a94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f24103bb0 0x7f6f24199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f28a94640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f241045b0 0x7f6f24199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f28a94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f2410d160 0x7f6f2419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f28a94640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24112da0 con 0x7f6f2410d160 2024-09-11T00:10:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f28a94640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24112c20 con 0x7f6f241045b0 2024-09-11T00:10:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f28a94640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24112f20 con 0x7f6f24103bb0 2024-09-11T00:10:58.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f2410d160 0x7f6f2419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f2410d160 0x7f6f2419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58250/0 (socket says 172.21.15.19:58250) 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 -- 172.21.15.19:0/1081947643 learned_addr learned my addr 172.21.15.19:0/1081947643 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f2259c640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f24103bb0 0x7f6f24199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f241045b0 0x7f6f24199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 -- 172.21.15.19:0/1081947643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f24103bb0 msgr2=0x7f6f24199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f24103bb0 0x7f6f24199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 -- 172.21.15.19:0/1081947643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f241045b0 msgr2=0x7f6f24199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f241045b0 0x7f6f24199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 -- 172.21.15.19:0/1081947643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2419f3c0 con 0x7f6f2410d160 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f22d9d640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f2410d160 0x7f6f2419ebf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00eaa0 tx=0x7f6f1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f1bfff640 1 -- 172.21.15.19:0/1081947643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00cdb0 con 0x7f6f2410d160 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.220+0000 7f6f1bfff640 1 -- 172.21.15.19:0/1081947643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f1c005020 con 0x7f6f2410d160 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.221+0000 7f6f1bfff640 1 -- 172.21.15.19:0/1081947643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0116d0 con 0x7f6f2410d160 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.221+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2419f6b0 con 0x7f6f2410d160 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.221+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f241a5d70 con 0x7f6f2410d160 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.223+0000 7f6f2ae69740 1 Processor -- start 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.223+0000 7f6f1bfff640 1 -- 172.21.15.19:0/1081947643 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f6f1c00f040 con 0x7f6f2410d160 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2ae69740 1 -- start start 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a75512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a7561660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7563f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609a74c7e60 con 0x5609a7550ee0 2024-09-11T00:10:58.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5609a74b7290 con 0x5609a7551800 2024-09-11T00:10:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609a74bb0a0 con 0x5609a7561ba0 2024-09-11T00:10:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a75512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a75512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58258/0 (socket says 172.21.15.19:58258) 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 -- 172.21.15.19:0/980372854 learned_addr learned my addr 172.21.15.19:0/980372854 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f2259c640 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a7561660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 -- 172.21.15.19:0/980372854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 msgr2=0x5609a7563f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7563f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 -- 172.21.15.19:0/980372854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 msgr2=0x5609a7561660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a7561660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 -- 172.21.15.19:0/980372854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609a7215930 con 0x5609a7550ee0 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f1bfff640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6f100b5450 0x7f6f100b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.224+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a75512c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02a930 tx=0x7f6f0c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bd8e230a8ab9d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f2259c640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6f100b5450 0x7f6f100b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f1bfff640 1 -- 172.21.15.19:0/1081947643 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f6f1c0e5e00 con 0x7f6f2410d160 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f18d99640 1 -- 172.21.15.19:0/980372854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c035050 con 0x5609a7550ee0 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f18d99640 1 -- 172.21.15.19:0/980372854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c0316a0 con 0x5609a7550ee0 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f18d99640 1 -- 172.21.15.19:0/980372854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0046c0 con 0x5609a7550ee0 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f2ae69740 1 -- 172.21.15.19:0/980372854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 msgr2=0x5609a75512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f2259c640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6f100b5450 0x7f6f100b7910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5609a7554060 tx=0x7f6f1400a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.225+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a75512c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02a930 tx=0x7f6f0c005e50 comp rx=0 tx=0).stop 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- 172.21.15.19:0/980372854 shutdown_connections 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7563f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a7561660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/980372854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a75512c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- 172.21.15.19:0/980372854 >> 172.21.15.19:0/980372854 conn(0x5609a754ed10 msgr2=0x5609a754feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- 172.21.15.19:0/980372854 shutdown_connections 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- 172.21.15.19:0/980372854 wait complete. 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- start start 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 Processor -- start 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7550ee0 0x5609a755eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a755f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7561ba0 0x5609a755f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609a7318890 con 0x5609a7561ba0 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5609a7451d40 con 0x5609a7551800 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609a75647f0 con 0x5609a7550ee0 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f2ae69740 10 client.0 _ll_register_callbacks cb 0x5609a74b5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:58.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7561ba0 0x5609a755f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7561ba0 0x5609a755f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58272/0 (socket says 172.21.15.19:58272) 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.226+0000 7f6f22d9d640 1 -- 172.21.15.19:0/3520713029 learned_addr learned my addr 172.21.15.19:0/3520713029 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f2259c640 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7550ee0 0x5609a755eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a755f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f22d9d640 1 -- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7550ee0 msgr2=0x5609a755eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f22d9d640 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7550ee0 0x5609a755eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f22d9d640 1 -- 172.21.15.19:0/3520713029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 msgr2=0x5609a755f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f22d9d640 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a755f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f22d9d640 1 -- 172.21.15.19:0/3520713029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609a756dc00 con 0x5609a7561ba0 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f22d9d640 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7561ba0 0x5609a755f5e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0abfd0 tx=0x7f6f1c005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4ab05b0fd7e7c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f09ffb640 1 -- 172.21.15.19:0/3520713029 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c01f030 con 0x5609a7561ba0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f09ffb640 1 -- 172.21.15.19:0/3520713029 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f6f1c0cf070 con 0x5609a7561ba0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0c0316a0 con 0x5609a7561ba0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f09ffb640 1 -- 172.21.15.19:0/3520713029 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6f1c0b0db0 con 0x5609a7561ba0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f2ae69740 10 client.16551 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5609a75705b0 con 0x5609a7561ba0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.227+0000 7f6f09ffb640 1 -- 172.21.15.19:0/3520713029 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c0316a0 con 0x5609a7561ba0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f09ffb640 1 -- 172.21.15.19:0/3520713029 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f6f1c0a7c20 con 0x5609a7561ba0 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2ae69740 10 client.16551 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2ae69740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2ae69740 20 client.16551 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a7571b60 0x5609a7573f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2ae69740 4 client.16551 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609a74c9db0 con 0x5609a7571b60 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2259c640 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a7571b60 0x5609a7573f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f2259c640 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a7571b60 0x5609a7573f80 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a95880fc3d98f7bd server_cookie=4b1666a52b016e50 in_seq=0 out_seq=0 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.228+0000 7f6f09ffb640 10 client.16551 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.229+0000 7f6f09ffb640 1 -- 172.21.15.19:0/3520713029 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609a74c9db0 con 0x5609a7571b60 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.229+0000 7f6f09ffb640 10 client.16551 handle_command_reply: tid=0 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.229+0000 7f6f2ae69740 1 client.16551 shutdown 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.229+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7561ba0 msgr2=0x5609a755f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.229+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7561ba0 0x5609a755f5e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0abfd0 tx=0x7f6f1c005450 comp rx=0 tx=0).stop 2024-09-11T00:10:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 shutdown_connections 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a7571b60 0x5609a7573f80 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7561ba0 0x5609a755f5e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a755f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/3520713029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7550ee0 0x5609a755eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f09ffb640 0 client.16551 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 >> 172.21.15.19:0/3520713029 conn(0x5609a754ed10 msgr2=0x5609a754df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 shutdown_connections 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 1 -- 172.21.15.19:0/3520713029 wait complete. 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.230+0000 7f6f2ae69740 20 client.16551 trim_cache size 0 max 16384 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 Processor -- start 2024-09-11T00:10:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 -- start start 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7550ee0 0x5609a75608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7551800 0x5609a7579850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7579d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241aec40 con 0x5609a7551800 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241ac480 con 0x5609a7550ee0 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241aa2d0 con 0x5609a7561ba0 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7551800 0x5609a7579850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7551800 0x5609a7579850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58282/0 (socket says 172.21.15.19:58282) 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.248+0000 7f6f19d9b640 1 -- 172.21.15.19:0/739935061 learned_addr learned my addr 172.21.15.19:0/739935061 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f19d9b640 1 -- 172.21.15.19:0/739935061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 msgr2=0x5609a7579d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/739935061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7579d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f19d9b640 1 -- 172.21.15.19:0/739935061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7550ee0 msgr2=0x5609a75608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/739935061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7550ee0 0x5609a75608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f19d9b640 1 -- 172.21.15.19:0/739935061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609a7562800 con 0x5609a7551800 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/739935061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7551800 0x5609a7579850 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c033000 tx=0x7f6f0c005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d47319c8534e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f0bfff640 1 -- 172.21.15.19:0/739935061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c053070 con 0x5609a7551800 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f0bfff640 1 -- 172.21.15.19:0/739935061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c004b70 con 0x5609a7551800 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.249+0000 7f6f0bfff640 1 -- 172.21.15.19:0/739935061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c035070 con 0x5609a7551800 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 -- 172.21.15.19:0/739935061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7551800 msgr2=0x5609a7579850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/739935061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7551800 0x5609a7579850 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c033000 tx=0x7f6f0c005380 comp rx=0 tx=0).stop 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 -- 172.21.15.19:0/739935061 shutdown_connections 2024-09-11T00:10:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/739935061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7579d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/739935061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7551800 0x5609a7579850 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/739935061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7550ee0 0x5609a75608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 -- 172.21.15.19:0/739935061 >> 172.21.15.19:0/739935061 conn(0x5609a754ed10 msgr2=0x5609a7560190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 -- 172.21.15.19:0/739935061 shutdown_connections 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 -- 172.21.15.19:0/739935061 wait complete. 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 -- start start 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 Processor -- start 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a756a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a75666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.250+0000 7f6f2ae69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7566c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241aa940 con 0x5609a7550ee0 2024-09-11T00:10:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241abdb0 con 0x5609a7551800 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2ae69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241ab010 con 0x5609a7561ba0 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a756a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2ae69740 10 client.0 _ll_register_callbacks cb 0x7f6f1c0a8920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a756a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58298/0 (socket says 172.21.15.19:58298) 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 -- 172.21.15.19:0/1835311671 learned_addr learned my addr 172.21.15.19:0/1835311671 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a75666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f22d9d640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7566c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 -- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 msgr2=0x5609a7566c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7566c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 -- 172.21.15.19:0/1835311671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 msgr2=0x5609a75666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a75666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 -- 172.21.15.19:0/1835311671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609a7567440 con 0x5609a7550ee0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a75666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2259c640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a756a1f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5609a75747f0 tx=0x7f6f14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561335ceb617d9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f09ffb640 1 -- 172.21.15.19:0/1835311671 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14005020 con 0x5609a7550ee0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.251+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0c004b70 con 0x5609a7550ee0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f09ffb640 1 -- 172.21.15.19:0/1835311671 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7f6f14027070 con 0x5609a7550ee0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f09ffb640 1 -- 172.21.15.19:0/1835311671 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6f140051c0 con 0x5609a7550ee0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 10 client.16557 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5609a75dfb20 con 0x5609a7550ee0 2024-09-11T00:10:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f09ffb640 1 -- 172.21.15.19:0/1835311671 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c004b70 con 0x5609a7550ee0 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f09ffb640 1 -- 172.21.15.19:0/1835311671 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f6f140047a0 con 0x5609a7550ee0 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 10 client.16557 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 20 client.16557 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a75e0280 0x5609a75e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 4 client.16557 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5609a74c5860 con 0x5609a75e0280 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.252+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a75e0280 0x5609a75e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.253+0000 7f6f19d9b640 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a75e0280 0x5609a75e26a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4265ea0558693f0 server_cookie=6d12c3f5a1b4fd97 in_seq=0 out_seq=0 2024-09-11T00:10:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.253+0000 7f6f09ffb640 10 client.16557 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.254+0000 7f6f09ffb640 1 -- 172.21.15.19:0/1835311671 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5609a74c5860 con 0x5609a75e0280 2024-09-11T00:10:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.254+0000 7f6f09ffb640 10 client.16557 handle_command_reply: tid=0 2024-09-11T00:10:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.254+0000 7f6f2ae69740 1 client.16557 shutdown 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 msgr2=0x5609a756a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a756a1f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5609a75747f0 tx=0x7f6f14004730 comp rx=0 tx=0).stop 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 shutdown_connections 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609a7561ba0 0x5609a7566c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609a7551800 0x5609a75666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609a75e0280 0x5609a75e26a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f09ffb640 0 client.16557 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 --2- 172.21.15.19:0/1835311671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7550ee0 0x5609a756a1f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 >> 172.21.15.19:0/1835311671 conn(0x5609a754ed10 msgr2=0x5609a756d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 shutdown_connections 2024-09-11T00:10:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 1 -- 172.21.15.19:0/1835311671 wait complete. 2024-09-11T00:10:58.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f2ae69740 20 client.16557 trim_cache size 0 max 16384 2024-09-11T00:10:58.276 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:10:58.276 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:10:58.276 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "e66baedb-0b9a-4aa0-b143-f749e4000f12", 2024-09-11T00:10:58.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:10:58.276 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:10:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.255+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6f100b5450 msgr2=0x7f6f100b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6f100b5450 0x7f6f100b7910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5609a7554060 tx=0x7f6f1400a250 comp rx=0 tx=0).stop 2024-09-11T00:10:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f2410d160 msgr2=0x7f6f2419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f2410d160 0x7f6f2419ebf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00eaa0 tx=0x7f6f1c00ef60 comp rx=0 tx=0).stop 2024-09-11T00:10:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 shutdown_connections 2024-09-11T00:10:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f6f100b5450 0x7f6f100b7910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f2410d160 0x7f6f2419ebf0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f241045b0 0x7f6f24199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 --2- 172.21.15.19:0/1081947643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f24103bb0 0x7f6f24199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 >> 172.21.15.19:0/1081947643 conn(0x7f6f240fd700 msgr2=0x7f6f240fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 shutdown_connections 2024-09-11T00:10:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:58.256+0000 7f6f28a94640 1 -- 172.21.15.19:0/1081947643 wait complete. 2024-09-11T00:10:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:57 smithi131 ceph-mon[35491]: pgmap v582: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:10:59.023 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:10:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 -- 172.21.15.19:0/2370910983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 msgr2=0x7fe334102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/2370910983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334102070 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe330009900 tx=0x7fe33002a410 comp rx=0 tx=0).stop 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 -- 172.21.15.19:0/2370910983 shutdown_connections 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/2370910983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334108020 0x7fe33410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/2370910983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3341076a0 0x7fe334107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/2370910983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334102070 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 -- 172.21.15.19:0/2370910983 >> 172.21.15.19:0/2370910983 conn(0x7fe3340fd700 msgr2=0x7fe3340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:59.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 -- 172.21.15.19:0/2370910983 shutdown_connections 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 -- 172.21.15.19:0/2370910983 wait complete. 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 Processor -- start 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.778+0000 7fe33bd6b640 1 -- start start 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe33bd6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe33bd6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3341076a0 0x7fe334199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe33bd6b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe334108020 0x7fe33419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe33bd6b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe334111ce0 con 0x7fe334101c90 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe33bd6b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe334111b60 con 0x7fe334108020 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe33bd6b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe334111e60 con 0x7fe3341076a0 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58318/0 (socket says 172.21.15.19:58318) 2024-09-11T00:10:59.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 -- 172.21.15.19:0/1394586041 learned_addr learned my addr 172.21.15.19:0/1394586041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339306640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3341076a0 0x7fe334199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe33a308640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe334108020 0x7fe33419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 -- 172.21.15.19:0/1394586041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3341076a0 msgr2=0x7fe334199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3341076a0 0x7fe334199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 -- 172.21.15.19:0/1394586041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe334108020 msgr2=0x7fe33419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe334108020 0x7fe33419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 -- 172.21.15.19:0/1394586041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33419f3f0 con 0x7fe334101c90 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.779+0000 7fe339b07640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334199340 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe330005940 tx=0x7fe3300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.780+0000 7fe32affd640 1 -- 172.21.15.19:0/1394586041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33003f030 con 0x7fe334101c90 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.780+0000 7fe32affd640 1 -- 172.21.15.19:0/1394586041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe330003cb0 con 0x7fe334101c90 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.780+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33419f680 con 0x7fe334101c90 2024-09-11T00:10:59.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.780+0000 7fe32affd640 1 -- 172.21.15.19:0/1394586041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330035070 con 0x7fe334101c90 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.780+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3341a5da0 con 0x7fe334101c90 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.782+0000 7fe33e140740 1 Processor -- start 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33e140740 1 -- start start 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe32affd640 1 -- 172.21.15.19:0/1394586041 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fe33003bbf0 con 0x7fe334101c90 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33e140740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d44480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33e140740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d50410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33e140740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d52d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33e140740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b691cbae50 con 0x55b691d449c0 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33e140740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55b691caa280 con 0x55b691d440a0 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33e140740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b691cae090 con 0x55b691d50950 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d50410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d50410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58326/0 (socket says 172.21.15.19:58326) 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 -- 172.21.15.19:0/939462806 learned_addr learned my addr 172.21.15.19:0/939462806 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:59.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339306640 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d52d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe33a308640 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d44480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 -- 172.21.15.19:0/939462806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 msgr2=0x55b691d52d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d52d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 -- 172.21.15.19:0/939462806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 msgr2=0x55b691d44480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d44480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.783+0000 7fe339b07640 1 -- 172.21.15.19:0/939462806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b691a08650 con 0x55b691d449c0 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.784+0000 7fe32affd640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe3200b54d0 0x7fe3200b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.784+0000 7fe339b07640 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d50410 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe330104130 tx=0x7fe33010ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97b05ab31798396 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.784+0000 7fe33a308640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe3200b54d0 0x7fe3200b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.784+0000 7fe32affd640 1 -- 172.21.15.19:0/1394586041 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fe330106a20 con 0x7fe334101c90 2024-09-11T00:10:59.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.784+0000 7fe31ffff640 1 -- 172.21.15.19:0/939462806 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300c95f0 con 0x55b691d449c0 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.784+0000 7fe31ffff640 1 -- 172.21.15.19:0/939462806 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe33010f050 con 0x55b691d449c0 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.784+0000 7fe31ffff640 1 -- 172.21.15.19:0/939462806 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330005d50 con 0x55b691d449c0 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 -- 172.21.15.19:0/939462806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 msgr2=0x55b691d50410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33a308640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe3200b54d0 0x7fe3200b7990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe32c005fd0 tx=0x7fe32c0096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d50410 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe330104130 tx=0x7fe33010ac40 comp rx=0 tx=0).stop 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 -- 172.21.15.19:0/939462806 shutdown_connections 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d52d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d50410 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 --2- 172.21.15.19:0/939462806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d44480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 -- 172.21.15.19:0/939462806 >> 172.21.15.19:0/939462806 conn(0x55b691d41ed0 msgr2=0x55b691d43070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 -- 172.21.15.19:0/939462806 shutdown_connections 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 -- 172.21.15.19:0/939462806 wait complete. 2024-09-11T00:10:59.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 -- start start 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.785+0000 7fe33e140740 1 Processor -- start 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33e140740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d440a0 0x55b691d501c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33e140740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d4d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33e140740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d50950 0x55b691d4db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33e140740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b691b0b700 con 0x55b691d449c0 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33e140740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55b691c45110 con 0x55b691d50950 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33e140740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b691d577a0 con 0x55b691d440a0 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33e140740 10 client.0 _ll_register_callbacks cb 0x55b691c5e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d4d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d4d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58328/0 (socket says 172.21.15.19:58328) 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 -- 172.21.15.19:0/3568745830 learned_addr learned my addr 172.21.15.19:0/3568745830 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:59.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339b07640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d440a0 0x55b691d501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33a308640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d50950 0x55b691d4db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 -- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d440a0 msgr2=0x55b691d501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d440a0 0x55b691d501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 -- 172.21.15.19:0/3568745830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d50950 msgr2=0x55b691d4db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d50950 0x55b691d4db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 -- 172.21.15.19:0/3568745830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b691c72c40 con 0x55b691d449c0 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe33a308640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d50950 0x55b691d4db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe339306640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d4d610 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe32400bad0 tx=0x7fe32400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893098a4062a63ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.786+0000 7fe31d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3568745830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324003e00 con 0x55b691d449c0 2024-09-11T00:10:59.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3568745830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fe324005020 con 0x55b691d449c0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe33010f050 con 0x55b691d449c0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3568745830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe324005220 con 0x55b691d449c0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 10 client.16569 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b691d63030 con 0x55b691d449c0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3568745830 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe33010f050 con 0x55b691d449c0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3568745830 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe32401b570 con 0x55b691d449c0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 10 client.16569 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 20 client.16569 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691d644b0 0x55b691d668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 4 client.16569 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.787+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b691cbcda0 con 0x55b691d644b0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.788+0000 7fe339b07640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691d644b0 0x55b691d668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.788+0000 7fe339b07640 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691d644b0 0x55b691d668f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da2774633ff9ff86 server_cookie=7945544d882fcb8a in_seq=0 out_seq=0 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.788+0000 7fe31d7fa640 10 client.16569 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3568745830 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b691cbcda0 con 0x55b691d644b0 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe31d7fa640 10 client.16569 handle_command_reply: tid=0 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 client.16569 shutdown 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 msgr2=0x55b691d4d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d4d610 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe32400bad0 tx=0x7fe32400bf90 comp rx=0 tx=0).stop 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 shutdown_connections 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d50950 0x55b691d4db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691d644b0 0x55b691d668f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d449c0 0x55b691d4d610 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe31d7fa640 0 client.16569 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:59.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 --2- 172.21.15.19:0/3568745830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d440a0 0x55b691d501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 >> 172.21.15.19:0/3568745830 conn(0x55b691d41ed0 msgr2=0x55b691d47a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:59.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 shutdown_connections 2024-09-11T00:10:59.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 1 -- 172.21.15.19:0/3568745830 wait complete. 2024-09-11T00:10:59.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.789+0000 7fe33e140740 20 client.16569 trim_cache size 0 max 16384 2024-09-11T00:10:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.807+0000 7fe33e140740 1 Processor -- start 2024-09-11T00:10:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.807+0000 7fe33e140740 1 -- start start 2024-09-11T00:10:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33e140740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d41710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33e140740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d449c0 0x55b691d51d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33e140740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d50950 0x55b691d52280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33e140740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341aee40 con 0x55b691d50950 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33e140740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341ac680 con 0x55b691d440a0 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33e140740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341aa4f0 con 0x55b691d449c0 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d50950 0x55b691d52280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe339306640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d449c0 0x55b691d51d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d50950 0x55b691d52280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58342/0 (socket says 172.21.15.19:58342) 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 -- 172.21.15.19:0/853995691 learned_addr learned my addr 172.21.15.19:0/853995691 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe339b07640 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d41710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 -- 172.21.15.19:0/853995691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d449c0 msgr2=0x55b691d51d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d449c0 0x55b691d51d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 -- 172.21.15.19:0/853995691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 msgr2=0x55b691d41710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d41710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe33a308640 1 -- 172.21.15.19:0/853995691 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b691d43a80 con 0x55b691d50950 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.808+0000 7fe339306640 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d449c0 0x55b691d51d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.809+0000 7fe33a308640 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d50950 0x55b691d52280 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0108b0 tx=0x7fe32c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566491adef9f8583 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.809+0000 7fe31f7fe640 1 -- 172.21.15.19:0/853995691 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c01e0d0 con 0x55b691d50950 2024-09-11T00:10:59.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.809+0000 7fe31f7fe640 1 -- 172.21.15.19:0/853995691 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe32c01e270 con 0x55b691d50950 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.809+0000 7fe31f7fe640 1 -- 172.21.15.19:0/853995691 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c01ea50 con 0x55b691d50950 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 -- 172.21.15.19:0/853995691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d50950 msgr2=0x55b691d52280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d50950 0x55b691d52280 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0108b0 tx=0x7fe32c016000 comp rx=0 tx=0).stop 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 -- 172.21.15.19:0/853995691 shutdown_connections 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d50950 0x55b691d52280 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d449c0 0x55b691d51d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 --2- 172.21.15.19:0/853995691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d440a0 0x55b691d41710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 -- 172.21.15.19:0/853995691 >> 172.21.15.19:0/853995691 conn(0x55b691d41ed0 msgr2=0x55b691d4f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 -- 172.21.15.19:0/853995691 shutdown_connections 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 -- 172.21.15.19:0/853995691 wait complete. 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 -- start start 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.810+0000 7fe33e140740 1 Processor -- start 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33e140740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d440a0 0x55b691d5cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33e140740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d449c0 0x55b691d5d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33e140740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d57af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33e140740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341aab40 con 0x55b691d440a0 2024-09-11T00:10:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33e140740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341abfb0 con 0x55b691d449c0 2024-09-11T00:10:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33e140740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341ab210 con 0x55b691d50950 2024-09-11T00:10:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d440a0 0x55b691d5cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33e140740 10 client.0 _ll_register_callbacks cb 0x7fe324004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d440a0 0x55b691d5cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58358/0 (socket says 172.21.15.19:58358) 2024-09-11T00:10:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 -- 172.21.15.19:0/3736652458 learned_addr learned my addr 172.21.15.19:0/3736652458 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:10:59.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33a308640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d57af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339306640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d449c0 0x55b691d5d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 -- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 msgr2=0x55b691d57af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d57af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 -- 172.21.15.19:0/3736652458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d449c0 msgr2=0x55b691d5d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:59.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d449c0 0x55b691d5d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 -- 172.21.15.19:0/3736652458 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b691d582f0 con 0x55b691d440a0 2024-09-11T00:10:59.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe33a308640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d57af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:59.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe339b07640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d440a0 0x55b691d5cd70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe3300ccca0 tx=0x7fe330032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86a21491db8c474 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:59.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.811+0000 7fe31d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:10:59.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3736652458 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330049040 con 0x55b691d440a0 2024-09-11T00:10:59.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3736652458 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8441+0+0 (secure 0 0 0) 0x7fe3300b81c0 con 0x55b691d440a0 2024-09-11T00:10:59.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe32c01e270 con 0x55b691d440a0 2024-09-11T00:10:59.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3736652458 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe3300cc710 con 0x55b691d440a0 2024-09-11T00:10:59.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 10 client.16575 fetch_fsmap learned FSMap version 35 2024-09-11T00:10:59.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b691dd2060 con 0x55b691d440a0 2024-09-11T00:10:59.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3736652458 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe32c01e270 con 0x55b691d440a0 2024-09-11T00:10:59.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3736652458 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe330104440 con 0x55b691d440a0 2024-09-11T00:10:59.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 10 client.16575 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:10:59.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:10:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 20 client.16575 populate_metadata read hostname 'smithi019' 2024-09-11T00:10:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691dd24c0 0x55b691dd48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 4 client.16575 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:10:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.812+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b691cb8850 con 0x55b691dd24c0 2024-09-11T00:10:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.813+0000 7fe339306640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691dd24c0 0x55b691dd48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.813+0000 7fe31d7fa640 10 client.16575 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:59.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.813+0000 7fe339306640 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691dd24c0 0x55b691dd48e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ecdffe791b64f0 server_cookie=c13c3be7ae141e1e in_seq=0 out_seq=0 2024-09-11T00:10:59.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.813+0000 7fe31d7fa640 1 -- 172.21.15.19:0/3736652458 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55b691cb8850 con 0x55b691dd24c0 2024-09-11T00:10:59.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.813+0000 7fe31d7fa640 10 client.16575 handle_command_reply: tid=0 2024-09-11T00:10:59.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.813+0000 7fe33e140740 1 client.16575 shutdown 2024-09-11T00:10:59.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.813+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d440a0 msgr2=0x55b691d5cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d440a0 0x55b691d5cd70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe3300ccca0 tx=0x7fe330032f60 comp rx=0 tx=0).stop 2024-09-11T00:10:59.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 shutdown_connections 2024-09-11T00:10:59.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b691d50950 0x55b691d57af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b691d449c0 0x55b691d5d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55b691dd24c0 0x55b691dd48e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 --2- 172.21.15.19:0/3736652458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b691d440a0 0x55b691d5cd70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe31d7fa640 0 client.16575 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:10:59.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 >> 172.21.15.19:0/3736652458 conn(0x55b691d41ed0 msgr2=0x55b691d4be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:59.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 shutdown_connections 2024-09-11T00:10:59.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 1 -- 172.21.15.19:0/3736652458 wait complete. 2024-09-11T00:10:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33e140740 20 client.16575 trim_cache size 0 max 16384 2024-09-11T00:10:59.830 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:10:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:10:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:10:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "e66baedb-0b9a-4aa0-b143-f749e4000f12": { 2024-09-11T00:10:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "e66baedb-0b9a-4aa0-b143-f749e4000f12", 2024-09-11T00:10:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:10:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:10:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "e66baedb-0b9a-4aa0-b143-f749e4000f12": { 2024-09-11T00:10:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:58.253354+0000", 2024-09-11T00:10:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:10:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:10:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:10:59.840 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:59.841 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:10:59.841 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:10:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe3200b54d0 msgr2=0x7fe3200b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe3200b54d0 0x7fe3200b7990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe32c005fd0 tx=0x7fe32c0096a0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 msgr2=0x7fe334199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334199340 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe330005940 tx=0x7fe3300042f0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 shutdown_connections 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe334108020 0x7fe33419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3341076a0 0x7fe334199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe3200b54d0 0x7fe3200b7990 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 --2- 172.21.15.19:0/1394586041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334101c90 0x7fe334199340 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.814+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 >> 172.21.15.19:0/1394586041 conn(0x7fe3340fd700 msgr2=0x7fe33406ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.815+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 shutdown_connections 2024-09-11T00:10:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:10:59.815+0000 7fe33bd6b640 1 -- 172.21.15.19:0/1394586041 wait complete. 2024-09-11T00:11:00.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:59 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:11:00.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:59 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:59 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:11:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:59 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:00.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:10:59 smithi019 ceph-mon[30859]: pgmap v583: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:11:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:59 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:11:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:59 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:00.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:59 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:11:00.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:59 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:00.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:10:59 smithi135 ceph-mon[35432]: pgmap v583: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:11:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:59 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:11:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:59 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:00.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:59 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:11:00.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:59 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:00.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:10:59 smithi131 ceph-mon[35491]: pgmap v583: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:11:00.569 INFO:tasks.cephfs.filesystem:scrub status for tag:e66baedb-0b9a-4aa0-b143-f749e4000f12 - {'path': '/', 'tag': 'e66baedb-0b9a-4aa0-b143-f749e4000f12', 'options': 'recursive,force'} 2024-09-11T00:11:01.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:00 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:11:01.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:00 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:11:01.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:00 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:11:02.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:01 smithi135 ceph-mon[35432]: pgmap v584: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:11:02.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:01 smithi019 ceph-mon[30859]: pgmap v584: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:11:02.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:01 smithi131 ceph-mon[35491]: pgmap v584: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:11:04.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:03 smithi135 ceph-mon[35432]: pgmap v585: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:11:04.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:03 smithi019 ceph-mon[30859]: pgmap v585: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:11:04.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:03 smithi131 ceph-mon[35491]: pgmap v585: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:11:05.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:04 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:05.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:04 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:05.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:04 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:06.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:05 smithi135 ceph-mon[35432]: pgmap v586: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:06.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:11:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:05 smithi019 ceph-mon[30859]: pgmap v586: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:11:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:05 smithi131 ceph-mon[35491]: pgmap v586: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:11:08.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:07 smithi135 ceph-mon[35432]: pgmap v587: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:11:08.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:07 smithi019 ceph-mon[30859]: pgmap v587: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:11:08.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:07 smithi131 ceph-mon[35491]: pgmap v587: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:11:10.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:09 smithi135 ceph-mon[35432]: pgmap v588: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:10.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:09 smithi019 ceph-mon[30859]: pgmap v588: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:10.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:09 smithi131 ceph-mon[35491]: pgmap v588: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:12.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:11 smithi135 ceph-mon[35432]: pgmap v589: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:12.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:11 smithi135 ceph-mon[35432]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T00:11:12.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:11 smithi019 ceph-mon[30859]: pgmap v589: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:12.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:11 smithi019 ceph-mon[30859]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T00:11:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:11 smithi131 ceph-mon[35491]: pgmap v589: 97 pgs: 97 active+clean; 858 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:11:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:11 smithi131 ceph-mon[35491]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T00:11:14.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:13 smithi135 ceph-mon[35432]: pgmap v591: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 855 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:11:14.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:13 smithi019 ceph-mon[30859]: pgmap v591: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 855 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:11:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:13 smithi131 ceph-mon[35491]: pgmap v591: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 855 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:11:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:15 smithi135 ceph-mon[35432]: pgmap v592: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 853 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:16.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:15 smithi019 ceph-mon[30859]: pgmap v592: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 853 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:15 smithi131 ceph-mon[35491]: pgmap v592: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 853 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:18.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:17 smithi135 ceph-mon[35432]: pgmap v593: 97 pgs: 13 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 77 active+clean; 847 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:18.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:17 smithi019 ceph-mon[30859]: pgmap v593: 97 pgs: 13 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 77 active+clean; 847 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:18.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:17 smithi131 ceph-mon[35491]: pgmap v593: 97 pgs: 13 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 77 active+clean; 847 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:20.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:19 smithi135 ceph-mon[35432]: pgmap v594: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:20.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:19 smithi019 ceph-mon[30859]: pgmap v594: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:20.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:19 smithi131 ceph-mon[35491]: pgmap v594: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:22.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:21 smithi135 ceph-mon[35432]: pgmap v595: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:22.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:21 smithi019 ceph-mon[30859]: pgmap v595: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:22.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:21 smithi131 ceph-mon[35491]: pgmap v595: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:11:24.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:23 smithi135 ceph-mon[35432]: pgmap v596: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 173 B/s wr, 6 op/s 2024-09-11T00:11:24.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:23 smithi135 ceph-mon[35432]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T00:11:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:23 smithi019 ceph-mon[30859]: pgmap v596: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 173 B/s wr, 6 op/s 2024-09-11T00:11:24.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:23 smithi019 ceph-mon[30859]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T00:11:24.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:23 smithi131 ceph-mon[35491]: pgmap v596: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 173 B/s wr, 6 op/s 2024-09-11T00:11:24.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:23 smithi131 ceph-mon[35491]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T00:11:26.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:25 smithi135 ceph-mon[35432]: pgmap v598: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:26.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:25 smithi019 ceph-mon[30859]: pgmap v598: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:26.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:25 smithi131 ceph-mon[35491]: pgmap v598: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:27 smithi135 ceph-mon[35432]: pgmap v599: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:28.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:27 smithi019 ceph-mon[30859]: pgmap v599: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:28.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:27 smithi131 ceph-mon[35491]: pgmap v599: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:29 smithi135 ceph-mon[35432]: pgmap v600: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:30.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:29 smithi019 ceph-mon[30859]: pgmap v600: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:29 smithi131 ceph-mon[35491]: pgmap v600: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:11:30.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:11:30.837 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 -- 172.21.15.19:0/277915963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c109150 msgr2=0x7f8f1c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 --2- 172.21.15.19:0/277915963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c109150 0x7f8f1c10f950 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009ca0 tx=0x7f8f1402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 -- 172.21.15.19:0/277915963 shutdown_connections 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 --2- 172.21.15.19:0/277915963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c109150 0x7f8f1c10f950 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 --2- 172.21.15.19:0/277915963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f1c1087d0 0x7f8f1c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 --2- 172.21.15.19:0/277915963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f1c102dc0 0x7f8f1c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 -- 172.21.15.19:0/277915963 >> 172.21.15.19:0/277915963 conn(0x7f8f1c0fe830 msgr2=0x7f8f1c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 -- 172.21.15.19:0/277915963 shutdown_connections 2024-09-11T00:11:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.328+0000 7f8f231bc640 1 -- 172.21.15.19:0/277915963 wait complete. 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 Processor -- start 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 -- start start 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f1c102dc0 0x7f8f1c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c1087d0 0x7f8f1c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f1c109150 0x7f8f1c19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c112e10 con 0x7f8f1c1087d0 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c112c90 con 0x7f8f1c109150 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.329+0000 7f8f231bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c112f90 con 0x7f8f1c102dc0 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c1087d0 0x7f8f1c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c1087d0 0x7f8f1c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40836/0 (socket says 172.21.15.19:40836) 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 -- 172.21.15.19:0/660319872 learned_addr learned my addr 172.21.15.19:0/660319872 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f20f58640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f1c102dc0 0x7f8f1c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f21759640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f1c109150 0x7f8f1c19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 -- 172.21.15.19:0/660319872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f1c102dc0 msgr2=0x7f8f1c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f1c102dc0 0x7f8f1c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 -- 172.21.15.19:0/660319872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f1c109150 msgr2=0x7f8f1c19eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f1c109150 0x7f8f1c19eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 -- 172.21.15.19:0/660319872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c19f470 con 0x7f8f1c1087d0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f21759640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f1c109150 0x7f8f1c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c1087d0 0x7f8f1c199900 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b4a0 tx=0x7f8f0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f19ffb640 1 -- 172.21.15.19:0/660319872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08014070 con 0x7f8f1c1087d0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f19ffb640 1 -- 172.21.15.19:0/660319872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f08010ac0 con 0x7f8f1c1087d0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c19f760 con 0x7f8f1c1087d0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f19ffb640 1 -- 172.21.15.19:0/660319872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08017c30 con 0x7f8f1c1087d0 2024-09-11T00:11:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.330+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c1a5e20 con 0x7f8f1c1087d0 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 Processor -- start 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f19ffb640 1 -- 172.21.15.19:0/660319872 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f8f08010610 con 0x7f8f1c1087d0 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 -- start start 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae75d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae770530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5592ae6d3e50 con 0x5592ae75dda0 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5592ae6c3280 con 0x5592ae76e140 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f25591740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592ae6c7090 con 0x5592ae75d480 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40846/0 (socket says 172.21.15.19:40846) 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 -- 172.21.15.19:0/1510255021 learned_addr learned my addr 172.21.15.19:0/1510255021 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f21759640 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae75d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae770530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 -- 172.21.15.19:0/1510255021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 msgr2=0x5592ae75d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae75d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 -- 172.21.15.19:0/1510255021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 msgr2=0x5592ae770530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae770530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f20f58640 1 -- 172.21.15.19:0/1510255021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592ae421650 con 0x5592ae75dda0 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.334+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae770530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.335+0000 7f8f19ffb640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8f0c0b5450 0x7f8f0c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.335+0000 7f8f21759640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8f0c0b5450 0x7f8f0c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.335+0000 7f8f20f58640 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76dc00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000bd40 tx=0x7f8f100107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813e88605bdedbdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.335+0000 7f8f19ffb640 1 -- 172.21.15.19:0/660319872 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f8f080e5880 con 0x7f8f1c1087d0 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.335+0000 7f8f06ffd640 1 -- 172.21.15.19:0/1510255021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10004230 con 0x5592ae75dda0 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.335+0000 7f8f06ffd640 1 -- 172.21.15.19:0/1510255021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f1000be30 con 0x5592ae75dda0 2024-09-11T00:11:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.335+0000 7f8f06ffd640 1 -- 172.21.15.19:0/1510255021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1001a850 con 0x5592ae75dda0 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 -- 172.21.15.19:0/1510255021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 msgr2=0x5592ae76dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f21759640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8f0c0b5450 0x7f8f0c0b7910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009a60 tx=0x7f8f14005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76dc00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000bd40 tx=0x7f8f100107a0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 -- 172.21.15.19:0/1510255021 shutdown_connections 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae770530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76dc00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 --2- 172.21.15.19:0/1510255021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae75d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 -- 172.21.15.19:0/1510255021 >> 172.21.15.19:0/1510255021 conn(0x5592ae75b2b0 msgr2=0x5592ae75c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 -- 172.21.15.19:0/1510255021 shutdown_connections 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 -- 172.21.15.19:0/1510255021 wait complete. 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 -- start start 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.336+0000 7f8f25591740 1 Processor -- start 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f25591740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae76d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f25591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f25591740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae76b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f25591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5592ae524700 con 0x5592ae75dda0 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f25591740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5592ae65e110 con 0x5592ae76e140 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f25591740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592ae770df0 con 0x5592ae75d480 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f25591740 10 client.0 _ll_register_callbacks cb 0x5592ae677990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40850/0 (socket says 172.21.15.19:40850) 2024-09-11T00:11:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 -- 172.21.15.19:0/277936336 learned_addr learned my addr 172.21.15.19:0/277936336 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f20f58640 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae76d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f21759640 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae76b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 -- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 msgr2=0x5592ae76d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae76d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 -- 172.21.15.19:0/277936336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 msgr2=0x5592ae76b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae76b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 -- 172.21.15.19:0/277936336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592ae68bc40 con 0x5592ae75dda0 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76ae00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f08000c00 tx=0x7f8f080abbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1fbbe0a850d191 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8efbfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8efbfff640 1 -- 172.21.15.19:0/277936336 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0801e030 con 0x5592ae75dda0 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.337+0000 7f8efbfff640 1 -- 172.21.15.19:0/277936336 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f8f080a7fc0 con 0x5592ae75dda0 2024-09-11T00:11:31.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f1000be30 con 0x5592ae75dda0 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8efbfff640 1 -- 172.21.15.19:0/277936336 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8f080ab860 con 0x5592ae75dda0 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 10 client.16587 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5592ae77c6a0 con 0x5592ae75dda0 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8efbfff640 1 -- 172.21.15.19:0/277936336 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f1000be30 con 0x5592ae75dda0 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8efbfff640 1 -- 172.21.15.19:0/277936336 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f8f080b4e50 con 0x5592ae75dda0 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 10 client.16587 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 20 client.16587 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae77db60 0x5592ae77ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 4 client.16587 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.338+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592ae6d5da0 con 0x5592ae77db60 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.339+0000 7f8f20f58640 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae77db60 0x5592ae77ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.339+0000 7f8efbfff640 10 client.16587 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.339+0000 7f8f20f58640 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae77db60 0x5592ae77ffa0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a0e2635c5d1673 server_cookie=1c63a7783381711b in_seq=0 out_seq=0 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8efbfff640 1 -- 172.21.15.19:0/277936336 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592ae6d5da0 con 0x5592ae77db60 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8efbfff640 10 client.16587 handle_command_reply: tid=0 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 client.16587 shutdown 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 msgr2=0x5592ae76ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76ae00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f08000c00 tx=0x7f8f080abbe0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 shutdown_connections 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae76b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae77db60 0x5592ae77ffa0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae76ae00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 --2- 172.21.15.19:0/277936336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae76d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8efbfff640 0 client.16587 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 >> 172.21.15.19:0/277936336 conn(0x5592ae75b2b0 msgr2=0x5592ae760e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 shutdown_connections 2024-09-11T00:11:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 1 -- 172.21.15.19:0/277936336 wait complete. 2024-09-11T00:11:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.340+0000 7f8f25591740 20 client.16587 trim_cache size 0 max 16384 2024-09-11T00:11:31.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 Processor -- start 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 -- start start 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae77a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae75c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae785870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1aee70 con 0x5592ae75dda0 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1ac6b0 con 0x5592ae76e140 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f25591740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1aa520 con 0x5592ae75d480 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae75c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae75c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40862/0 (socket says 172.21.15.19:40862) 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 -- 172.21.15.19:0/1693794018 learned_addr learned my addr 172.21.15.19:0/1693794018 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f20f58640 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae77a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 -- 172.21.15.19:0/1693794018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 msgr2=0x5592ae77a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae77a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 -- 172.21.15.19:0/1693794018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 msgr2=0x5592ae785870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae785870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f1bfff640 1 -- 172.21.15.19:0/1693794018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592ae76b6f0 con 0x5592ae75dda0 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.358+0000 7f8f20f58640 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae77a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae75c6a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8f08017600 tx=0x7f8f08017650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e724f84cbbe7984 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f067fc640 1 -- 172.21.15.19:0/1693794018 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08097040 con 0x5592ae75dda0 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f067fc640 1 -- 172.21.15.19:0/1693794018 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f080ac450 con 0x5592ae75dda0 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f067fc640 1 -- 172.21.15.19:0/1693794018 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f080a7fc0 con 0x5592ae75dda0 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 -- 172.21.15.19:0/1693794018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 msgr2=0x5592ae75c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae75c6a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8f08017600 tx=0x7f8f08017650 comp rx=0 tx=0).stop 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 -- 172.21.15.19:0/1693794018 shutdown_connections 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae785870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75dda0 0x5592ae75c6a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 --2- 172.21.15.19:0/1693794018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75d480 0x5592ae77a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 -- 172.21.15.19:0/1693794018 >> 172.21.15.19:0/1693794018 conn(0x5592ae75b2b0 msgr2=0x5592ae75bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 -- 172.21.15.19:0/1693794018 shutdown_connections 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.359+0000 7f8f25591740 1 -- 172.21.15.19:0/1693794018 wait complete. 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 -- start start 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 Processor -- start 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75d480 0x5592ae776620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75dda0 0x5592ae773080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae7735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1aab70 con 0x5592ae75d480 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1abfe0 con 0x5592ae76e140 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1ab240 con 0x5592ae75dda0 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.360+0000 7f8f25591740 10 client.0 _ll_register_callbacks cb 0x7f8f08017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75d480 0x5592ae776620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75d480 0x5592ae776620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43650/0 (socket says 172.21.15.19:43650) 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 -- 172.21.15.19:0/3083988261 learned_addr learned my addr 172.21.15.19:0/3083988261 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f21759640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae7735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75dda0 0x5592ae773080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 -- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75dda0 msgr2=0x5592ae773080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75dda0 0x5592ae773080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 -- 172.21.15.19:0/3083988261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 msgr2=0x5592ae7735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae7735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 -- 172.21.15.19:0/3083988261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592ae773b80 con 0x5592ae75d480 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75dda0 0x5592ae773080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f20f58640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75d480 0x5592ae776620 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000baa0 tx=0x7f8f1000bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e48a5714daa3e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8efbfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8efbfff640 1 -- 172.21.15.19:0/3083988261 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10032060 con 0x5592ae75d480 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8efbfff640 1 -- 172.21.15.19:0/3083988261 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f8f10005040 con 0x5592ae75d480 2024-09-11T00:11:31.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f080ac450 con 0x5592ae75d480 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8efbfff640 1 -- 172.21.15.19:0/3083988261 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8f10005260 con 0x5592ae75d480 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f25591740 10 client.16593 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.361+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5592ae7eb7f0 con 0x5592ae75d480 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8efbfff640 1 -- 172.21.15.19:0/3083988261 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f080ac450 con 0x5592ae75d480 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8efbfff640 1 -- 172.21.15.19:0/3083988261 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f8f1001a4e0 con 0x5592ae75d480 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8f25591740 10 client.16593 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8f25591740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8f25591740 20 client.16593 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8f25591740 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae7ebbf0 0x5592ae7edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8f25591740 4 client.16593 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5592ae6d1850 con 0x5592ae7ebbf0 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.362+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae7ebbf0 0x5592ae7edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:31.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f1bfff640 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae7ebbf0 0x5592ae7edfe0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea1b9b89ccccf55 server_cookie=b1f0bbf61fc7fad2 in_seq=0 out_seq=0 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8efbfff640 10 client.16593 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8efbfff640 1 -- 172.21.15.19:0/3083988261 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5592ae6d1850 con 0x5592ae7ebbf0 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8efbfff640 10 client.16593 handle_command_reply: tid=0 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 client.16593 shutdown 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75d480 msgr2=0x5592ae776620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75d480 0x5592ae776620 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000baa0 tx=0x7f8f1000bcc0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 shutdown_connections 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592ae76e140 0x5592ae7735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592ae75dda0 0x5592ae773080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5592ae7ebbf0 0x5592ae7edfe0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 --2- 172.21.15.19:0/3083988261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5592ae75d480 0x5592ae776620 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8efbfff640 0 client.16593 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 >> 172.21.15.19:0/3083988261 conn(0x5592ae75b2b0 msgr2=0x5592ae76c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 shutdown_connections 2024-09-11T00:11:31.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.363+0000 7f8f25591740 1 -- 172.21.15.19:0/3083988261 wait complete. 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f25591740 20 client.16593 trim_cache size 0 max 16384 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout: "e66baedb-0b9a-4aa0-b143-f749e4000f12": { 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:58.253354+0000", 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.375 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:11:31.378 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.379 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.380 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:11:31.381 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:11:31.382 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8f0c0b5450 msgr2=0x7f8f0c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8f0c0b5450 0x7f8f0c0b7910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009a60 tx=0x7f8f14005c30 comp rx=0 tx=0).stop 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c1087d0 msgr2=0x7f8f1c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c1087d0 0x7f8f1c199900 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b4a0 tx=0x7f8f0800b960 comp rx=0 tx=0).stop 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 shutdown_connections 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f1c109150 0x7f8f1c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f8f0c0b5450 0x7f8f0c0b7910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f1c1087d0 0x7f8f1c199900 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 --2- 172.21.15.19:0/660319872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f1c102dc0 0x7f8f1c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:31.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 >> 172.21.15.19:0/660319872 conn(0x7f8f1c0fe830 msgr2=0x7f8f1c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:31.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 shutdown_connections 2024-09-11T00:11:31.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:31.364+0000 7f8f231bc640 1 -- 172.21.15.19:0/660319872 wait complete. 2024-09-11T00:11:31.987 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:31 smithi019 ceph-mon[30859]: pgmap v601: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:11:32.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:31 smithi135 ceph-mon[35432]: pgmap v601: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:11:32.178 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:11:32.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:11:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:31 smithi131 ceph-mon[35491]: pgmap v601: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:11:32.448 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 -- 172.21.15.19:0/2472597373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0102920 msgr2=0x7f96f0102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 --2- 172.21.15.19:0/2472597373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0102920 0x7f96f0102d00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009900 tx=0x7f96e002a410 comp rx=0 tx=0).stop 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 -- 172.21.15.19:0/2472597373 shutdown_connections 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 --2- 172.21.15.19:0/2472597373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f0108120 0x7f96f010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 --2- 172.21.15.19:0/2472597373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f0107780 0x7f96f0107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 --2- 172.21.15.19:0/2472597373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0102920 0x7f96f0102d00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 -- 172.21.15.19:0/2472597373 >> 172.21.15.19:0/2472597373 conn(0x7f96f0076f50 msgr2=0x7f96f0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 -- 172.21.15.19:0/2472597373 shutdown_connections 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 -- 172.21.15.19:0/2472597373 wait complete. 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 Processor -- start 2024-09-11T00:11:33.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.102+0000 7f96f6926640 1 -- start start 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f6926640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f0102920 0x7f96f0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f6926640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0107780 0x7f96f0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f6926640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f0108120 0x7f96f019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f6926640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0111ce0 con 0x7f96f0107780 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f6926640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0111b60 con 0x7f96f0102920 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f6926640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0111e60 con 0x7f96f0108120 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0107780 0x7f96f0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0107780 0x7f96f0199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43676/0 (socket says 172.21.15.19:43676) 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 -- 172.21.15.19:0/848300060 learned_addr learned my addr 172.21.15.19:0/848300060 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96effff640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f0102920 0x7f96f0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f4ec3640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f0108120 0x7f96f019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:33.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 -- 172.21.15.19:0/848300060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f0108120 msgr2=0x7f96f019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f0108120 0x7f96f019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 -- 172.21.15.19:0/848300060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f0102920 msgr2=0x7f96f0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f0102920 0x7f96f0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 -- 172.21.15.19:0/848300060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f019f3d0 con 0x7f96f0107780 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96effff640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f0102920 0x7f96f0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f4ec3640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f0108120 0x7f96f019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ef7fe640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0107780 0x7f96f0199860 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c970 tx=0x7f96e400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ed7fa640 1 -- 172.21.15.19:0/848300060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4007bb0 con 0x7f96f0107780 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f019f6c0 con 0x7f96f0107780 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.103+0000 7f96ed7fa640 1 -- 172.21.15.19:0/848300060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e4007d50 con 0x7f96f0107780 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.104+0000 7f96ed7fa640 1 -- 172.21.15.19:0/848300060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e400f450 con 0x7f96f0107780 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.104+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f01a5e00 con 0x7f96f0107780 2024-09-11T00:11:33.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.105+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f0102d00 con 0x7f96f0107780 2024-09-11T00:11:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.106+0000 7f96ed7fa640 1 -- 172.21.15.19:0/848300060 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f96e4004f00 con 0x7f96f0107780 2024-09-11T00:11:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.107+0000 7f96ed7fa640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d80b5450 0x7f96d80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.107+0000 7f96effff640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d80b5450 0x7f96d80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.107+0000 7f96ed7fa640 1 -- 172.21.15.19:0/848300060 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f96e40e6090 con 0x7f96f0107780 2024-09-11T00:11:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.107+0000 7f96effff640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d80b5450 0x7f96d80b7910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f96e0031440 tx=0x7f96e00095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:33.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.110+0000 7f96ed7fa640 1 -- 172.21.15.19:0/848300060 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96e4014030 con 0x7f96f0107780 2024-09-11T00:11:33.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.333+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96f002e5c0 con 0x7f96f0107780 2024-09-11T00:11:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.333+0000 7f96ed7fa640 1 -- 172.21.15.19:0/848300060 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11920 (secure 0 0 0) 0x7f96e40acd00 con 0x7f96f0107780 2024-09-11T00:11:33.336 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:11:33.336 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":35,"btime":"2024-09-11T00:09:15:303339+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:09:15.054686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:11:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 35 2024-09-11T00:11:33.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d80b5450 msgr2=0x7f96d80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:33.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d80b5450 0x7f96d80b7910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f96e0031440 tx=0x7f96e00095f0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0107780 msgr2=0x7f96f0199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0107780 0x7f96f0199860 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c970 tx=0x7f96e400ce30 comp rx=0 tx=0).stop 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 shutdown_connections 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96f0108120 0x7f96f019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96d80b5450 0x7f96d80b7910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96f0107780 0x7f96f0199860 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 --2- 172.21.15.19:0/848300060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f0102920 0x7f96f0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 >> 172.21.15.19:0/848300060 conn(0x7f96f0076f50 msgr2=0x7f96f0106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 shutdown_connections 2024-09-11T00:11:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:33.336+0000 7f96f6926640 1 -- 172.21.15.19:0/848300060 wait complete. 2024-09-11T00:11:34.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:11:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:33 smithi135 ceph-mon[35432]: pgmap v602: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:11:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:33 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/848300060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:34.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:33 smithi019 ceph-mon[30859]: pgmap v602: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:11:34.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:33 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/848300060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:33 smithi131 ceph-mon[35491]: pgmap v602: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:11:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:33 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/848300060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.746+0000 7f0060c73640 1 -- 172.21.15.19:0/2441560871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c1087d0 msgr2=0x7f005c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.746+0000 7f0060c73640 1 --2- 172.21.15.19:0/2441560871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c1087d0 0x7f005c108c10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0044009900 tx=0x7f004402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.746+0000 7f0060c73640 1 -- 172.21.15.19:0/2441560871 shutdown_connections 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.746+0000 7f0060c73640 1 --2- 172.21.15.19:0/2441560871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f005c109150 0x7f005c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.746+0000 7f0060c73640 1 --2- 172.21.15.19:0/2441560871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c1087d0 0x7f005c108c10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.746+0000 7f0060c73640 1 --2- 172.21.15.19:0/2441560871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f005c102dc0 0x7f005c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.746+0000 7f0060c73640 1 -- 172.21.15.19:0/2441560871 >> 172.21.15.19:0/2441560871 conn(0x7f005c0fe830 msgr2=0x7f005c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.747+0000 7f0060c73640 1 -- 172.21.15.19:0/2441560871 shutdown_connections 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.747+0000 7f0060c73640 1 -- 172.21.15.19:0/2441560871 wait complete. 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.747+0000 7f0060c73640 1 Processor -- start 2024-09-11T00:11:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.747+0000 7f0060c73640 1 -- start start 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.747+0000 7f0060c73640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f005c102dc0 0x7f005c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0060c73640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f005c1087d0 0x7f005c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0060c73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c109150 0x7f005c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0060c73640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f005c112e10 con 0x7f005c109150 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0060c73640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f005c112c90 con 0x7f005c1087d0 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0060c73640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f005c112f90 con 0x7f005c102dc0 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c109150 0x7f005c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c109150 0x7f005c19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43686/0 (socket says 172.21.15.19:43686) 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 -- 172.21.15.19:0/2794957924 learned_addr learned my addr 172.21.15.19:0/2794957924 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0053fff640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f005c1087d0 0x7f005c199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005a59c640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f005c102dc0 0x7f005c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 -- 172.21.15.19:0/2794957924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f005c102dc0 msgr2=0x7f005c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f005c102dc0 0x7f005c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 -- 172.21.15.19:0/2794957924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f005c1087d0 msgr2=0x7f005c199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f005c1087d0 0x7f005c199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 -- 172.21.15.19:0/2794957924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c19f2f0 con 0x7f005c109150 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f005ad9d640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c109150 0x7f005c19eb20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f005400cce0 tx=0x7f005400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f00537fe640 1 -- 172.21.15.19:0/2794957924 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005400f450 con 0x7f005c109150 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c19f5e0 con 0x7f005c109150 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f00537fe640 1 -- 172.21.15.19:0/2794957924 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f005400faa0 con 0x7f005c109150 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f00537fe640 1 -- 172.21.15.19:0/2794957924 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054018b70 con 0x7f005c109150 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.748+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c1a5ca0 con 0x7f005c109150 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.751+0000 7f00537fe640 1 -- 172.21.15.19:0/2794957924 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f005400f5f0 con 0x7f005c109150 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.751+0000 7f0063048740 1 Processor -- start 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.751+0000 7f0063048740 1 -- start start 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.751+0000 7f0063048740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.751+0000 7f0063048740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd090460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0063048740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd092d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0063048740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5628bcffaea0 con 0x5628bd0909a0 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0063048740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5628bcfea2d0 con 0x5628bd0840f0 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0063048740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628bcfee0e0 con 0x5628bd084a10 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd092d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd092d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43692/0 (socket says 172.21.15.19:43692) 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0053fff640 1 -- 172.21.15.19:0/2019469089 learned_addr learned my addr 172.21.15.19:0/2019469089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005a59c640 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd090460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0053fff640 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f00537fe640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f00480b5450 0x7f00480b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005a59c640 1 -- 172.21.15.19:0/2019469089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 msgr2=0x5628bd0844d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005a59c640 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0844d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005a59c640 1 -- 172.21.15.19:0/2019469089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 msgr2=0x5628bd092d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005a59c640 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd092d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005a59c640 1 -- 172.21.15.19:0/2019469089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628bcd48650 con 0x5628bd084a10 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f0053fff640 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd092d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005ad9d640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f00480b5450 0x7f00480b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f00537fe640 1 -- 172.21.15.19:0/2794957924 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f00540e6610 con 0x7f005c109150 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.752+0000 7f005a59c640 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd090460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f004c00bbf0 tx=0x7f004c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be1ea3d5a2b4ae11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0050ff9640 1 -- 172.21.15.19:0/2019469089 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004030 con 0x5628bd084a10 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0050ff9640 1 -- 172.21.15.19:0/2019469089 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c0035f0 con 0x5628bd084a10 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0050ff9640 1 -- 172.21.15.19:0/2019469089 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c011680 con 0x5628bd084a10 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0063048740 1 -- 172.21.15.19:0/2019469089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 msgr2=0x5628bd090460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f005ad9d640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f00480b5450 0x7f00480b7910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00540ac7e0 tx=0x7f005400ff50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0063048740 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd090460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f004c00bbf0 tx=0x7f004c0107a0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0063048740 1 -- 172.21.15.19:0/2019469089 shutdown_connections 2024-09-11T00:11:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0063048740 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd092d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0063048740 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd090460 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0063048740 1 --2- 172.21.15.19:0/2019469089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0844d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.753+0000 7f0063048740 1 -- 172.21.15.19:0/2019469089 >> 172.21.15.19:0/2019469089 conn(0x5628bd081f20 msgr2=0x5628bd0830c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 -- 172.21.15.19:0/2019469089 shutdown_connections 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 -- 172.21.15.19:0/2019469089 wait complete. 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 -- start start 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 Processor -- start 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0902b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd08d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd08dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5628bce4b700 con 0x5628bd0909a0 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5628bcf85160 con 0x5628bd0840f0 2024-09-11T00:11:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628bd093620 con 0x5628bd084a10 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0063048740 10 client.0 _ll_register_callbacks cb 0x5628bcf9e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd08dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd08dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43700/0 (socket says 172.21.15.19:43700) 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0053fff640 1 -- 172.21.15.19:0/4268120279 learned_addr learned my addr 172.21.15.19:0/4268120279 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f005a59c640 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd08d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.754+0000 7f0053fff640 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0902b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0053fff640 1 -- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 msgr2=0x5628bd08d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0053fff640 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd08d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0053fff640 1 -- 172.21.15.19:0/4268120279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 msgr2=0x5628bd0902b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0053fff640 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0902b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0053fff640 1 -- 172.21.15.19:0/4268120279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628bcfb2c90 con 0x5628bd0909a0 2024-09-11T00:11:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0053fff640 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd08dd30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0044031440 tx=0x7f004402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99d728819227514 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0041ffb640 1 -- 172.21.15.19:0/4268120279 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044035040 con 0x5628bd0909a0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0041ffb640 1 -- 172.21.15.19:0/4268120279 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f00440037f0 con 0x5628bd0909a0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c0035f0 con 0x5628bd0909a0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0041ffb640 1 -- 172.21.15.19:0/4268120279 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f00440039f0 con 0x5628bd0909a0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0063048740 10 client.16611 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5628bd09efb0 con 0x5628bd0909a0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.755+0000 7f0041ffb640 1 -- 172.21.15.19:0/4268120279 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c0035f0 con 0x5628bd0909a0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0041ffb640 1 -- 172.21.15.19:0/4268120279 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f004403da50 con 0x5628bd0909a0 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0063048740 10 client.16611 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0063048740 10 client.16611 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0063048740 20 client.16611 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0063048740 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd0a0510 0x5628bd0a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0063048740 4 client.16611 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628bcffcdf0 con 0x5628bd0a0510 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f005a59c640 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd0a0510 0x5628bd0a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f005a59c640 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd0a0510 0x5628bd0a2900 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b8348887210f97cf server_cookie=39b820f868196fd6 in_seq=0 out_seq=0 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.756+0000 7f0041ffb640 10 client.16611 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0041ffb640 1 -- 172.21.15.19:0/4268120279 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628bcffcdf0 con 0x5628bd0a0510 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0041ffb640 10 client.16611 handle_command_reply: tid=0 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 client.16611 shutdown 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 msgr2=0x5628bd08dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd08dd30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0044031440 tx=0x7f004402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 shutdown_connections 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd0a0510 0x5628bd0a2900 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd08dd30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd084a10 0x5628bd08d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0041ffb640 0 client.16611 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 --2- 172.21.15.19:0/4268120279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0840f0 0x5628bd0902b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 >> 172.21.15.19:0/4268120279 conn(0x5628bd081f20 msgr2=0x5628bd087a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 shutdown_connections 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.757+0000 7f0063048740 1 -- 172.21.15.19:0/4268120279 wait complete. 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.758+0000 7f0063048740 20 client.16611 trim_cache size 0 max 16384 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 Processor -- start 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 -- start start 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd081760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd084a10 0x5628bd091d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0909a0 0x5628bd0922d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1b0e90 con 0x5628bd084a10 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1ae6d0 con 0x5628bd0909a0 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0063048740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1ac590 con 0x5628bd0840f0 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd084a10 0x5628bd091d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd084a10 0x5628bd091d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43708/0 (socket says 172.21.15.19:43708) 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 -- 172.21.15.19:0/626448594 learned_addr learned my addr 172.21.15.19:0/626448594 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0053fff640 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd081760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 -- 172.21.15.19:0/626448594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 msgr2=0x5628bd081760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd081760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f0053fff640 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0909a0 0x5628bd0922d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 -- 172.21.15.19:0/626448594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0909a0 msgr2=0x5628bd0922d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0909a0 0x5628bd0922d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 -- 172.21.15.19:0/626448594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628bd0a2c70 con 0x5628bd084a10 2024-09-11T00:11:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.771+0000 7f005a59c640 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd084a10 0x5628bd091d90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ebd3240539ccd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0043fff640 1 -- 172.21.15.19:0/626448594 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c005240 con 0x5628bd084a10 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0043fff640 1 -- 172.21.15.19:0/626448594 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c0053e0 con 0x5628bd084a10 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0043fff640 1 -- 172.21.15.19:0/626448594 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c029670 con 0x5628bd084a10 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 -- 172.21.15.19:0/626448594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd084a10 msgr2=0x5628bd091d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd084a10 0x5628bd091d90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c00b390 comp rx=0 tx=0).stop 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 -- 172.21.15.19:0/626448594 shutdown_connections 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd0909a0 0x5628bd0922d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd084a10 0x5628bd091d90 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 --2- 172.21.15.19:0/626448594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd081760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 -- 172.21.15.19:0/626448594 >> 172.21.15.19:0/626448594 conn(0x5628bd081f20 msgr2=0x5628bd08f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 -- 172.21.15.19:0/626448594 shutdown_connections 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.772+0000 7f0063048740 1 -- 172.21.15.19:0/626448594 wait complete. 2024-09-11T00:11:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 -- start start 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 Processor -- start 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd0988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd084a10 0x5628bd098e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd0938a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1acbe0 con 0x5628bd0909a0 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1ae000 con 0x5628bd084a10 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1ad260 con 0x5628bd0840f0 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0063048740 10 client.0 _ll_register_callbacks cb 0x7f0044031910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd0938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd0938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43716/0 (socket says 172.21.15.19:43716) 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 -- 172.21.15.19:0/4096427415 learned_addr learned my addr 172.21.15.19:0/4096427415 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f005a59c640 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd084a10 0x5628bd098e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd0988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 -- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 msgr2=0x5628bd0988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd0988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 -- 172.21.15.19:0/4096427415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd084a10 msgr2=0x5628bd098e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd084a10 0x5628bd098e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.773+0000 7f0053fff640 1 -- 172.21.15.19:0/4096427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628bd093de0 con 0x5628bd0909a0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0053fff640 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd0938a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0044005ec0 tx=0x7f004402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f305f1424a309024 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0041ffb640 1 -- 172.21.15.19:0/4096427415 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044035050 con 0x5628bd0909a0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0041ffb640 1 -- 172.21.15.19:0/4096427415 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f0044031a60 con 0x5628bd0909a0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c0053e0 con 0x5628bd0909a0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0041ffb640 1 -- 172.21.15.19:0/4096427415 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0044066050 con 0x5628bd0909a0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 10 client.16617 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5628bd10dc30 con 0x5628bd0909a0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0041ffb640 1 -- 172.21.15.19:0/4096427415 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c0053e0 con 0x5628bd0909a0 2024-09-11T00:11:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0041ffb640 1 -- 172.21.15.19:0/4096427415 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0044031c60 con 0x5628bd0909a0 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 10 client.16617 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 10 client.16617 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 20 client.16617 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd10e320 0x5628bd110740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 4 client.16617 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.774+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628bcff88a0 con 0x5628bd10e320 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f005a59c640 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd10e320 0x5628bd110740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f005a59c640 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd10e320 0x5628bd110740 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33b1e86ffb5f38b3 server_cookie=2394d5f2f281d90a in_seq=0 out_seq=0 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0041ffb640 10 client.16617 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0041ffb640 1 -- 172.21.15.19:0/4096427415 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628bcff88a0 con 0x5628bd10e320 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0041ffb640 10 client.16617 handle_command_reply: tid=0 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 client.16617 shutdown 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 msgr2=0x5628bd0938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd0938a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0044005ec0 tx=0x7f004402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 shutdown_connections 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x5628bd10e320 0x5628bd110740 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628bd0909a0 0x5628bd0938a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628bd084a10 0x5628bd098e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0041ffb640 0 client.16617 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 --2- 172.21.15.19:0/4096427415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628bd0840f0 0x5628bd0988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 >> 172.21.15.19:0/4096427415 conn(0x5628bd081f20 msgr2=0x5628bd087180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 shutdown_connections 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.775+0000 7f0063048740 1 -- 172.21.15.19:0/4096427415 wait complete. 2024-09-11T00:11:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0063048740 20 client.16617 trim_cache size 0 max 16384 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f00480b5450 msgr2=0x7f00480b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f00480b5450 0x7f00480b7910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00540ac7e0 tx=0x7f005400ff50 comp rx=0 tx=0).stop 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c109150 msgr2=0x7f005c19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c109150 0x7f005c19eb20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f005400cce0 tx=0x7f005400a620 comp rx=0 tx=0).stop 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 shutdown_connections 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f00480b5450 0x7f00480b7910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f005c109150 0x7f005c19eb20 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f005c1087d0 0x7f005c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 --2- 172.21.15.19:0/2794957924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f005c102dc0 0x7f005c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 >> 172.21.15.19:0/2794957924 conn(0x7f005c0fe830 msgr2=0x7f005c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 shutdown_connections 2024-09-11T00:11:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:34.776+0000 7f0060c73640 1 -- 172.21.15.19:0/2794957924 wait complete. 2024-09-11T00:11:35.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:11:35.874 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:36.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:35 smithi019 ceph-mon[30859]: pgmap v603: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:11:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:35 smithi135 ceph-mon[35432]: pgmap v603: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:11:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:35 smithi131 ceph-mon[35491]: pgmap v603: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:11:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 -- 172.21.15.19:0/2181464234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc1076e0 msgr2=0x7f77bc107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 --2- 172.21.15.19:0/2181464234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc1076e0 0x7f77bc107b20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009ca0 tx=0x7f77b002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 -- 172.21.15.19:0/2181464234 shutdown_connections 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 --2- 172.21.15.19:0/2181464234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc108060 0x7f77bc10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 --2- 172.21.15.19:0/2181464234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc1076e0 0x7f77bc107b20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 --2- 172.21.15.19:0/2181464234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc101cd0 0x7f77bc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 -- 172.21.15.19:0/2181464234 >> 172.21.15.19:0/2181464234 conn(0x7f77bc0fd700 msgr2=0x7f77bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 -- 172.21.15.19:0/2181464234 shutdown_connections 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 -- 172.21.15.19:0/2181464234 wait complete. 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 Processor -- start 2024-09-11T00:11:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.371+0000 7f77c464e640 1 -- start start 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c464e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc101cd0 0x7f77bc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c464e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc1076e0 0x7f77bc199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c464e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc108060 0x7f77bc19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c464e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc111d20 con 0x7f77bc108060 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c464e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc111ba0 con 0x7f77bc1076e0 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c464e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc111ea0 con 0x7f77bc101cd0 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc108060 0x7f77bc19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc108060 0x7f77bc19eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43734/0 (socket says 172.21.15.19:43734) 2024-09-11T00:11:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 -- 172.21.15.19:0/3887024540 learned_addr learned my addr 172.21.15.19:0/3887024540 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c1be9640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc1076e0 0x7f77bc199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c23ea640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc101cd0 0x7f77bc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 -- 172.21.15.19:0/3887024540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc101cd0 msgr2=0x7f77bc1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc101cd0 0x7f77bc1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 -- 172.21.15.19:0/3887024540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc1076e0 msgr2=0x7f77bc199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc1076e0 0x7f77bc199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 -- 172.21.15.19:0/3887024540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc19f470 con 0x7f77bc108060 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c23ea640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc101cd0 0x7f77bc1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c2beb640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc108060 0x7f77bc19eca0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f77b400d750 tx=0x7f77b400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77bb7fe640 1 -- 172.21.15.19:0/3887024540 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4017070 con 0x7f77bc108060 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77bb7fe640 1 -- 172.21.15.19:0/3887024540 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b40054d0 con 0x7f77bc108060 2024-09-11T00:11:36.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc19f760 con 0x7f77bc108060 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.372+0000 7f77bb7fe640 1 -- 172.21.15.19:0/3887024540 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4004c60 con 0x7f77bc108060 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.373+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc1a5e20 con 0x7f77bc108060 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.375+0000 7f77bb7fe640 1 -- 172.21.15.19:0/3887024540 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f77b4004e00 con 0x7f77bc108060 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.375+0000 7f77c6a23740 1 Processor -- start 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.375+0000 7f77c6a23740 1 -- start start 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3ed958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3eda1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c6a23740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558c3ed0bea0 con 0x558c3eda1d80 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c6a23740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558c3ecfb2d0 con 0x558c3ed95df0 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c6a23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558c3ecff0e0 con 0x558c3ed954d0 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43740/0 (socket says 172.21.15.19:43740) 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 -- 172.21.15.19:0/3707090198 learned_addr learned my addr 172.21.15.19:0/3707090198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3ed958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c23ea640 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3eda1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77bb7fe640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77a40b5450 0x7f77a40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c2beb640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77a40b5450 0x7f77a40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 -- 172.21.15.19:0/3707090198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 msgr2=0x558c3ed958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3ed958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 -- 172.21.15.19:0/3707090198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 msgr2=0x558c3eda1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3eda1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 -- 172.21.15.19:0/3707090198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3ea59650 con 0x558c3eda1d80 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77bb7fe640 1 -- 172.21.15.19:0/3887024540 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f77b40e59b0 con 0x7f77bc108060 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.376+0000 7f77c1be9640 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4170 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009ca0 tx=0x7f77b00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14a5b302c2ba51a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:36.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77b8ff9640 1 -- 172.21.15.19:0/3707090198 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0032e20 con 0x558c3eda1d80 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77c2beb640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77a40b5450 0x7f77a40b7910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f77b40abb80 tx=0x7f77b40a6040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77b8ff9640 1 -- 172.21.15.19:0/3707090198 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b0036070 con 0x558c3eda1d80 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77b8ff9640 1 -- 172.21.15.19:0/3707090198 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0004240 con 0x558c3eda1d80 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77c6a23740 1 -- 172.21.15.19:0/3707090198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 msgr2=0x558c3eda4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77c6a23740 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4170 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009ca0 tx=0x7f77b00093d0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77c6a23740 1 -- 172.21.15.19:0/3707090198 shutdown_connections 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.377+0000 7f77c6a23740 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4170 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3eda1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 --2- 172.21.15.19:0/3707090198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3ed958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 -- 172.21.15.19:0/3707090198 >> 172.21.15.19:0/3707090198 conn(0x558c3ed93300 msgr2=0x558c3ed944a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 -- 172.21.15.19:0/3707090198 shutdown_connections 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 -- 172.21.15.19:0/3707090198 wait complete. 2024-09-11T00:11:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 -- start start 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 Processor -- start 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3eda1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3ed9eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3eda1d80 0x558c3ed9f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558c3eb5c700 con 0x558c3ed954d0 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558c3ec96160 con 0x558c3ed95df0 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558c3eda4820 con 0x558c3eda1d80 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c6a23740 10 client.0 _ll_register_callbacks cb 0x558c3ecaf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3eda1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3eda1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43746/0 (socket says 172.21.15.19:43746) 2024-09-11T00:11:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.378+0000 7f77c1be9640 1 -- 172.21.15.19:0/2478584784 learned_addr learned my addr 172.21.15.19:0/2478584784 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.379+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3ed9eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.379+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3eda1d80 0x558c3ed9f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.379+0000 7f77c1be9640 1 -- 172.21.15.19:0/2478584784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3eda1d80 msgr2=0x558c3ed9f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.379+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3eda1d80 0x558c3ed9f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.379+0000 7f77c1be9640 1 -- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 msgr2=0x558c3ed9eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.379+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3ed9eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.379+0000 7f77c1be9640 1 -- 172.21.15.19:0/2478584784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3ecc3c90 con 0x558c3ed954d0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3eda1690 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f77b0003ea0 tx=0x7f77b0003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2582548c892384b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2478584784 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0031650 con 0x558c3ed954d0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2478584784 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f77b00317f0 con 0x558c3ed954d0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b0036070 con 0x558c3ed954d0 2024-09-11T00:11:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2478584784 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f77b002f660 con 0x558c3ed954d0 2024-09-11T00:11:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77c6a23740 10 client.16629 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558c3edb01b0 con 0x558c3ed954d0 2024-09-11T00:11:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2478584784 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b0036070 con 0x558c3ed954d0 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.380+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2478584784 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f77b0004320 con 0x558c3ed954d0 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c6a23740 10 client.16629 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c6a23740 10 client.16629 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c6a23740 20 client.16629 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3edb1500 0x558c3edb38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c6a23740 4 client.16629 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c3ed0ddf0 con 0x558c3edb1500 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3edb1500 0x558c3edb38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3edb1500 0x558c3edb38f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7c7b026aee05e83 server_cookie=2788e33779d7c065 in_seq=0 out_seq=0 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.381+0000 7f77a1ffb640 10 client.16629 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2478584784 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c3ed0ddf0 con 0x558c3edb1500 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77a1ffb640 10 client.16629 handle_command_reply: tid=0 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 client.16629 shutdown 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 msgr2=0x558c3eda1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3eda1690 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f77b0003ea0 tx=0x7f77b0003da0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 shutdown_connections 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3edb1500 0x558c3edb38f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3eda1d80 0x558c3ed9f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77a1ffb640 0 client.16629 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:11:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3ed9eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2478584784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3eda1690 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.382+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 >> 172.21.15.19:0/2478584784 conn(0x558c3ed93300 msgr2=0x558c3ed98e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.383+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 shutdown_connections 2024-09-11T00:11:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.383+0000 7f77c6a23740 1 -- 172.21.15.19:0/2478584784 wait complete. 2024-09-11T00:11:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.383+0000 7f77c6a23740 20 client.16629 trim_cache size 0 max 16384 2024-09-11T00:11:36.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 Processor -- start 2024-09-11T00:11:36.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 -- start start 2024-09-11T00:11:36.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3edada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed95df0 0x558c3ed92c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3eda1d80 0x558c3eda0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc1b0ea0 con 0x558c3ed954d0 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc1ae6e0 con 0x558c3eda1d80 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c6a23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc1ac550 con 0x558c3ed95df0 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3edada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3edada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43754/0 (socket says 172.21.15.19:43754) 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.396+0000 7f77c1be9640 1 -- 172.21.15.19:0/2126799720 learned_addr learned my addr 172.21.15.19:0/2126799720 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed95df0 0x558c3ed92c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3eda1d80 0x558c3eda0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c1be9640 1 -- 172.21.15.19:0/2126799720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed95df0 msgr2=0x558c3ed92c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed95df0 0x558c3ed92c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c1be9640 1 -- 172.21.15.19:0/2126799720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3eda1d80 msgr2=0x558c3eda0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3eda1d80 0x558c3eda0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c1be9640 1 -- 172.21.15.19:0/2126799720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3ed9e890 con 0x558c3ed954d0 2024-09-11T00:11:36.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3edada80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f77b00049d0 tx=0x7f77b002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ffd401c371c0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77a3fff640 1 -- 172.21.15.19:0/2126799720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0031450 con 0x558c3ed954d0 2024-09-11T00:11:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77a3fff640 1 -- 172.21.15.19:0/2126799720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b0036070 con 0x558c3ed954d0 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.397+0000 7f77a3fff640 1 -- 172.21.15.19:0/2126799720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b002f800 con 0x558c3ed954d0 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- 172.21.15.19:0/2126799720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 msgr2=0x558c3edada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3edada80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f77b00049d0 tx=0x7f77b002bfd0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- 172.21.15.19:0/2126799720 shutdown_connections 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3eda1d80 0x558c3eda0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed95df0 0x558c3ed92c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2126799720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3ed954d0 0x558c3edada80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- 172.21.15.19:0/2126799720 >> 172.21.15.19:0/2126799720 conn(0x558c3ed93300 msgr2=0x558c3eda0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- 172.21.15.19:0/2126799720 shutdown_connections 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- 172.21.15.19:0/2126799720 wait complete. 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- start start 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 Processor -- start 2024-09-11T00:11:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3eda9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3edaa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc1acba0 con 0x558c3eda1d80 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc1ae010 con 0x558c3ed95df0 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.398+0000 7f77c6a23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc1ad270 con 0x558c3ed954d0 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c6a23740 10 client.0 _ll_register_callbacks cb 0x7f77ac009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43758/0 (socket says 172.21.15.19:43758) 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 -- 172.21.15.19:0/2450868370 learned_addr learned my addr 172.21.15.19:0/2450868370 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3edaa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3eda9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 -- 172.21.15.19:0/2450868370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 msgr2=0x558c3eda9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3eda9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 -- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 msgr2=0x558c3edaa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3edaa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 -- 172.21.15.19:0/2450868370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3eda5030 con 0x558c3eda1d80 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3edaa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c1be9640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4aa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f77b0030630 tx=0x7f77b002f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20097ea01ec0f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2450868370 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0063040 con 0x558c3eda1d80 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2450868370 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f77b002fdf0 con 0x558c3eda1d80 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.399+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b0036070 con 0x558c3eda1d80 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2450868370 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f77b00306b0 con 0x558c3eda1d80 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 10 client.16635 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558c3ee1e9c0 con 0x558c3eda1d80 2024-09-11T00:11:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2450868370 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b0036070 con 0x558c3eda1d80 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2450868370 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f77b0069040 con 0x558c3eda1d80 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 10 client.16635 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 10 client.16635 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 20 client.16635 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3ee1ef20 0x558c3ee21340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 4 client.16635 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c3ed098a0 con 0x558c3ee1ef20 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.400+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3ee1ef20 0x558c3ee21340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c23ea640 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3ee1ef20 0x558c3ee21340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c42d569b686fb385 server_cookie=c2d159f5f18ff9c9 in_seq=0 out_seq=0 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77a1ffb640 10 client.16635 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77a1ffb640 1 -- 172.21.15.19:0/2450868370 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c3ed098a0 con 0x558c3ee1ef20 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77a1ffb640 10 client.16635 handle_command_reply: tid=0 2024-09-11T00:11:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 client.16635 shutdown 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 msgr2=0x558c3eda4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4aa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f77b0030630 tx=0x7f77b002f510 comp rx=0 tx=0).stop 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 shutdown_connections 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x558c3ee1ef20 0x558c3ee21340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c3eda1d80 0x558c3eda4aa0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c3ed95df0 0x558c3edaa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77a1ffb640 0 client.16635 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 --2- 172.21.15.19:0/2450868370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c3ed954d0 0x558c3eda9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 >> 172.21.15.19:0/2450868370 conn(0x558c3ed93300 msgr2=0x558c3eda0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 shutdown_connections 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.401+0000 7f77c6a23740 1 -- 172.21.15.19:0/2450868370 wait complete. 2024-09-11T00:11:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c6a23740 20 client.16635 trim_cache size 0 max 16384 2024-09-11T00:11:36.410 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:11:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77a40b5450 msgr2=0x7f77a40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77a40b5450 0x7f77a40b7910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f77b40abb80 tx=0x7f77b40a6040 comp rx=0 tx=0).stop 2024-09-11T00:11:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc108060 msgr2=0x7f77bc19eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc108060 0x7f77bc19eca0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f77b400d750 tx=0x7f77b400dc10 comp rx=0 tx=0).stop 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 shutdown_connections 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f77a40b5450 0x7f77a40b7910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77bc108060 0x7f77bc19eca0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc1076e0 0x7f77bc199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 --2- 172.21.15.19:0/3887024540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc101cd0 0x7f77bc1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 >> 172.21.15.19:0/3887024540 conn(0x7f77bc0fd700 msgr2=0x7f77bc06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 shutdown_connections 2024-09-11T00:11:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:36.402+0000 7f77c464e640 1 -- 172.21.15.19:0/3887024540 wait complete. 2024-09-11T00:11:37.198 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:11:37.464 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 -- 172.21.15.19:0/843164254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f68103ca0 msgr2=0x7f0f68104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/843164254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f68103ca0 0x7f0f68104080 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009900 tx=0x7f0f5802a410 comp rx=0 tx=0).stop 2024-09-11T00:11:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 -- 172.21.15.19:0/843164254 shutdown_connections 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/843164254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f6810d100 0x7f0f6810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/843164254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f681045c0 0x7f0f6810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/843164254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f68103ca0 0x7f0f68104080 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 -- 172.21.15.19:0/843164254 >> 172.21.15.19:0/843164254 conn(0x7f0f680fd700 msgr2=0x7f0f680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 -- 172.21.15.19:0/843164254 shutdown_connections 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.981+0000 7f0f6ca77640 1 -- 172.21.15.19:0/843164254 wait complete. 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 Processor -- start 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 -- start start 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68103ca0 0x7f0f68199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f681045c0 0x7f0f68199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f6810d100 0x7f0f6819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112d70 con 0x7f0f6810d100 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112bf0 con 0x7f0f68103ca0 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6ca77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112ef0 con 0x7f0f681045c0 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f6810d100 0x7f0f6819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f6810d100 0x7f0f6819eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43766/0 (socket says 172.21.15.19:43766) 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 -- 172.21.15.19:0/110379623 learned_addr learned my addr 172.21.15.19:0/110379623 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f681045c0 0x7f0f68199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f6659c640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68103ca0 0x7f0f68199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 -- 172.21.15.19:0/110379623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f681045c0 msgr2=0x7f0f68199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f681045c0 0x7f0f68199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 -- 172.21.15.19:0/110379623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68103ca0 msgr2=0x7f0f68199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68103ca0 0x7f0f68199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 -- 172.21.15.19:0/110379623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6819f2b0 con 0x7f0f6810d100 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.982+0000 7f0f66d9d640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f6810d100 0x7f0f6819eae0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000cce0 tx=0x7f0f6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.983+0000 7f0f577fe640 1 -- 172.21.15.19:0/110379623 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000f450 con 0x7f0f6810d100 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.983+0000 7f0f577fe640 1 -- 172.21.15.19:0/110379623 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f6000faa0 con 0x7f0f6810d100 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.983+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6819f5a0 con 0x7f0f6810d100 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.983+0000 7f0f577fe640 1 -- 172.21.15.19:0/110379623 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60018b70 con 0x7f0f6810d100 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.983+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f681a5c60 con 0x7f0f6810d100 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.985+0000 7f0f577fe640 1 -- 172.21.15.19:0/110379623 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f0f6000f5f0 con 0x7f0f6810d100 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.985+0000 7f0f6ee4c740 1 Processor -- start 2024-09-11T00:11:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6ee4c740 1 -- start start 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4d74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4e7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4e7db0 0x55af9d4ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55af9d44dea0 con 0x55af9d4d70f0 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55af9d43d2d0 con 0x55af9d4e7db0 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55af9d4410e0 con 0x55af9d4d7a10 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4d74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4d74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43768/0 (socket says 172.21.15.19:43768) 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 -- 172.21.15.19:0/2884168879 learned_addr learned my addr 172.21.15.19:0/2884168879 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f6659c640 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4e7db0 0x55af9d4ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 -- 172.21.15.19:0/2884168879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 msgr2=0x55af9d4e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4e7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f577fe640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f500b5450 0x7f0f500b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 -- 172.21.15.19:0/2884168879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4e7db0 msgr2=0x55af9d4ea1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4e7db0 0x55af9d4ea1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.986+0000 7f0f65d9b640 1 -- 172.21.15.19:0/2884168879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af9d19b650 con 0x55af9d4d70f0 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.987+0000 7f0f66d9d640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f500b5450 0x7f0f500b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.987+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4d74d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c013580 tx=0x7f0f5c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e403994bc07fae58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.987+0000 7f0f577fe640 1 -- 172.21.15.19:0/110379623 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f0f600e6780 con 0x7f0f6810d100 2024-09-11T00:11:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.987+0000 7f0f54ff9640 1 -- 172.21.15.19:0/2884168879 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c019030 con 0x55af9d4d70f0 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.987+0000 7f0f54ff9640 1 -- 172.21.15.19:0/2884168879 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f5c0118f0 con 0x55af9d4d70f0 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.987+0000 7f0f54ff9640 1 -- 172.21.15.19:0/2884168879 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c01d740 con 0x55af9d4d70f0 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/2884168879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 msgr2=0x55af9d4d74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4d74d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c013580 tx=0x7f0f5c00b660 comp rx=0 tx=0).stop 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f66d9d640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f500b5450 0x7f0f500b7910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0f6005b860 tx=0x7f0f6000ff50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/2884168879 shutdown_connections 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4e7db0 0x55af9d4ea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/2884168879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4d74d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/2884168879 >> 172.21.15.19:0/2884168879 conn(0x55af9d4d4f20 msgr2=0x55af9d4d60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/2884168879 shutdown_connections 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/2884168879 wait complete. 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 -- start start 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 Processor -- start 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.988+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 0x55af9d4e51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55af9d29e700 con 0x55af9d4d70f0 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55af9d3d8160 con 0x55af9d4d7a10 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55af9d4eaa60 con 0x55af9d4e7db0 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f6ee4c740 10 client.0 _ll_register_callbacks cb 0x55af9d3f19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4e76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43770/0 (socket says 172.21.15.19:43770) 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 -- 172.21.15.19:0/3609935832 learned_addr learned my addr 172.21.15.19:0/3609935832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f6659c640 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 0x55af9d4e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 -- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 msgr2=0x55af9d4e51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 0x55af9d4e51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 -- 172.21.15.19:0/3609935832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 msgr2=0x55af9d4e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4e4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 -- 172.21.15.19:0/3609935832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af9d405c90 con 0x55af9d4d70f0 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4e76e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00b990 tx=0x7f0f5c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d931c0b0bdffb571 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f4dffb640 1 -- 172.21.15.19:0/3609935832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c019040 con 0x55af9d4d70f0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f4dffb640 1 -- 172.21.15.19:0/3609935832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f0f5c011d20 con 0x55af9d4d70f0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.989+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f5c0118f0 con 0x55af9d4d70f0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f4dffb640 1 -- 172.21.15.19:0/3609935832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0f5c032050 con 0x55af9d4d70f0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 10 client.16647 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55af9d4f6400 con 0x55af9d4d70f0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f4dffb640 1 -- 172.21.15.19:0/3609935832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f5c0118f0 con 0x55af9d4d70f0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f4dffb640 1 -- 172.21.15.19:0/3609935832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0f5c02b060 con 0x55af9d4d70f0 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 10 client.16647 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 20 client.16647 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d4f7800 0x55af9d4f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 4 client.16647 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af9d44fdf0 con 0x55af9d4f7800 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.990+0000 7f0f6659c640 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d4f7800 0x55af9d4f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.991+0000 7f0f6659c640 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d4f7800 0x55af9d4f9bf0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e69357840c68f97 server_cookie=f9853254c945dda7 in_seq=0 out_seq=0 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.991+0000 7f0f4dffb640 10 client.16647 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f4dffb640 1 -- 172.21.15.19:0/3609935832 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af9d44fdf0 con 0x55af9d4f7800 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f4dffb640 10 client.16647 handle_command_reply: tid=0 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 client.16647 shutdown 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 msgr2=0x55af9d4e76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4e76e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00b990 tx=0x7f0f5c00b8a0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 shutdown_connections 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 0x55af9d4e51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d4f7800 0x55af9d4f9bf0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/3609935832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4e76e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f4dffb640 0 client.16647 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 >> 172.21.15.19:0/3609935832 conn(0x55af9d4d4f20 msgr2=0x55af9d4daa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 shutdown_connections 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/3609935832 wait complete. 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:37.992+0000 7f0f6ee4c740 20 client.16647 trim_cache size 0 max 16384 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.005+0000 7f0f6ee4c740 1 Processor -- start 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.005+0000 7f0f6ee4c740 1 -- start start 2024-09-11T00:11:38.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 0x55af9d4ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681aec80 con 0x55af9d4d70f0 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681ac4c0 con 0x55af9d4d7a10 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681aa330 con 0x55af9d4e7db0 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43776/0 (socket says 172.21.15.19:43776) 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 -- 172.21.15.19:0/756064968 learned_addr learned my addr 172.21.15.19:0/756064968 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f6659c640 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 -- 172.21.15.19:0/756064968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 msgr2=0x55af9d4ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 0x55af9d4ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 -- 172.21.15.19:0/756064968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 msgr2=0x55af9d4d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 -- 172.21.15.19:0/756064968 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af9d4fa180 con 0x55af9d4d70f0 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.006+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4f3cc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00c010 tx=0x7f0f5c01d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cc0de8361a6a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f4ffff640 1 -- 172.21.15.19:0/756064968 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c03b070 con 0x55af9d4d70f0 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f4ffff640 1 -- 172.21.15.19:0/756064968 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f5c004680 con 0x55af9d4d70f0 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f4ffff640 1 -- 172.21.15.19:0/756064968 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c019070 con 0x55af9d4d70f0 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/756064968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 msgr2=0x55af9d4f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4f3cc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00c010 tx=0x7f0f5c01d440 comp rx=0 tx=0).stop 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/756064968 shutdown_connections 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4e7db0 0x55af9d4ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d7a10 0x55af9d4d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/756064968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4d70f0 0x55af9d4f3cc0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.007+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/756064968 >> 172.21.15.19:0/756064968 conn(0x55af9d4d4f20 msgr2=0x55af9d4e9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/756064968 shutdown_connections 2024-09-11T00:11:38.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/756064968 wait complete. 2024-09-11T00:11:38.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 -- start start 2024-09-11T00:11:38.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 Processor -- start 2024-09-11T00:11:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d70f0 0x55af9d4ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4efd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4e7db0 0x55af9d4f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681aa980 con 0x55af9d4e7db0 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681abdf0 con 0x55af9d4d70f0 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681ab050 con 0x55af9d4d7a10 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6ee4c740 10 client.0 _ll_register_callbacks cb 0x7f0f58009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4e7db0 0x55af9d4f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f65d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4e7db0 0x55af9d4f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43792/0 (socket says 172.21.15.19:43792) 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f65d9b640 1 -- 172.21.15.19:0/1377919877 learned_addr learned my addr 172.21.15.19:0/1377919877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f6659c640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.008+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d70f0 0x55af9d4ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6659c640 1 -- 172.21.15.19:0/1377919877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d70f0 msgr2=0x55af9d4ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6659c640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d70f0 0x55af9d4ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6659c640 1 -- 172.21.15.19:0/1377919877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4e7db0 msgr2=0x55af9d4f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6659c640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4e7db0 0x55af9d4f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6659c640 1 -- 172.21.15.19:0/1377919877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af9d4df3c0 con 0x55af9d4d7a10 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4e7db0 0x55af9d4f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6659c640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4efd20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f58005940 tx=0x7f0f58004130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=196a0fb89eb49233 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f4dffb640 1 -- 172.21.15.19:0/1377919877 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58048070 con 0x55af9d4d7a10 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f5c004680 con 0x55af9d4d7a10 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f4dffb640 1 -- 172.21.15.19:0/1377919877 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f0f58005240 con 0x55af9d4d7a10 2024-09-11T00:11:38.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f4dffb640 1 -- 172.21.15.19:0/1377919877 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0f58054050 con 0x55af9d4d7a10 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6ee4c740 10 client.26188 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.009+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55af9d560860 con 0x55af9d4d7a10 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f4dffb640 1 -- 172.21.15.19:0/1377919877 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f5c004680 con 0x55af9d4d7a10 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f4dffb640 1 -- 172.21.15.19:0/1377919877 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0f580035f0 con 0x55af9d4d7a10 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f6ee4c740 10 client.26188 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f6ee4c740 10 client.26188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f6ee4c740 20 client.26188 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d560fc0 0x55af9d5633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f6ee4c740 4 client.26188 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af9d44b8a0 con 0x55af9d560fc0 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.010+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d560fc0 0x55af9d5633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f4dffb640 10 client.26188 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f65d9b640 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d560fc0 0x55af9d5633e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c15eb5c95c86769 server_cookie=d0d2435a75422e59 in_seq=0 out_seq=0 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f4dffb640 1 -- 172.21.15.19:0/1377919877 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af9d44b8a0 con 0x55af9d560fc0 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f4dffb640 10 client.26188 handle_command_reply: tid=0 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 client.26188 shutdown 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 msgr2=0x55af9d4efd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4efd20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f58005940 tx=0x7f0f58004130 comp rx=0 tx=0).stop 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 shutdown_connections 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55af9d560fc0 0x55af9d5633e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55af9d4e7db0 0x55af9d4f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55af9d4d7a10 0x55af9d4efd20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 --2- 172.21.15.19:0/1377919877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af9d4d70f0 0x55af9d4ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f4dffb640 0 client.26188 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 >> 172.21.15.19:0/1377919877 conn(0x55af9d4d4f20 msgr2=0x55af9d4e6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 shutdown_connections 2024-09-11T00:11:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 1 -- 172.21.15.19:0/1377919877 wait complete. 2024-09-11T00:11:38.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.011+0000 7f0f6ee4c740 20 client.26188 trim_cache size 0 max 16384 2024-09-11T00:11:38.032 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:11:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f500b5450 msgr2=0x7f0f500b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f500b5450 0x7f0f500b7910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0f6005b860 tx=0x7f0f6000ff50 comp rx=0 tx=0).stop 2024-09-11T00:11:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f6810d100 msgr2=0x7f0f6819eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f6810d100 0x7f0f6819eae0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000cce0 tx=0x7f0f6000a620 comp rx=0 tx=0).stop 2024-09-11T00:11:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 shutdown_connections 2024-09-11T00:11:38.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f0f500b5450 0x7f0f500b7910 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f6810d100 0x7f0f6819eae0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f681045c0 0x7f0f68199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 --2- 172.21.15.19:0/110379623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68103ca0 0x7f0f68199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 >> 172.21.15.19:0/110379623 conn(0x7f0f680fd700 msgr2=0x7f0f6810f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 shutdown_connections 2024-09-11T00:11:38.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:38.012+0000 7f0f6ca77640 1 -- 172.21.15.19:0/110379623 wait complete. 2024-09-11T00:11:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:37 smithi135 ceph-mon[35432]: pgmap v604: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:11:38.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:37 smithi019 ceph-mon[30859]: pgmap v604: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:11:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:37 smithi131 ceph-mon[35491]: pgmap v604: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:11:39.789 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:11:39.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:11:40.060 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:39 smithi135 ceph-mon[35432]: pgmap v605: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:11:40.181 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:39 smithi019 ceph-mon[30859]: pgmap v605: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:11:40.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:39 smithi131 ceph-mon[35491]: pgmap v605: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 -- 172.21.15.19:0/2801786829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec109150 msgr2=0x7f23ec10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 --2- 172.21.15.19:0/2801786829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec109150 0x7f23ec10f950 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009ca0 tx=0x7f23e402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 -- 172.21.15.19:0/2801786829 shutdown_connections 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 --2- 172.21.15.19:0/2801786829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec109150 0x7f23ec10f950 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 --2- 172.21.15.19:0/2801786829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec1087d0 0x7f23ec108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 --2- 172.21.15.19:0/2801786829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec102dc0 0x7f23ec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 -- 172.21.15.19:0/2801786829 >> 172.21.15.19:0/2801786829 conn(0x7f23ec0fe830 msgr2=0x7f23ec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 -- 172.21.15.19:0/2801786829 shutdown_connections 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 -- 172.21.15.19:0/2801786829 wait complete. 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.642+0000 7f23f30e8640 1 Processor -- start 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f30e8640 1 -- start start 2024-09-11T00:11:40.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f30e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec102dc0 0x7f23ec19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f30e8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec1087d0 0x7f23ec19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f30e8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec109150 0x7f23ec1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f30e8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec115000 con 0x7f23ec109150 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f30e8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec114e80 con 0x7f23ec1087d0 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f30e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec115180 con 0x7f23ec102dc0 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec109150 0x7f23ec1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec109150 0x7f23ec1a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43808/0 (socket says 172.21.15.19:43808) 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 -- 172.21.15.19:0/819328365 learned_addr learned my addr 172.21.15.19:0/819328365 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f0e84640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec102dc0 0x7f23ec19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23ebfff640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec1087d0 0x7f23ec19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 -- 172.21.15.19:0/819328365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec102dc0 msgr2=0x7f23ec19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec102dc0 0x7f23ec19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 -- 172.21.15.19:0/819328365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec1087d0 msgr2=0x7f23ec19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec1087d0 0x7f23ec19b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.643+0000 7f23f1685640 1 -- 172.21.15.19:0/819328365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec1a1540 con 0x7f23ec109150 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.644+0000 7f23f1685640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec109150 0x7f23ec1a0d70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f23e4005cc0 tx=0x7f23e402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.644+0000 7f23e9ffb640 1 -- 172.21.15.19:0/819328365 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4003bf0 con 0x7f23ec109150 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.644+0000 7f23e9ffb640 1 -- 172.21.15.19:0/819328365 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e4003d90 con 0x7f23ec109150 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.644+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ec1a17d0 con 0x7f23ec109150 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.644+0000 7f23e9ffb640 1 -- 172.21.15.19:0/819328365 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e402fb20 con 0x7f23ec109150 2024-09-11T00:11:40.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.644+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ec1a7ef0 con 0x7f23ec109150 2024-09-11T00:11:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.646+0000 7f23e9ffb640 1 -- 172.21.15.19:0/819328365 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f23e4004580 con 0x7f23ec109150 2024-09-11T00:11:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 Processor -- start 2024-09-11T00:11:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 -- start start 2024-09-11T00:11:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a3ee0 0x55e3073a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a4800 0x55e3073b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e30731ae60 con 0x55e3073a3ee0 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e30730a290 con 0x55e3073a4800 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f54bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e30730e0a0 con 0x55e3073b0790 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23e9ffb640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f23dc0b5450 0x7f23dc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a3ee0 0x55e3073a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a3ee0 0x55e3073a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43824/0 (socket says 172.21.15.19:43824) 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23ebfff640 1 -- 172.21.15.19:0/2441102596 learned_addr learned my addr 172.21.15.19:0/2441102596 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.647+0000 7f23f0e84640 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a4800 0x55e3073b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23e9ffb640 1 -- 172.21.15.19:0/819328365 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f23e41072a0 con 0x7f23ec109150 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23f1685640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f23dc0b5450 0x7f23dc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23ebfff640 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23ebfff640 1 -- 172.21.15.19:0/2441102596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 msgr2=0x55e3073b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23ebfff640 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23ebfff640 1 -- 172.21.15.19:0/2441102596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a4800 msgr2=0x55e3073b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23ebfff640 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a4800 0x55e3073b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23ebfff640 1 -- 172.21.15.19:0/2441102596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e307068930 con 0x55e3073a3ee0 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23f0e84640 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a4800 0x55e3073b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23ebfff640 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a3ee0 0x55e3073a42c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009f90 tx=0x7f23d80095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fc2c8bd1b3ee67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23f1685640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f23dc0b5450 0x7f23dc0b7910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23e4006010 tx=0x7f23e4097900 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23d6ffd640 1 -- 172.21.15.19:0/2441102596 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8017610 con 0x55e3073a3ee0 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23d6ffd640 1 -- 172.21.15.19:0/2441102596 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d801c070 con 0x55e3073a3ee0 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.648+0000 7f23d6ffd640 1 -- 172.21.15.19:0/2441102596 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8015810 con 0x55e3073a3ee0 2024-09-11T00:11:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 -- 172.21.15.19:0/2441102596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a3ee0 msgr2=0x55e3073a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a3ee0 0x55e3073a42c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009f90 tx=0x7f23d80095d0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 -- 172.21.15.19:0/2441102596 shutdown_connections 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a4800 0x55e3073b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 --2- 172.21.15.19:0/2441102596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a3ee0 0x55e3073a42c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 -- 172.21.15.19:0/2441102596 >> 172.21.15.19:0/2441102596 conn(0x55e3073a1d10 msgr2=0x55e3073a2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 -- 172.21.15.19:0/2441102596 shutdown_connections 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 -- 172.21.15.19:0/2441102596 wait complete. 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.649+0000 7f23f54bd740 1 -- start start 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 1 Processor -- start 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 0x55e3073ad740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e30716b890 con 0x55e3073a4800 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e3072a4d40 con 0x55e3073a3ee0 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e3073b33e0 con 0x55e3073b0790 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f54bd740 10 client.0 _ll_register_callbacks cb 0x55e307308c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43832/0 (socket says 172.21.15.19:43832) 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 -- 172.21.15.19:0/585135130 learned_addr learned my addr 172.21.15.19:0/585135130 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 -- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 msgr2=0x55e3073ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23ebfff640 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 -- 172.21.15.19:0/585135130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 msgr2=0x55e3073ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 0x55e3073ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23f0e84640 1 -- 172.21.15.19:0/585135130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3073bc7f0 con 0x55e3073a4800 2024-09-11T00:11:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.650+0000 7f23ebfff640 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f0e84640 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073adc80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f23e000baa0 tx=0x7f23e000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186964fafd23fc3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23cbfff640 1 -- 172.21.15.19:0/585135130 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0011440 con 0x55e3073a4800 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d801c070 con 0x55e3073a4800 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23cbfff640 1 -- 172.21.15.19:0/585135130 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f23e00115e0 con 0x55e3073a4800 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23cbfff640 1 -- 172.21.15.19:0/585135130 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f23e00117e0 con 0x55e3073a4800 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f54bd740 10 client.16665 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e3073bf230 con 0x55e3073a4800 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23cbfff640 1 -- 172.21.15.19:0/585135130 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d801c070 con 0x55e3073a4800 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23cbfff640 1 -- 172.21.15.19:0/585135130 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f23e001b990 con 0x55e3073a4800 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f54bd740 10 client.16665 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f54bd740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f54bd740 20 client.16665 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.651+0000 7f23f54bd740 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e3073c06e0 0x55e3073c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.652+0000 7f23f54bd740 4 client.16665 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.652+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e30731cdb0 con 0x55e3073c06e0 2024-09-11T00:11:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.652+0000 7f23ebfff640 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e3073c06e0 0x55e3073c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.652+0000 7f23cbfff640 10 client.16665 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.652+0000 7f23ebfff640 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e3073c06e0 0x55e3073c2b70 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba87851b444c58f9 server_cookie=9e8d1f100bb2da73 in_seq=0 out_seq=0 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23cbfff640 1 -- 172.21.15.19:0/585135130 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e30731cdb0 con 0x55e3073c06e0 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23cbfff640 10 client.16665 handle_command_reply: tid=0 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 client.16665 shutdown 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 msgr2=0x55e3073adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073adc80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f23e000baa0 tx=0x7f23e000bf60 comp rx=0 tx=0).stop 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 shutdown_connections 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073b0790 0x55e3073ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e3073c06e0 0x55e3073c2b70 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073adc80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 --2- 172.21.15.19:0/585135130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 0x55e3073ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 >> 172.21.15.19:0/585135130 conn(0x55e3073a1d10 msgr2=0x55e3073a0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23cbfff640 0 client.16665 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 shutdown_connections 2024-09-11T00:11:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.653+0000 7f23f54bd740 1 -- 172.21.15.19:0/585135130 wait complete. 2024-09-11T00:11:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.654+0000 7f23f54bd740 20 client.16665 trim_cache size 0 max 16384 2024-09-11T00:11:40.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 Processor -- start 2024-09-11T00:11:40.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 -- start start 2024-09-11T00:11:40.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a3ee0 0x55e3073af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073b0790 0x55e3073aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b3190 con 0x55e3073a4800 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b09d0 con 0x55e3073b0790 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f54bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1ae840 con 0x55e3073a3ee0 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f0e84640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f0e84640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43840/0 (socket says 172.21.15.19:43840) 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23f0e84640 1 -- 172.21.15.19:0/3502190970 learned_addr learned my addr 172.21.15.19:0/3502190970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.671+0000 7f23ebfff640 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a3ee0 0x55e3073af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23ebfff640 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073b0790 0x55e3073aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23f0e84640 1 -- 172.21.15.19:0/3502190970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a3ee0 msgr2=0x55e3073af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23f0e84640 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a3ee0 0x55e3073af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23f0e84640 1 -- 172.21.15.19:0/3502190970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073b0790 msgr2=0x55e3073aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23f0e84640 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073b0790 0x55e3073aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23f0e84640 1 -- 172.21.15.19:0/3502190970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3073b2f70 con 0x55e3073a4800 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23f0e84640 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073aa970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f23e001bdd0 tx=0x7f23e000b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7926c35fdb6b9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23d67fc640 1 -- 172.21.15.19:0/3502190970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0031070 con 0x55e3073a4800 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23d67fc640 1 -- 172.21.15.19:0/3502190970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e0011440 con 0x55e3073a4800 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.672+0000 7f23d67fc640 1 -- 172.21.15.19:0/3502190970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0028040 con 0x55e3073a4800 2024-09-11T00:11:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 -- 172.21.15.19:0/3502190970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 msgr2=0x55e3073aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073aa970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f23e001bdd0 tx=0x7f23e000b530 comp rx=0 tx=0).stop 2024-09-11T00:11:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 -- 172.21.15.19:0/3502190970 shutdown_connections 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073b0790 0x55e3073aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073a4800 0x55e3073aa970 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 --2- 172.21.15.19:0/3502190970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a3ee0 0x55e3073af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 -- 172.21.15.19:0/3502190970 >> 172.21.15.19:0/3502190970 conn(0x55e3073a1d10 msgr2=0x55e3073aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 -- 172.21.15.19:0/3502190970 shutdown_connections 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 -- 172.21.15.19:0/3502190970 wait complete. 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 -- start start 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.673+0000 7f23f54bd740 1 Processor -- start 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 0x55e3073b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a4800 0x55e3073b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073b0790 0x55e3073b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1aee90 con 0x55e3073b0790 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b0300 con 0x55e3073a3ee0 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1af560 con 0x55e3073a4800 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 10 client.0 _ll_register_callbacks cb 0x7f23e00040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073b0790 0x55e3073b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073b0790 0x55e3073b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43842/0 (socket says 172.21.15.19:43842) 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 -- 172.21.15.19:0/4265221848 learned_addr learned my addr 172.21.15.19:0/4265221848 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f0e84640 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a4800 0x55e3073b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 0x55e3073b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 -- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a4800 msgr2=0x55e3073b8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a4800 0x55e3073b8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 -- 172.21.15.19:0/4265221848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 msgr2=0x55e3073b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 0x55e3073b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 -- 172.21.15.19:0/4265221848 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3073b3ba0 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23ebfff640 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073b0790 0x55e3073b3660 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009cf0 tx=0x7f23e0004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad175e4efe1a6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23cbfff640 1 -- 172.21.15.19:0/4265221848 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d802e040 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23cbfff640 1 -- 172.21.15.19:0/4265221848 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7f23d8015990 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.674+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23e0011440 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23cbfff640 1 -- 172.21.15.19:0/4265221848 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f23d8037020 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 10 client.16671 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e30742dd90 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23cbfff640 1 -- 172.21.15.19:0/4265221848 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e0011440 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23cbfff640 1 -- 172.21.15.19:0/4265221848 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f23d803caa0 con 0x55e3073b0790 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 10 client.16671 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 20 client.16671 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e30742e280 0x55e3074306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 4 client.16671 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:11:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e307318860 con 0x55e30742e280 2024-09-11T00:11:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.675+0000 7f23f0e84640 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e30742e280 0x55e3074306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.676+0000 7f23f0e84640 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e30742e280 0x55e3074306a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=656f4b41c5aff5b9 server_cookie=259a231fbe87ef79 in_seq=0 out_seq=0 2024-09-11T00:11:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.676+0000 7f23cbfff640 10 client.16671 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.677+0000 7f23cbfff640 1 -- 172.21.15.19:0/4265221848 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e307318860 con 0x55e30742e280 2024-09-11T00:11:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.677+0000 7f23cbfff640 10 client.16671 handle_command_reply: tid=0 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.677+0000 7f23f54bd740 1 client.16671 shutdown 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073b0790 msgr2=0x55e3073b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073b0790 0x55e3073b3660 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009cf0 tx=0x7f23e0004410 comp rx=0 tx=0).stop 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 shutdown_connections 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55e30742e280 0x55e3074306a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3073b0790 0x55e3073b3660 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3073a4800 0x55e3073b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 --2- 172.21.15.19:0/4265221848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3073a3ee0 0x55e3073b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 >> 172.21.15.19:0/4265221848 conn(0x55e3073a1d10 msgr2=0x55e3073af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23cbfff640 0 client.16671 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 shutdown_connections 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 1 -- 172.21.15.19:0/4265221848 wait complete. 2024-09-11T00:11:40.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.678+0000 7f23f54bd740 20 client.16671 trim_cache size 0 max 16384 2024-09-11T00:11:40.686 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:11:40.686 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:11:40.686 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "09e8f5bb-ab99-4c46-81b2-61c40689c774", 2024-09-11T00:11:40.686 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:11:40.686 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:11:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f23dc0b5450 msgr2=0x7f23dc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f23dc0b5450 0x7f23dc0b7910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23e4006010 tx=0x7f23e4097900 comp rx=0 tx=0).stop 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec109150 msgr2=0x7f23ec1a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec109150 0x7f23ec1a0d70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f23e4005cc0 tx=0x7f23e402f380 comp rx=0 tx=0).stop 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 shutdown_connections 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f23dc0b5450 0x7f23dc0b7910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23ec109150 0x7f23ec1a0d70 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec1087d0 0x7f23ec19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 --2- 172.21.15.19:0/819328365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23ec102dc0 0x7f23ec19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 >> 172.21.15.19:0/819328365 conn(0x7f23ec0fe830 msgr2=0x7f23ec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 shutdown_connections 2024-09-11T00:11:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:40.679+0000 7f23f30e8640 1 -- 172.21.15.19:0/819328365 wait complete. 2024-09-11T00:11:41.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:11:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:42.142 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:41 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:11:42.143 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:41 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:42.143 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:41 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:11:42.143 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:41 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:42.143 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:41 smithi019 ceph-mon[30859]: pgmap v606: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:11:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:41 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:11:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:41 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:41 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:11:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:41 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:41 smithi135 ceph-mon[35432]: pgmap v606: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 -- 172.21.15.19:0/2052130123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23810d140 msgr2=0x7fe23810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 --2- 172.21.15.19:0/2052130123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23810d140 0x7fe23810f5a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe230009ca0 tx=0x7fe23002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 -- 172.21.15.19:0/2052130123 shutdown_connections 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 --2- 172.21.15.19:0/2052130123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23810d140 0x7fe23810f5a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 --2- 172.21.15.19:0/2052130123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238104600 0x7fe23810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 --2- 172.21.15.19:0/2052130123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe238103ce0 0x7fe2381040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 -- 172.21.15.19:0/2052130123 >> 172.21.15.19:0/2052130123 conn(0x7fe2380fd720 msgr2=0x7fe2380ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 -- 172.21.15.19:0/2052130123 shutdown_connections 2024-09-11T00:11:42.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.252+0000 7fe23e44d640 1 -- 172.21.15.19:0/2052130123 wait complete. 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 Processor -- start 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 -- start start 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe238103ce0 0x7fe238101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe238104600 0x7fe238101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23810d140 0x7fe238102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe238112db0 con 0x7fe238104600 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe238112c30 con 0x7fe238103ce0 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23e44d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe238112f30 con 0x7fe23810d140 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe238104600 0x7fe238101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe238104600 0x7fe238101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40668/0 (socket says 172.21.15.19:40668) 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 -- 172.21.15.19:0/471361818 learned_addr learned my addr 172.21.15.19:0/471361818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe237fff640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe238103ce0 0x7fe238101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23810d140 0x7fe238102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 -- 172.21.15.19:0/471361818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23810d140 msgr2=0x7fe238102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23810d140 0x7fe238102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 -- 172.21.15.19:0/471361818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe238103ce0 msgr2=0x7fe238101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe238103ce0 0x7fe238101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.253+0000 7fe22ffff640 1 -- 172.21.15.19:0/471361818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2381a7700 con 0x7fe238104600 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.254+0000 7fe237fff640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe238103ce0 0x7fe238101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.254+0000 7fe22ffff640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe238104600 0x7fe238101ed0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe22000d6b0 tx=0x7fe22000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.254+0000 7fe235ffb640 1 -- 172.21.15.19:0/471361818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220017070 con 0x7fe238104600 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.254+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2381a79f0 con 0x7fe238104600 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.254+0000 7fe235ffb640 1 -- 172.21.15.19:0/471361818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe220010460 con 0x7fe238104600 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.254+0000 7fe235ffb640 1 -- 172.21.15.19:0/471361818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22000f620 con 0x7fe238104600 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.254+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2381a7ee0 con 0x7fe238104600 2024-09-11T00:11:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.256+0000 7fe235ffb640 1 -- 172.21.15.19:0/471361818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fe220010930 con 0x7fe238104600 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.256+0000 7fe240822740 1 Processor -- start 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe240822740 1 -- start start 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe240822740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99490a0 0x560be9949480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe240822740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99499c0 0x560be9955410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe240822740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be9955950 0x560be9957d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe240822740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560be98bfe50 con 0x560be9955950 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe240822740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560be98af280 con 0x560be99499c0 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe240822740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560be98b3090 con 0x560be99490a0 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be9955950 0x560be9957d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe23c9ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99490a0 0x560be9949480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be9955950 0x560be9957d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40672/0 (socket says 172.21.15.19:40672) 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe22ffff640 1 -- 172.21.15.19:0/3930018197 learned_addr learned my addr 172.21.15.19:0/3930018197 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:42.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe237fff640 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99499c0 0x560be9955410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe23c9ea640 1 -- 172.21.15.19:0/3930018197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99499c0 msgr2=0x560be9955410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99499c0 0x560be9955410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe23c9ea640 1 -- 172.21.15.19:0/3930018197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be9955950 msgr2=0x560be9957d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be9955950 0x560be9957d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe23c9ea640 1 -- 172.21.15.19:0/3930018197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be960d650 con 0x560be99490a0 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe235ffb640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe2240b5450 0x7fe2240b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe22ffff640 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be9955950 0x560be9957d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.257+0000 7fe237fff640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe2240b5450 0x7fe2240b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.258+0000 7fe235ffb640 1 -- 172.21.15.19:0/471361818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7fe2200e5c70 con 0x7fe238104600 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.258+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99490a0 0x560be9949480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe230006010 tx=0x7fe230009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d574d0cdfaa130fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.258+0000 7fe22e7fc640 1 -- 172.21.15.19:0/3930018197 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230031450 con 0x560be99490a0 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.258+0000 7fe22e7fc640 1 -- 172.21.15.19:0/3930018197 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe230036040 con 0x560be99490a0 2024-09-11T00:11:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.258+0000 7fe22e7fc640 1 -- 172.21.15.19:0/3930018197 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2300043b0 con 0x560be99490a0 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.258+0000 7fe237fff640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe2240b5450 0x7fe2240b7910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x560be9947db0 tx=0x7fe22800c330 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 -- 172.21.15.19:0/3930018197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99490a0 msgr2=0x560be9949480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99490a0 0x560be9949480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe230006010 tx=0x7fe230009a20 comp rx=0 tx=0).stop 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 -- 172.21.15.19:0/3930018197 shutdown_connections 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be9955950 0x560be9957d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99499c0 0x560be9955410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 --2- 172.21.15.19:0/3930018197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99490a0 0x560be9949480 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 -- 172.21.15.19:0/3930018197 >> 172.21.15.19:0/3930018197 conn(0x560be9946ed0 msgr2=0x560be9948070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 -- 172.21.15.19:0/3930018197 shutdown_connections 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 -- 172.21.15.19:0/3930018197 wait complete. 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 -- start start 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 Processor -- start 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.259+0000 7fe240822740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe240822740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be99526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe240822740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9952d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe240822740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560be9710700 con 0x560be99490a0 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe240822740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560be984a110 con 0x560be9955950 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe240822740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560be9958570 con 0x560be99499c0 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe240822740 10 client.0 _ll_register_callbacks cb 0x560be9863990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40682/0 (socket says 172.21.15.19:40682) 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 -- 172.21.15.19:0/2048929778 learned_addr learned my addr 172.21.15.19:0/2048929778 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe22ffff640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be99526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9952d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 -- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 msgr2=0x560be99526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be99526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 -- 172.21.15.19:0/2048929778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 msgr2=0x560be9952d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9952d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 -- 172.21.15.19:0/2048929778 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be9877c40 con 0x560be99490a0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9952d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe237fff640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99552a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe228011e10 tx=0x7fe2280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adca54a245ce1c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe2177fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe2177fe640 1 -- 172.21.15.19:0/2048929778 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22801e420 con 0x560be99490a0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe2177fe640 1 -- 172.21.15.19:0/2048929778 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7fe22801e5c0 con 0x560be99490a0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.260+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe230036040 con 0x560be99490a0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe2177fe640 1 -- 172.21.15.19:0/2048929778 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe22801e7c0 con 0x560be99490a0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 10 client.16683 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560be9963f60 con 0x560be99490a0 2024-09-11T00:11:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe2177fe640 1 -- 172.21.15.19:0/2048929778 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe230036040 con 0x560be99490a0 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe2177fe640 1 -- 172.21.15.19:0/2048929778 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe228030970 con 0x560be99490a0 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 10 client.16683 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 20 client.16683 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be9965410 0x560be9967800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 4 client.16683 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560be98c1da0 con 0x560be9965410 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.261+0000 7fe22ffff640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be9965410 0x560be9967800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.262+0000 7fe2177fe640 10 client.16683 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.262+0000 7fe22ffff640 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be9965410 0x560be9967800 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efefe6849e52380d server_cookie=f6a30f8cbc1b74e2 in_seq=0 out_seq=0 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.262+0000 7fe2177fe640 1 -- 172.21.15.19:0/2048929778 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560be98c1da0 con 0x560be9965410 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.262+0000 7fe2177fe640 10 client.16683 handle_command_reply: tid=0 2024-09-11T00:11:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 client.16683 shutdown 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 msgr2=0x560be99552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99552a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe228011e10 tx=0x7fe2280046c0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 shutdown_connections 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9952d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be99526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be9965410 0x560be9967800 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 --2- 172.21.15.19:0/2048929778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99552a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 >> 172.21.15.19:0/2048929778 conn(0x560be9946ed0 msgr2=0x560be994ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe2177fe640 0 client.16683 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 shutdown_connections 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 1 -- 172.21.15.19:0/2048929778 wait complete. 2024-09-11T00:11:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.263+0000 7fe240822740 20 client.16683 trim_cache size 0 max 16384 2024-09-11T00:11:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.280+0000 7fe240822740 1 Processor -- start 2024-09-11T00:11:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.280+0000 7fe240822740 1 -- start start 2024-09-11T00:11:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe240822740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe240822740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be9947f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe240822740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9954430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe240822740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381b31c0 con 0x560be99490a0 2024-09-11T00:11:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe240822740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381b0a00 con 0x560be9955950 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe240822740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381ae870 con 0x560be99499c0 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40686/0 (socket says 172.21.15.19:40686) 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 -- 172.21.15.19:0/1704827004 learned_addr learned my addr 172.21.15.19:0/1704827004 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe22ffff640 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be9947f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9954430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 -- 172.21.15.19:0/1704827004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 msgr2=0x560be9947f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be9947f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 -- 172.21.15.19:0/1704827004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 msgr2=0x560be9954430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9954430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 -- 172.21.15.19:0/1704827004 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be9947950 con 0x560be99490a0 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe22ffff640 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be9947f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.281+0000 7fe237fff640 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99617a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe228000c00 tx=0x7fe228026630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c190ebbf1c8d4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe22dffb640 1 -- 172.21.15.19:0/1704827004 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228036040 con 0x560be99490a0 2024-09-11T00:11:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe22dffb640 1 -- 172.21.15.19:0/1704827004 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe22801ee10 con 0x560be99490a0 2024-09-11T00:11:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe22dffb640 1 -- 172.21.15.19:0/1704827004 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2280306e0 con 0x560be99490a0 2024-09-11T00:11:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 -- 172.21.15.19:0/1704827004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 msgr2=0x560be99617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99617a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe228000c00 tx=0x7fe228026630 comp rx=0 tx=0).stop 2024-09-11T00:11:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 -- 172.21.15.19:0/1704827004 shutdown_connections 2024-09-11T00:11:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be9955950 0x560be9954430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be99499c0 0x560be9947f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 --2- 172.21.15.19:0/1704827004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99490a0 0x560be99617a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 -- 172.21.15.19:0/1704827004 >> 172.21.15.19:0/1704827004 conn(0x560be9946ed0 msgr2=0x560be9953d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 -- 172.21.15.19:0/1704827004 shutdown_connections 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.282+0000 7fe240822740 1 -- 172.21.15.19:0/1704827004 wait complete. 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 -- start start 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 Processor -- start 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99490a0 0x560be995da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99499c0 0x560be995e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be9955950 0x560be994e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381aeec0 con 0x560be99499c0 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381b0330 con 0x560be99490a0 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381af590 con 0x560be9955950 2024-09-11T00:11:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe240822740 10 client.0 _ll_register_callbacks cb 0x7fe22800c4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99499c0 0x560be995e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99499c0 0x560be995e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40702/0 (socket says 172.21.15.19:40702) 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe22ffff640 1 -- 172.21.15.19:0/810454394 learned_addr learned my addr 172.21.15.19:0/810454394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe23c9ea640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be9955950 0x560be994e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe237fff640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99490a0 0x560be995da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe22ffff640 1 -- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be9955950 msgr2=0x560be994e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.283+0000 7fe22ffff640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be9955950 0x560be994e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe22ffff640 1 -- 172.21.15.19:0/810454394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99490a0 msgr2=0x560be995da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe22ffff640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99490a0 0x560be995da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe22ffff640 1 -- 172.21.15.19:0/810454394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be994f160 con 0x560be99499c0 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe237fff640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99490a0 0x560be995da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe22ffff640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99499c0 0x560be995e010 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe2200e34c0 tx=0x7fe2200b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b182f3935281a669 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe2177fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe2177fe640 1 -- 172.21.15.19:0/810454394 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220021040 con 0x560be99499c0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe2177fe640 1 -- 172.21.15.19:0/810454394 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8441+0+0 (secure 0 0 0) 0x7fe2200a83b0 con 0x560be99499c0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe22801ee10 con 0x560be99499c0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe2177fe640 1 -- 172.21.15.19:0/810454394 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe2200abf10 con 0x560be99499c0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 10 client.16689 fetch_fsmap learned FSMap version 35 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560be99503e0 con 0x560be99499c0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe2177fe640 1 -- 172.21.15.19:0/810454394 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe22801ee10 con 0x560be99499c0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe2177fe640 1 -- 172.21.15.19:0/810454394 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe2200e3b60 con 0x560be99499c0 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 10 client.16689 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 20 client.16689 populate_metadata read hostname 'smithi019' 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be99d34d0 0x560be99d58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 4 client.16689 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.284+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560be98bd850 con 0x560be99d34d0 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.285+0000 7fe237fff640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be99d34d0 0x560be99d58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.285+0000 7fe237fff640 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be99d34d0 0x560be99d58f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1151e311e8de2c9f server_cookie=eac45703d54bf61b in_seq=0 out_seq=0 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.285+0000 7fe2177fe640 10 client.16689 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.285+0000 7fe2177fe640 1 -- 172.21.15.19:0/810454394 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x560be98bd850 con 0x560be99d34d0 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.285+0000 7fe2177fe640 10 client.16689 handle_command_reply: tid=0 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 client.16689 shutdown 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99499c0 msgr2=0x560be995e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99499c0 0x560be995e010 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe2200e34c0 tx=0x7fe2200b5040 comp rx=0 tx=0).stop 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 shutdown_connections 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560be9955950 0x560be994e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x560be99d34d0 0x560be99d58f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560be99499c0 0x560be995e010 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 --2- 172.21.15.19:0/810454394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560be99490a0 0x560be995da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe2177fe640 0 client.16689 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 >> 172.21.15.19:0/810454394 conn(0x560be9946ed0 msgr2=0x560be9954540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 shutdown_connections 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 1 -- 172.21.15.19:0/810454394 wait complete. 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe240822740 20 client.16689 trim_cache size 0 max 16384 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "09e8f5bb-ab99-4c46-81b2-61c40689c774": { 2024-09-11T00:11:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "09e8f5bb-ab99-4c46-81b2-61c40689c774", 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "09e8f5bb-ab99-4c46-81b2-61c40689c774": { 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:11:40.677468+0000", 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "e66baedb-0b9a-4aa0-b143-f749e4000f12": { 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:58.253354+0000", 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:11:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:11:42.302 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:11:42.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe2240b5450 msgr2=0x7fe2240b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe23e44d640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe2240b5450 0x7fe2240b7910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x560be9947db0 tx=0x7fe22800c330 comp rx=0 tx=0).stop 2024-09-11T00:11:42.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe238104600 msgr2=0x7fe238101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.286+0000 7fe23e44d640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe238104600 0x7fe238101ed0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe22000d6b0 tx=0x7fe22000db70 comp rx=0 tx=0).stop 2024-09-11T00:11:42.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 shutdown_connections 2024-09-11T00:11:42.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23810d140 0x7fe238102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe2240b5450 0x7fe2240b7910 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe238104600 0x7fe238101ed0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 --2- 172.21.15.19:0/471361818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe238103ce0 0x7fe238101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 >> 172.21.15.19:0/471361818 conn(0x7fe2380fd720 msgr2=0x7fe2380fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 shutdown_connections 2024-09-11T00:11:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:11:42.287+0000 7fe23e44d640 1 -- 172.21.15.19:0/471361818 wait complete. 2024-09-11T00:11:42.304 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:41 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:11:42.304 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:41 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:42.304 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:41 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:11:42.304 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:41 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:11:42.304 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:41 smithi131 ceph-mon[35491]: pgmap v606: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:11:43.062 INFO:tasks.cephfs.filesystem:scrub status for tag:09e8f5bb-ab99-4c46-81b2-61c40689c774 - {'path': '/', 'tag': '09e8f5bb-ab99-4c46-81b2-61c40689c774', 'options': 'recursive,force'} 2024-09-11T00:11:44.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:43 smithi135 ceph-mon[35432]: pgmap v607: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-11T00:11:44.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:43 smithi019 ceph-mon[30859]: pgmap v607: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-11T00:11:44.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:43 smithi131 ceph-mon[35491]: pgmap v607: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-11T00:11:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:45 smithi135 ceph-mon[35432]: pgmap v608: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-11T00:11:46.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:45 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:11:46.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:45 smithi019 ceph-mon[30859]: pgmap v608: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-11T00:11:46.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:45 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:11:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:45 smithi131 ceph-mon[35491]: pgmap v608: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-11T00:11:46.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:45 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:11:48.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:47 smithi135 ceph-mon[35432]: pgmap v609: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:11:48.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:47 smithi019 ceph-mon[30859]: pgmap v609: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:11:48.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:47 smithi131 ceph-mon[35491]: pgmap v609: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:11:50.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:49 smithi135 ceph-mon[35432]: pgmap v610: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:11:50.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:49 smithi019 ceph-mon[30859]: pgmap v610: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:11:50.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:49 smithi131 ceph-mon[35491]: pgmap v610: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:11:52.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:51 smithi019 ceph-mon[30859]: pgmap v611: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-11T00:11:52.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:51 smithi131 ceph-mon[35491]: pgmap v611: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-11T00:11:52.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:51 smithi135 ceph-mon[35432]: pgmap v611: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-11T00:11:54.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:53 smithi019 ceph-mon[30859]: pgmap v612: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-11T00:11:54.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:53 smithi131 ceph-mon[35491]: pgmap v612: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-11T00:11:54.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:53 smithi135 ceph-mon[35432]: pgmap v612: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-11T00:11:56.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:55 smithi019 ceph-mon[30859]: pgmap v613: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-11T00:11:56.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:55 smithi131 ceph-mon[35491]: pgmap v613: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-11T00:11:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:55 smithi135 ceph-mon[35432]: pgmap v613: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-11T00:11:58.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:57 smithi019 ceph-mon[30859]: pgmap v614: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:11:58.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:57 smithi131 ceph-mon[35491]: pgmap v614: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:11:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:57 smithi135 ceph-mon[35432]: pgmap v614: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:12:00.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:11:59 smithi019 ceph-mon[30859]: pgmap v615: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:12:00.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:11:59 smithi131 ceph-mon[35491]: pgmap v615: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:12:00.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:11:59 smithi135 ceph-mon[35432]: pgmap v615: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:12:02.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:01 smithi019 ceph-mon[30859]: pgmap v616: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:02.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:01 smithi131 ceph-mon[35491]: pgmap v616: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:02.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:01 smithi135 ceph-mon[35432]: pgmap v616: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:04.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:03 smithi019 ceph-mon[30859]: pgmap v617: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:12:04.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:03 smithi131 ceph-mon[35491]: pgmap v617: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:12:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:03 smithi135 ceph-mon[35432]: pgmap v617: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:12:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:05 smithi019 ceph-mon[30859]: pgmap v618: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:06.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:05 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:12:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:05 smithi131 ceph-mon[35491]: pgmap v618: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:06.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:05 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:12:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:05 smithi135 ceph-mon[35432]: pgmap v618: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:06.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:05 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:12:08.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:07 smithi019 ceph-mon[30859]: pgmap v619: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:12:08.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:07 smithi131 ceph-mon[35491]: pgmap v619: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:12:08.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:07 smithi135 ceph-mon[35432]: pgmap v619: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:12:10.228 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:09 smithi135 ceph-mon[35432]: pgmap v620: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:10.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:09 smithi019 ceph-mon[30859]: pgmap v620: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:10.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:09 smithi131 ceph-mon[35491]: pgmap v620: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:12.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:11 smithi019 ceph-mon[30859]: pgmap v621: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:12.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:11 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:12.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:11 smithi019 ceph-mon[30859]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T00:12:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:11 smithi131 ceph-mon[35491]: pgmap v621: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:11 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:12.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:11 smithi131 ceph-mon[35491]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T00:12:12.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:11 smithi135 ceph-mon[35432]: pgmap v621: 97 pgs: 97 active+clean; 843 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:12:12.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:11 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:12.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:11 smithi135 ceph-mon[35432]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T00:12:13.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:12:13.492 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:14.206 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:13 smithi019 ceph-mon[30859]: pgmap v623: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 841 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:12:14.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:13 smithi131 ceph-mon[35491]: pgmap v623: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 841 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:12:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.353+0000 7f56bb7fe640 1 -- 172.21.15.19:0/3258926908 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b402c040 con 0x7f56bc115a10 2024-09-11T00:12:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 -- 172.21.15.19:0/3258926908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc115a10 msgr2=0x7f56bc117e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 --2- 172.21.15.19:0/3258926908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc115a10 0x7f56bc117e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009ca0 tx=0x7f56b402a950 comp rx=0 tx=0).stop 2024-09-11T00:12:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 -- 172.21.15.19:0/3258926908 shutdown_connections 2024-09-11T00:12:14.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 --2- 172.21.15.19:0/3258926908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc115a10 0x7f56bc117e00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 --2- 172.21.15.19:0/3258926908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc10aa70 0x7f56bc1154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 --2- 172.21.15.19:0/3258926908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56bc10a150 0x7f56bc10a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 -- 172.21.15.19:0/3258926908 >> 172.21.15.19:0/3258926908 conn(0x7f56bc06dfc0 msgr2=0x7f56bc06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.354+0000 7f56c2e25640 1 -- 172.21.15.19:0/3258926908 shutdown_connections 2024-09-11T00:12:14.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.355+0000 7f56c2e25640 1 -- 172.21.15.19:0/3258926908 wait complete. 2024-09-11T00:12:14.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.355+0000 7f56c2e25640 1 Processor -- start 2024-09-11T00:12:14.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c2e25640 1 -- start start 2024-09-11T00:12:14.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c2e25640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56bc10a150 0x7f56bc1147a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c2e25640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc10aa70 0x7f56bc114ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c2e25640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc115a10 0x7f56bc1ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c2e25640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc11b590 con 0x7f56bc10a150 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c2e25640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc11b410 con 0x7f56bc10aa70 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c2e25640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc11b710 con 0x7f56bc115a10 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c0bc1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56bc10a150 0x7f56bc1147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c13c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc115a10 0x7f56bc1ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c13c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc115a10 0x7f56bc1ad8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56858/0 (socket says 172.21.15.19:56858) 2024-09-11T00:12:14.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.356+0000 7f56c13c2640 1 -- 172.21.15.19:0/4284924759 learned_addr learned my addr 172.21.15.19:0/4284924759 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:14.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.357+0000 7f56c13c2640 1 -- 172.21.15.19:0/4284924759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc10aa70 msgr2=0x7f56bc114ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.357+0000 7f56bbfff640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc10aa70 0x7f56bc114ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.357+0000 7f56c13c2640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc10aa70 0x7f56bc114ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.357+0000 7f56c13c2640 1 -- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56bc10a150 msgr2=0x7f56bc1147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.357+0000 7f56c13c2640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56bc10a150 0x7f56bc1147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.357+0000 7f56c13c2640 1 -- 172.21.15.19:0/4284924759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc1ae0b0 con 0x7f56bc115a10 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.358+0000 7f56bbfff640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc10aa70 0x7f56bc114ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.358+0000 7f56c13c2640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc115a10 0x7f56bc1ad8e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f56b402aec0 tx=0x7f56b4003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.358+0000 7f56b9ffb640 1 -- 172.21.15.19:0/4284924759 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4034040 con 0x7f56bc115a10 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.359+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc1ae340 con 0x7f56bc115a10 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.359+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc1b4a60 con 0x7f56bc115a10 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.359+0000 7f56b9ffb640 1 -- 172.21.15.19:0/4284924759 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b4003e50 con 0x7f56bc115a10 2024-09-11T00:12:14.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.359+0000 7f56b9ffb640 1 -- 172.21.15.19:0/4284924759 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4004520 con 0x7f56bc115a10 2024-09-11T00:12:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.363+0000 7f56b9ffb640 1 -- 172.21.15.19:0/4284924759 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f56b404d030 con 0x7f56bc115a10 2024-09-11T00:12:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 Processor -- start 2024-09-11T00:12:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 -- start start 2024-09-11T00:12:14.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26480 0x55ae1df26860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 0x55ae1df327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df32d30 0x55ae1df35120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ae1de9ce50 con 0x55ae1df26480 2024-09-11T00:12:14.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ae1de8c280 con 0x55ae1df26da0 2024-09-11T00:12:14.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.364+0000 7f56c51fa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae1de90090 con 0x55ae1df32d30 2024-09-11T00:12:14.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df32d30 0x55ae1df35120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df32d30 0x55ae1df35120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56870/0 (socket says 172.21.15.19:56870) 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 -- 172.21.15.19:0/4245152538 learned_addr learned my addr 172.21.15.19:0/4245152538 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 0x55ae1df327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 -- 172.21.15.19:0/4245152538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 msgr2=0x55ae1df327f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 0x55ae1df327f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 -- 172.21.15.19:0/4245152538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26480 msgr2=0x55ae1df26860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26480 0x55ae1df26860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.365+0000 7f56bbfff640 1 -- 172.21.15.19:0/4245152538 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae1dbea650 con 0x55ae1df32d30 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.366+0000 7f56bbfff640 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df32d30 0x55ae1df35120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009ca0 tx=0x7f56b00117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c2381874dc827f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.366+0000 7f56a6ffd640 1 -- 172.21.15.19:0/4245152538 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b001b470 con 0x55ae1df32d30 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.366+0000 7f56a6ffd640 1 -- 172.21.15.19:0/4245152538 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b0016070 con 0x55ae1df32d30 2024-09-11T00:12:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.367+0000 7f56b9ffb640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f56ac0b5500 0x7f56ac0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.367+0000 7f56c51fa740 1 -- 172.21.15.19:0/4245152538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df32d30 msgr2=0x55ae1df35120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.367+0000 7f56c51fa740 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df32d30 0x55ae1df35120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009ca0 tx=0x7f56b00117b0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.367+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f56ac0b5500 0x7f56ac0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.368+0000 7f56b9ffb640 1 -- 172.21.15.19:0/4284924759 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f56b4106bb0 con 0x7f56bc115a10 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.368+0000 7f56c51fa740 1 -- 172.21.15.19:0/4245152538 shutdown_connections 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.368+0000 7f56c51fa740 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df32d30 0x55ae1df35120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.368+0000 7f56c51fa740 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 0x55ae1df327f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.368+0000 7f56c51fa740 1 --2- 172.21.15.19:0/4245152538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26480 0x55ae1df26860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.368+0000 7f56c51fa740 1 -- 172.21.15.19:0/4245152538 >> 172.21.15.19:0/4245152538 conn(0x55ae1df242b0 msgr2=0x55ae1df25450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.369+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f56ac0b5500 0x7f56ac0b79c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55ae1df25190 tx=0x7f56a800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.369+0000 7f56c51fa740 1 -- 172.21.15.19:0/4245152538 shutdown_connections 2024-09-11T00:12:14.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.370+0000 7f56c51fa740 1 -- 172.21.15.19:0/4245152538 wait complete. 2024-09-11T00:12:14.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.370+0000 7f56c51fa740 1 -- start start 2024-09-11T00:12:14.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.370+0000 7f56c51fa740 1 Processor -- start 2024-09-11T00:12:14.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df32590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c51fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ae1dced700 con 0x55ae1df26da0 2024-09-11T00:12:14.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c51fa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ae1de27110 con 0x55ae1df32d30 2024-09-11T00:12:14.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c51fa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae1df35a00 con 0x55ae1df26480 2024-09-11T00:12:14.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c51fa740 10 client.0 _ll_register_callbacks cb 0x55ae1de40990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:14.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56c13c2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48994/0 (socket says 172.21.15.19:48994) 2024-09-11T00:12:14.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.371+0000 7f56bbfff640 1 -- 172.21.15.19:0/1999080708 learned_addr learned my addr 172.21.15.19:0/1999080708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:14.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.372+0000 7f56c13c2640 1 -- 172.21.15.19:0/1999080708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 msgr2=0x55ae1df32590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:12:14.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.372+0000 7f56c13c2640 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df32590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.372+0000 7f56c13c2640 1 -- 172.21.15.19:0/1999080708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 msgr2=0x55ae1df2f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:14.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.372+0000 7f56c13c2640 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.372+0000 7f56c13c2640 1 -- 172.21.15.19:0/1999080708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae1de54c40 con 0x55ae1df32d30 2024-09-11T00:12:14.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.373+0000 7f56c13c2640 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2ff60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f56b41042c0 tx=0x7f56b40cca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a10d433ed7411df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.373+0000 7f569bfff640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.373+0000 7f569bfff640 1 -- 172.21.15.19:0/1999080708 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b40ccb00 con 0x55ae1df32d30 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.373+0000 7f569bfff640 1 -- 172.21.15.19:0/1999080708 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f56b40cc250 con 0x55ae1df32d30 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.373+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56b0016070 con 0x55ae1df32d30 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.374+0000 7f569bfff640 1 -- 172.21.15.19:0/1999080708 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f56b40cd6f0 con 0x55ae1df32d30 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.374+0000 7f56c51fa740 10 client.25973 fetch_fsmap learned FSMap version 36 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.374+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ae1df41390 con 0x55ae1df32d30 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.374+0000 7f569bfff640 1 -- 172.21.15.19:0/1999080708 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b40d4e50 con 0x55ae1df32d30 2024-09-11T00:12:14.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.374+0000 7f569bfff640 1 -- 172.21.15.19:0/1999080708 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 36) ==== 8358+0+0 (secure 0 0 0) 0x7f56b40b81d0 con 0x55ae1df32d30 2024-09-11T00:12:14.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.375+0000 7f56c51fa740 10 client.25973 fetch_fsmap finished waiting for FSMap version 36 2024-09-11T00:12:14.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.375+0000 7f56c51fa740 10 client.25973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:14.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.375+0000 7f56c51fa740 20 client.25973 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:14.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.375+0000 7f56c51fa740 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1df44cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.375+0000 7f56c51fa740 4 client.25973 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:14.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.375+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f56b0016070 con 0x55ae1df42890 2024-09-11T00:12:14.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.375+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1df44cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.377+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1df44cb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9d1f6e76841540 server_cookie=7dd0fb49cf014ab1 in_seq=0 out_seq=0 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.377+0000 7f569bfff640 10 client.25973 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.380+0000 7f569bfff640 1 -- 172.21.15.19:0/1999080708 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f56b0016070 con 0x55ae1df42890 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.380+0000 7f569bfff640 10 client.25973 handle_command_reply: tid=0 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.380+0000 7f56c51fa740 1 client.25973 shutdown 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.380+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 msgr2=0x55ae1df2ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.380+0000 7f56c51fa740 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2ff60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f56b41042c0 tx=0x7f56b40cca00 comp rx=0 tx=0).stop 2024-09-11T00:12:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 shutdown_connections 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2ff60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1df44cb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f569bfff640 0 client.25973 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 --2- 172.21.15.19:0/1999080708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df32590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 >> 172.21.15.19:0/1999080708 conn(0x55ae1df242b0 msgr2=0x55ae1df29e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 shutdown_connections 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 1 -- 172.21.15.19:0/1999080708 wait complete. 2024-09-11T00:12:14.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.381+0000 7f56c51fa740 20 client.25973 trim_cache size 0 max 16384 2024-09-11T00:12:14.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.415+0000 7f56c51fa740 1 Processor -- start 2024-09-11T00:12:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.416+0000 7f56c51fa740 1 -- start start 2024-09-11T00:12:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.416+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.416+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.416+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.416+0000 7f56c51fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f56a0011180 con 0x55ae1df26da0 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.416+0000 7f56c51fa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f56a000e9f0 con 0x55ae1df32d30 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.416+0000 7f56c51fa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56a000c860 con 0x55ae1df26480 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49004/0 (socket says 172.21.15.19:49004) 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 -- 172.21.15.19:0/323317829 learned_addr learned my addr 172.21.15.19:0/323317829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56c13c2640 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 -- 172.21.15.19:0/323317829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 msgr2=0x55ae1df3ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:14.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 -- 172.21.15.19:0/323317829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 msgr2=0x55ae1df2d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:14.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.417+0000 7f56bbfff640 1 -- 172.21.15.19:0/323317829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae1df35890 con 0x55ae1df26da0 2024-09-11T00:12:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.419+0000 7f56bbfff640 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2cc10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f56b000f750 tx=0x7f56b000f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dcbf5771ba6514 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.419+0000 7f56a67fc640 1 -- 172.21.15.19:0/323317829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b000fbf0 con 0x55ae1df26da0 2024-09-11T00:12:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.419+0000 7f56a67fc640 1 -- 172.21.15.19:0/323317829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b0021040 con 0x55ae1df26da0 2024-09-11T00:12:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.419+0000 7f56a67fc640 1 -- 172.21.15.19:0/323317829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b0003960 con 0x55ae1df26da0 2024-09-11T00:12:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.420+0000 7f56c51fa740 1 -- 172.21.15.19:0/323317829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 msgr2=0x55ae1df2cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.420+0000 7f56c51fa740 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2cc10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f56b000f750 tx=0x7f56b000f780 comp rx=0 tx=0).stop 2024-09-11T00:12:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.421+0000 7f56c51fa740 1 -- 172.21.15.19:0/323317829 shutdown_connections 2024-09-11T00:12:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.421+0000 7f56c51fa740 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df32d30 0x55ae1df2d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.421+0000 7f56c51fa740 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df26da0 0x55ae1df2cc10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.421+0000 7f56c51fa740 1 --2- 172.21.15.19:0/323317829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.421+0000 7f56c51fa740 1 -- 172.21.15.19:0/323317829 >> 172.21.15.19:0/323317829 conn(0x55ae1df242b0 msgr2=0x55ae1df31010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.423+0000 7f56c51fa740 1 -- 172.21.15.19:0/323317829 shutdown_connections 2024-09-11T00:12:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.423+0000 7f56c51fa740 1 -- 172.21.15.19:0/323317829 wait complete. 2024-09-11T00:12:14.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:13 smithi135 ceph-mon[35432]: pgmap v623: 97 pgs: 19 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 69 active+clean; 841 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:12:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.424+0000 7f56c51fa740 1 -- start start 2024-09-11T00:12:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.424+0000 7f56c51fa740 1 Processor -- start 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 0x55ae1df37d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c51fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df32d30 0x55ae1df383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c51fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f56a000ceb0 con 0x55ae1df32d30 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c51fa740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f56a000e320 con 0x55ae1df26da0 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c51fa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56a000d580 con 0x55ae1df26480 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c51fa740 10 client.0 _ll_register_callbacks cb 0x7f56b4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c13c2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df32d30 0x55ae1df383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c13c2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df32d30 0x55ae1df383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49012/0 (socket says 172.21.15.19:49012) 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c13c2640 1 -- 172.21.15.19:0/3906942185 learned_addr learned my addr 172.21.15.19:0/3906942185 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.425+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c13c2640 1 -- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 msgr2=0x55ae1df3b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c13c2640 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c13c2640 1 -- 172.21.15.19:0/3906942185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 msgr2=0x55ae1df37d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:12:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c13c2640 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 0x55ae1df37d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c13c2640 1 -- 172.21.15.19:0/3906942185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae1dfaf7d0 con 0x55ae1df32d30 2024-09-11T00:12:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c13c2640 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df32d30 0x55ae1df383c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f56b4039020 tx=0x7f56b40cc480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25833b6aff920f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f569bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f569bfff640 1 -- 172.21.15.19:0/3906942185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b40c9640 con 0x55ae1df32d30 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.426+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56b0021040 con 0x55ae1df32d30 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.427+0000 7f569bfff640 1 -- 172.21.15.19:0/3906942185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f56b40cbcc0 con 0x55ae1df32d30 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.427+0000 7f569bfff640 1 -- 172.21.15.19:0/3906942185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f56b40ccdc0 con 0x55ae1df32d30 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.427+0000 7f56c51fa740 10 client.16704 fetch_fsmap learned FSMap version 36 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.427+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ae1dfb09b0 con 0x55ae1df32d30 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.427+0000 7f569bfff640 1 -- 172.21.15.19:0/3906942185 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b40d4e50 con 0x55ae1df32d30 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.428+0000 7f569bfff640 1 -- 172.21.15.19:0/3906942185 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8358+0+0 (secure 0 0 0) 0x7f56b40cbec0 con 0x55ae1df32d30 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.428+0000 7f56c51fa740 10 client.16704 fetch_fsmap finished waiting for FSMap version 36 2024-09-11T00:12:14.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.428+0000 7f56c51fa740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:14.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.428+0000 7f56c51fa740 20 client.16704 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:14.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.428+0000 7f56c51fa740 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1dfb3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.428+0000 7f56c51fa740 4 client.16704 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:12:14.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.428+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f56b0021040 con 0x55ae1df42890 2024-09-11T00:12:14.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.429+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1dfb3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.431+0000 7f56c0bc1640 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1dfb3010 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ec42a43065585b2 server_cookie=f66fb0336377184e in_seq=0 out_seq=0 2024-09-11T00:12:14.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.431+0000 7f569bfff640 10 client.16704 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:14.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.432+0000 7f569bfff640 1 -- 172.21.15.19:0/3906942185 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x7f56b0021040 con 0x55ae1df42890 2024-09-11T00:12:14.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.432+0000 7f569bfff640 10 client.16704 handle_command_reply: tid=0 2024-09-11T00:12:14.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.432+0000 7f56c51fa740 1 client.16704 shutdown 2024-09-11T00:12:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df32d30 msgr2=0x55ae1df383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df32d30 0x55ae1df383c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f56b4039020 tx=0x7f56b40cc480 comp rx=0 tx=0).stop 2024-09-11T00:12:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 shutdown_connections 2024-09-11T00:12:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ae1df42890 0x55ae1dfb3010 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ae1df32d30 0x55ae1df383c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1df26da0 0x55ae1df37d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 --2- 172.21.15.19:0/3906942185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae1df26480 0x55ae1df3b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.433+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 >> 172.21.15.19:0/3906942185 conn(0x55ae1df242b0 msgr2=0x55ae1df22bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.434+0000 7f569bfff640 0 client.16704 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.434+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 shutdown_connections 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.434+0000 7f56c51fa740 1 -- 172.21.15.19:0/3906942185 wait complete. 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.435+0000 7f56c51fa740 20 client.16704 trim_cache size 0 max 16384 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:12:14.437 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "09e8f5bb-ab99-4c46-81b2-61c40689c774": { 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:11:40.677468+0000", 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "e66baedb-0b9a-4aa0-b143-f749e4000f12": { 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:58.253354+0000", 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.438 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.439 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.440 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.441 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.443 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:12:14.444 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:14.445 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:14.445 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:14.445 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:14.445 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:14.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:12:14.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:12:14.445 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.436+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f56ac0b5500 msgr2=0x7f56ac0b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.436+0000 7f56c2e25640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f56ac0b5500 0x7f56ac0b79c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55ae1df25190 tx=0x7f56a800b390 comp rx=0 tx=0).stop 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.436+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc115a10 msgr2=0x7f56bc1ad8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.436+0000 7f56c2e25640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc115a10 0x7f56bc1ad8e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f56b402aec0 tx=0x7f56b4003ce0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 shutdown_connections 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc115a10 0x7f56bc1ad8e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56bc10aa70 0x7f56bc114ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f56ac0b5500 0x7f56ac0b79c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 --2- 172.21.15.19:0/4284924759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56bc10a150 0x7f56bc1147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 >> 172.21.15.19:0/4284924759 conn(0x7f56bc06dfc0 msgr2=0x7f56bc072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 shutdown_connections 2024-09-11T00:12:14.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:14.437+0000 7f56c2e25640 1 -- 172.21.15.19:0/4284924759 wait complete. 2024-09-11T00:12:15.333 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:12:15.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:12:15.596 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:15.983 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:15 smithi019 ceph-mon[30859]: pgmap v624: 97 pgs: 21 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 65 active+clean; 839 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:15.983 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:15 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:16.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.093+0000 7fc35759f640 1 -- 172.21.15.19:0/1170621729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 msgr2=0x7fc3501031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.093+0000 7fc35759f640 1 --2- 172.21.15.19:0/1170621729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3501031a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009900 tx=0x7fc34c02a410 comp rx=0 tx=0).stop 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.093+0000 7fc35759f640 1 -- 172.21.15.19:0/1170621729 shutdown_connections 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.093+0000 7fc35759f640 1 --2- 172.21.15.19:0/1170621729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc350109150 0x7fc35010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.093+0000 7fc35759f640 1 --2- 172.21.15.19:0/1170621729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3501087d0 0x7fc350108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.093+0000 7fc35759f640 1 --2- 172.21.15.19:0/1170621729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3501031a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.093+0000 7fc35759f640 1 -- 172.21.15.19:0/1170621729 >> 172.21.15.19:0/1170621729 conn(0x7fc3500fe830 msgr2=0x7fc350100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 -- 172.21.15.19:0/1170621729 shutdown_connections 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 -- 172.21.15.19:0/1170621729 wait complete. 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 Processor -- start 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 -- start start 2024-09-11T00:12:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3500754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3501087d0 0x7fc3500759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc350109150 0x7fc350075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc350112e10 con 0x7fc350102dc0 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc350112c90 con 0x7fc3501087d0 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35759f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc350112f90 con 0x7fc350109150 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35533b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3500754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35533b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3500754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49028/0 (socket says 172.21.15.19:49028) 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.094+0000 7fc35533b640 1 -- 172.21.15.19:0/1336762311 learned_addr learned my addr 172.21.15.19:0/1336762311 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc355b3c640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc350109150 0x7fc350075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc354b3a640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3501087d0 0x7fc3500759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35533b640 1 -- 172.21.15.19:0/1336762311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc350109150 msgr2=0x7fc350075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35533b640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc350109150 0x7fc350075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35533b640 1 -- 172.21.15.19:0/1336762311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3501087d0 msgr2=0x7fc3500759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35533b640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3501087d0 0x7fc3500759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35533b640 1 -- 172.21.15.19:0/1336762311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3501a76a0 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35533b640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3500754a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005940 tx=0x7fc34c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc3467fc640 1 -- 172.21.15.19:0/1336762311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c03f030 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3501a7930 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc3467fc640 1 -- 172.21.15.19:0/1336762311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc34c003aa0 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc3467fc640 1 -- 172.21.15.19:0/1336762311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c035070 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.095+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3501a7e10 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.096+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3501031a0 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.098+0000 7fc3467fc640 1 -- 172.21.15.19:0/1336762311 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fc34c03bcc0 con 0x7fc350102dc0 2024-09-11T00:12:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.099+0000 7fc3467fc640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc33c0b5450 0x7fc33c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.099+0000 7fc3467fc640 1 -- 172.21.15.19:0/1336762311 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7fc34c106b80 con 0x7fc350102dc0 2024-09-11T00:12:16.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.099+0000 7fc354b3a640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc33c0b5450 0x7fc33c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.099+0000 7fc354b3a640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc33c0b5450 0x7fc33c0b7910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc350076f90 tx=0x7fc340005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:16.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.102+0000 7fc3467fc640 1 -- 172.21.15.19:0/1336762311 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc34c0cd0d0 con 0x7fc350102dc0 2024-09-11T00:12:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:15 smithi131 ceph-mon[35491]: pgmap v624: 97 pgs: 21 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 65 active+clean; 839 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:16.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:15 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.328+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc35002e5c0 con 0x7fc350102dc0 2024-09-11T00:12:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.329+0000 7fc3467fc640 1 -- 172.21.15.19:0/1336762311 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11917 (secure 0 0 0) 0x7fc34c0d1b00 con 0x7fc350102dc0 2024-09-11T00:12:16.331 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:12:16.331 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"btime":"2024-09-11T00:12:14:969594+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:12:14.734413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:12:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 37 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc33c0b5450 msgr2=0x7fc33c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc33c0b5450 0x7fc33c0b7910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc350076f90 tx=0x7fc340005f90 comp rx=0 tx=0).stop 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 msgr2=0x7fc3500754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3500754a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005940 tx=0x7fc34c004270 comp rx=0 tx=0).stop 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 shutdown_connections 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc350109150 0x7fc350075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3501087d0 0x7fc3500759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc33c0b5450 0x7fc33c0b7910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 --2- 172.21.15.19:0/1336762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc350102dc0 0x7fc3500754a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 >> 172.21.15.19:0/1336762311 conn(0x7fc3500fe830 msgr2=0x7fc350100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 shutdown_connections 2024-09-11T00:12:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:16.332+0000 7fc35759f640 1 -- 172.21.15.19:0/1336762311 wait complete. 2024-09-11T00:12:16.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:15 smithi135 ceph-mon[35432]: pgmap v624: 97 pgs: 21 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 65 active+clean; 839 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:16.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:15 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:17.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:16 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1336762311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:12:17.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:12:17.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:16 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1336762311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:12:17.392 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:17.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:16 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1336762311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:12:18.241 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:17 smithi019 ceph-mon[30859]: pgmap v625: 97 pgs: 21 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 65 active+clean; 830 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:18.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:17 smithi131 ceph-mon[35491]: pgmap v625: 97 pgs: 21 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 65 active+clean; 830 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:18.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 -- 172.21.15.19:0/34861068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc1076a0 msgr2=0x7f13dc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 --2- 172.21.15.19:0/34861068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc1076a0 0x7f13dc107ae0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009900 tx=0x7f13cc02a410 comp rx=0 tx=0).stop 2024-09-11T00:12:18.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 -- 172.21.15.19:0/34861068 shutdown_connections 2024-09-11T00:12:18.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 --2- 172.21.15.19:0/34861068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc108020 0x7f13dc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 --2- 172.21.15.19:0/34861068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc1076a0 0x7f13dc107ae0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 --2- 172.21.15.19:0/34861068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc101c90 0x7f13dc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 -- 172.21.15.19:0/34861068 >> 172.21.15.19:0/34861068 conn(0x7f13dc0fd700 msgr2=0x7f13dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 -- 172.21.15.19:0/34861068 shutdown_connections 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.198+0000 7f13e3d39640 1 -- 172.21.15.19:0/34861068 wait complete. 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 Processor -- start 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 -- start start 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc101c90 0x7f13dc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc1076a0 0x7f13dc199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc108020 0x7f13dc19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc111cf0 con 0x7f13dc101c90 2024-09-11T00:12:18.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc111b70 con 0x7f13dc108020 2024-09-11T00:12:18.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.199+0000 7f13e3d39640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc111e70 con 0x7f13dc1076a0 2024-09-11T00:12:18.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc101c90 0x7f13dc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc101c90 0x7f13dc199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49046/0 (socket says 172.21.15.19:49046) 2024-09-11T00:12:18.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 -- 172.21.15.19:0/3921441083 learned_addr learned my addr 172.21.15.19:0/3921441083 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:18.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e12d4640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc1076a0 0x7f13dc199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e22d6640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc108020 0x7f13dc19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 -- 172.21.15.19:0/3921441083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc1076a0 msgr2=0x7f13dc199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc1076a0 0x7f13dc199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 -- 172.21.15.19:0/3921441083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc108020 msgr2=0x7f13dc19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc108020 0x7f13dc19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 -- 172.21.15.19:0/3921441083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc19f2f0 con 0x7f13dc101c90 2024-09-11T00:12:18.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e22d6640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc108020 0x7f13dc19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:18.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc101c90 0x7f13dc199240 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c920 tx=0x7f13d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:18.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13d2ffd640 1 -- 172.21.15.19:0/3921441083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8007c70 con 0x7f13dc101c90 2024-09-11T00:12:18.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13d2ffd640 1 -- 172.21.15.19:0/3921441083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13d8007e10 con 0x7f13dc101c90 2024-09-11T00:12:18.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13dc19f5e0 con 0x7f13dc101c90 2024-09-11T00:12:18.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13d2ffd640 1 -- 172.21.15.19:0/3921441083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8018820 con 0x7f13dc101c90 2024-09-11T00:12:18.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.200+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13dc1a5e70 con 0x7f13dc101c90 2024-09-11T00:12:18.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.203+0000 7f13e610e740 1 Processor -- start 2024-09-11T00:12:18.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.203+0000 7f13d2ffd640 1 -- 172.21.15.19:0/3921441083 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f13d800f450 con 0x7f13dc101c90 2024-09-11T00:12:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.203+0000 7f13e610e740 1 -- start start 2024-09-11T00:12:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e610e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e610e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c88b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e610e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c88bdb0 0x55ed8c88e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e610e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ed8c7f1ea0 con 0x55ed8c88bdb0 2024-09-11T00:12:18.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e610e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ed8c7e12d0 con 0x55ed8c87ba10 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e610e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ed8c7e50e0 con 0x55ed8c87b0f0 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c88bdb0 0x55ed8c88e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c88bdb0 0x55ed8c88e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49056/0 (socket says 172.21.15.19:49056) 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 -- 172.21.15.19:0/1798733256 learned_addr learned my addr 172.21.15.19:0/1798733256 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e22d6640 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c88b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 -- 172.21.15.19:0/1798733256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 msgr2=0x55ed8c87b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 -- 172.21.15.19:0/1798733256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 msgr2=0x55ed8c88b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c88b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 -- 172.21.15.19:0/1798733256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8c53f650 con 0x55ed8c88bdb0 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13d2ffd640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f13c80b54d0 0x7f13c80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e12d4640 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c88bdb0 0x55ed8c88e1a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009230 tx=0x7f13cc004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea64c62f52c327d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.204+0000 7f13e22d6640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f13c80b54d0 0x7f13c80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13d2ffd640 1 -- 172.21.15.19:0/3921441083 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f13d80e6070 con 0x7f13dc101c90 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13c7fff640 1 -- 172.21.15.19:0/1798733256 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc035040 con 0x55ed8c88bdb0 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13c7fff640 1 -- 172.21.15.19:0/1798733256 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13cc004770 con 0x55ed8c88bdb0 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13c7fff640 1 -- 172.21.15.19:0/1798733256 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0037f0 con 0x55ed8c88bdb0 2024-09-11T00:12:18.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e610e740 1 -- 172.21.15.19:0/1798733256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c88bdb0 msgr2=0x55ed8c88e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e22d6640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f13c80b54d0 0x7f13c80b7990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f13d4005fd0 tx=0x7f13d4009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:18.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e610e740 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c88bdb0 0x55ed8c88e1a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009230 tx=0x7f13cc004310 comp rx=0 tx=0).stop 2024-09-11T00:12:18.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e610e740 1 -- 172.21.15.19:0/1798733256 shutdown_connections 2024-09-11T00:12:18.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e610e740 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c88bdb0 0x55ed8c88e1a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e610e740 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c88b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e610e740 1 --2- 172.21.15.19:0/1798733256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.205+0000 7f13e610e740 1 -- 172.21.15.19:0/1798733256 >> 172.21.15.19:0/1798733256 conn(0x55ed8c878f20 msgr2=0x55ed8c87a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 -- 172.21.15.19:0/1798733256 shutdown_connections 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 -- 172.21.15.19:0/1798733256 wait complete. 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 -- start start 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 Processor -- start 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c88b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87ba10 0x55ed8c888b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8890c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ed8c642700 con 0x55ed8c87ba10 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ed8c77c160 con 0x55ed8c88bdb0 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.206+0000 7f13e610e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ed8c88ea00 con 0x55ed8c87b0f0 2024-09-11T00:12:18.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e610e740 10 client.0 _ll_register_callbacks cb 0x55ed8c7959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:18.314 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:12:18.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87ba10 0x55ed8c888b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87ba10 0x55ed8c888b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49066/0 (socket says 172.21.15.19:49066) 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 -- 172.21.15.19:0/3541216855 learned_addr learned my addr 172.21.15.19:0/3541216855 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e22d6640 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8890c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c88b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 -- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 msgr2=0x55ed8c88b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c88b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 -- 172.21.15.19:0/3541216855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c88bdb0 msgr2=0x55ed8c8890c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8890c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 -- 172.21.15.19:0/3541216855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8c7a9c90 con 0x55ed8c87ba10 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e12d4640 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87ba10 0x55ed8c888b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f13cc02aa00 tx=0x7f13cc004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2c8e4a7db50360 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:18.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13c57fa640 1 -- 172.21.15.19:0/3541216855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc053060 con 0x55ed8c87ba10 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13c57fa640 1 -- 172.21.15.19:0/3541216855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f13cc005000 con 0x55ed8c87ba10 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.207+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13cc004770 con 0x55ed8c87ba10 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13c57fa640 1 -- 172.21.15.19:0/3541216855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f13cc035050 con 0x55ed8c87ba10 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 10 client.16722 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ed8c89a2f0 con 0x55ed8c87ba10 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13c57fa640 1 -- 172.21.15.19:0/3541216855 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13cc004770 con 0x55ed8c87ba10 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13c57fa640 1 -- 172.21.15.19:0/3541216855 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f13cc031c60 con 0x55ed8c87ba10 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 10 client.16722 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 10 client.16722 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 20 client.16722 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c89b640 0x55ed8c89da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 4 client.16722 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed8c7f3df0 con 0x55ed8c89b640 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.208+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c89b640 0x55ed8c89da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.209+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c89b640 0x55ed8c89da30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5fab3b3546cce6b2 server_cookie=7537fb1e07b0b127 in_seq=0 out_seq=0 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.209+0000 7f13c57fa640 10 client.16722 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.209+0000 7f13c57fa640 1 -- 172.21.15.19:0/3541216855 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ed8c7f3df0 con 0x55ed8c89b640 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.209+0000 7f13c57fa640 10 client.16722 handle_command_reply: tid=0 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 client.16722 shutdown 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87ba10 msgr2=0x55ed8c888b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87ba10 0x55ed8c888b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f13cc02aa00 tx=0x7f13cc004b50 comp rx=0 tx=0).stop 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 shutdown_connections 2024-09-11T00:12:18.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c89b640 0x55ed8c89da30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8890c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87ba10 0x55ed8c888b00 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13c57fa640 0 client.16722 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 --2- 172.21.15.19:0/3541216855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c87b0f0 0x55ed8c88b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 >> 172.21.15.19:0/3541216855 conn(0x55ed8c878f20 msgr2=0x55ed8c87ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 shutdown_connections 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 1 -- 172.21.15.19:0/3541216855 wait complete. 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.210+0000 7f13e610e740 20 client.16722 trim_cache size 0 max 16384 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.223+0000 7f13e610e740 1 Processor -- start 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e610e740 1 -- start start 2024-09-11T00:12:18.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e610e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e610e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c8a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e610e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e610e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1aecb0 con 0x55ed8c87b0f0 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e610e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1ac550 con 0x55ed8c87ba10 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e610e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1aa3c0 con 0x55ed8c88bdb0 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49078/0 (socket says 172.21.15.19:49078) 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 -- 172.21.15.19:0/801223395 learned_addr learned my addr 172.21.15.19:0/801223395 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e22d6640 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 -- 172.21.15.19:0/801223395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 msgr2=0x55ed8c8a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8a0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e12d4640 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c8a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 -- 172.21.15.19:0/801223395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 msgr2=0x55ed8c8a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c8a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 -- 172.21.15.19:0/801223395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8c88e940 con 0x55ed8c87b0f0 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e12d4640 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c8a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87a4d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ac4a0 tx=0x7f13d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18731adb780470ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13c77fe640 1 -- 172.21.15.19:0/801223395 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d80b53e0 con 0x55ed8c87b0f0 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13c77fe640 1 -- 172.21.15.19:0/801223395 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13d80ac020 con 0x55ed8c87b0f0 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.224+0000 7f13c77fe640 1 -- 172.21.15.19:0/801223395 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d80e3a60 con 0x55ed8c87b0f0 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 -- 172.21.15.19:0/801223395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 msgr2=0x55ed8c87a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87a4d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ac4a0 tx=0x7f13d8000bc0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 -- 172.21.15.19:0/801223395 shutdown_connections 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c8a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c8a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 --2- 172.21.15.19:0/801223395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c87a4d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 -- 172.21.15.19:0/801223395 >> 172.21.15.19:0/801223395 conn(0x55ed8c878f20 msgr2=0x55ed8c879dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 -- 172.21.15.19:0/801223395 shutdown_connections 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 -- 172.21.15.19:0/801223395 wait complete. 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 -- start start 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.225+0000 7f13e610e740 1 Processor -- start 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e610e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c89f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e610e740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c89f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e610e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c9011f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e610e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1aaa10 con 0x55ed8c87b0f0 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e610e740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1abe80 con 0x55ed8c87ba10 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e610e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1ab0e0 con 0x55ed8c88bdb0 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e610e740 10 client.0 _ll_register_callbacks cb 0x7f13d40096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e1ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c89f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e1ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c89f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49082/0 (socket says 172.21.15.19:49082) 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e1ad5640 1 -- 172.21.15.19:0/1661224752 learned_addr learned my addr 172.21.15.19:0/1661224752 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.226+0000 7f13e12d4640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c89f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e22d6640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c9011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e1ad5640 1 -- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 msgr2=0x55ed8c9011f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c9011f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e1ad5640 1 -- 172.21.15.19:0/1661224752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 msgr2=0x55ed8c89f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c89f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e1ad5640 1 -- 172.21.15.19:0/1661224752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8c881250 con 0x55ed8c87b0f0 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e12d4640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c89f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e1ad5640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c89f410 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007590 tx=0x7f13d800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554ed0ecfdb3099c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13c57fa640 1 -- 172.21.15.19:0/1661224752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d80ac510 con 0x55ed8c87b0f0 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13c57fa640 1 -- 172.21.15.19:0/1661224752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f13d80a8780 con 0x55ed8c87b0f0 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13d80ac020 con 0x55ed8c87b0f0 2024-09-11T00:12:18.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13c57fa640 1 -- 172.21.15.19:0/1661224752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f13d80acc10 con 0x55ed8c87b0f0 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e610e740 10 client.16728 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ed8c881420 con 0x55ed8c87b0f0 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.227+0000 7f13c57fa640 1 -- 172.21.15.19:0/1661224752 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13d80ac020 con 0x55ed8c87b0f0 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13c57fa640 1 -- 172.21.15.19:0/1661224752 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f13d80b5610 con 0x55ed8c87b0f0 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e610e740 10 client.16728 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e610e740 10 client.16728 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e610e740 20 client.16728 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e610e740 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c881b20 0x55ed8c883f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e610e740 4 client.16728 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:12:18.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed8c7ef8a0 con 0x55ed8c881b20 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e12d4640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c881b20 0x55ed8c883f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13c57fa640 10 client.16728 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e12d4640 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c881b20 0x55ed8c883f40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17c18b53e83e9c4d server_cookie=45fb65365f7731fd in_seq=0 out_seq=0 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13c57fa640 1 -- 172.21.15.19:0/1661224752 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed8c7ef8a0 con 0x55ed8c881b20 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13c57fa640 10 client.16728 handle_command_reply: tid=0 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.228+0000 7f13e610e740 1 client.16728 shutdown 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 msgr2=0x55ed8c89f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c89f410 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007590 tx=0x7f13d800cf10 comp rx=0 tx=0).stop 2024-09-11T00:12:18.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 shutdown_connections 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55ed8c881b20 0x55ed8c883f40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8c88bdb0 0x55ed8c9011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8c87ba10 0x55ed8c89f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13c57fa640 0 client.16728 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 --2- 172.21.15.19:0/1661224752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ed8c87b0f0 0x55ed8c89f410 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 >> 172.21.15.19:0/1661224752 conn(0x55ed8c878f20 msgr2=0x55ed8c88a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 shutdown_connections 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 1 -- 172.21.15.19:0/1661224752 wait complete. 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e610e740 20 client.16728 trim_cache size 0 max 16384 2024-09-11T00:12:18.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f13c80b54d0 msgr2=0x7f13c80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.229+0000 7f13e3d39640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f13c80b54d0 0x7f13c80b7990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f13d4005fd0 tx=0x7f13d4009800 comp rx=0 tx=0).stop 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc101c90 msgr2=0x7f13dc199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc101c90 0x7f13dc199240 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c920 tx=0x7f13d800cde0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 shutdown_connections 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc108020 0x7f13dc19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc1076a0 0x7f13dc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f13c80b54d0 0x7f13c80b7990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 --2- 172.21.15.19:0/3921441083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13dc101c90 0x7f13dc199240 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 >> 172.21.15.19:0/3921441083 conn(0x7f13dc0fd700 msgr2=0x7f13dc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 shutdown_connections 2024-09-11T00:12:18.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:18.230+0000 7f13e3d39640 1 -- 172.21.15.19:0/3921441083 wait complete. 2024-09-11T00:12:18.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:17 smithi135 ceph-mon[35432]: pgmap v625: 97 pgs: 21 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 65 active+clean; 830 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:19.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:12:20.213 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:20.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:19 smithi019 ceph-mon[30859]: pgmap v626: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:20.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:19 smithi131 ceph-mon[35491]: pgmap v626: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:20.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:19 smithi135 ceph-mon[35432]: pgmap v626: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:20.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 -- 172.21.15.19:0/2821515825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7388101cb0 msgr2=0x7f7388102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 --2- 172.21.15.19:0/2821515825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7388101cb0 0x7f7388102090 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7384009900 tx=0x7f738402a410 comp rx=0 tx=0).stop 2024-09-11T00:12:20.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 -- 172.21.15.19:0/2821515825 shutdown_connections 2024-09-11T00:12:20.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 --2- 172.21.15.19:0/2821515825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7388108040 0x7f738810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 --2- 172.21.15.19:0/2821515825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73881076c0 0x7f7388107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 --2- 172.21.15.19:0/2821515825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7388101cb0 0x7f7388102090 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 -- 172.21.15.19:0/2821515825 >> 172.21.15.19:0/2821515825 conn(0x7f73880fd700 msgr2=0x7f73880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 -- 172.21.15.19:0/2821515825 shutdown_connections 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 -- 172.21.15.19:0/2821515825 wait complete. 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.711+0000 7f738fe71640 1 Processor -- start 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738fe71640 1 -- start start 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738fe71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7388101cb0 0x7f738819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738fe71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73881076c0 0x7f738819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738fe71640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7388108040 0x7f73881a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738fe71640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7388111d00 con 0x7f73881076c0 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738fe71640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7388111b80 con 0x7f7388108040 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738fe71640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7388111e80 con 0x7f7388101cb0 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73881076c0 0x7f738819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73881076c0 0x7f738819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49104/0 (socket says 172.21.15.19:49104) 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 -- 172.21.15.19:0/3111779991 learned_addr learned my addr 172.21.15.19:0/3111779991 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738dc0d640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7388101cb0 0x7f738819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738e40e640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7388108040 0x7f73881a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 -- 172.21.15.19:0/3111779991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7388101cb0 msgr2=0x7f738819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7388101cb0 0x7f738819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 -- 172.21.15.19:0/3111779991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7388108040 msgr2=0x7f73881a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7388108040 0x7f73881a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 -- 172.21.15.19:0/3111779991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73881a1560 con 0x7f73881076c0 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738e40e640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7388108040 0x7f73881a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.712+0000 7f738d40c640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73881076c0 0x7f738819b9f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f737800d950 tx=0x7f737800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.713+0000 7f737effd640 1 -- 172.21.15.19:0/3111779991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378017070 con 0x7f73881076c0 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.713+0000 7f737effd640 1 -- 172.21.15.19:0/3111779991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7378009c30 con 0x7f73881076c0 2024-09-11T00:12:20.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.713+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73881a1850 con 0x7f73881076c0 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.713+0000 7f737effd640 1 -- 172.21.15.19:0/3111779991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737800f620 con 0x7f73881076c0 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.713+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73881a7f90 con 0x7f73881076c0 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.715+0000 7f7392246740 1 Processor -- start 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.715+0000 7f7392246740 1 -- start start 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.715+0000 7f737effd640 1 -- 172.21.15.19:0/3111779991 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f7378010460 con 0x7f73881076c0 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f7392246740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef9518b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f7392246740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef95d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f7392246740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef960170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f7392246740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605ef8c7ea0 con 0x5605ef95dd80 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f7392246740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5605ef8b72d0 con 0x5605ef9514d0 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f7392246740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605ef8bb0e0 con 0x5605ef951df0 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef960170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef960170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49106/0 (socket says 172.21.15.19:49106) 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 -- 172.21.15.19:0/2795966295 learned_addr learned my addr 172.21.15.19:0/2795966295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738dc0d640 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef95d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738e40e640 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef9518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 -- 172.21.15.19:0/2795966295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 msgr2=0x5605ef95d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef95d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 -- 172.21.15.19:0/2795966295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 msgr2=0x5605ef9518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef9518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 -- 172.21.15.19:0/2795966295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ef615650 con 0x5605ef95dd80 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.716+0000 7f738d40c640 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef960170 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f73780e3340 tx=0x7f73780ee7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a76f2010473cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f737effd640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73740b5450 0x7f73740b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7373fff640 1 -- 172.21.15.19:0/2795966295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780ec860 con 0x5605ef95dd80 2024-09-11T00:12:20.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7373fff640 1 -- 172.21.15.19:0/2795966295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73780f3070 con 0x5605ef95dd80 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7373fff640 1 -- 172.21.15.19:0/2795966295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780ab870 con 0x5605ef95dd80 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f738e40e640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73740b5450 0x7f73740b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f737effd640 1 -- 172.21.15.19:0/3111779991 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f73780e5c60 con 0x7f73881076c0 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7392246740 1 -- 172.21.15.19:0/2795966295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 msgr2=0x5605ef960170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f738e40e640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73740b5450 0x7f73740b7910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f738000f4c0 tx=0x7f7380007740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7392246740 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef960170 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f73780e3340 tx=0x7f73780ee7a0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7392246740 1 -- 172.21.15.19:0/2795966295 shutdown_connections 2024-09-11T00:12:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7392246740 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef960170 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7392246740 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef95d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7392246740 1 --2- 172.21.15.19:0/2795966295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef9518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.717+0000 7f7392246740 1 -- 172.21.15.19:0/2795966295 >> 172.21.15.19:0/2795966295 conn(0x5605ef94f300 msgr2=0x5605ef9504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 -- 172.21.15.19:0/2795966295 shutdown_connections 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 -- 172.21.15.19:0/2795966295 wait complete. 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 -- start start 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 Processor -- start 2024-09-11T00:12:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef9514d0 0x5605ef95d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef951df0 0x5605ef95aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef95b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605ef718700 con 0x5605ef951df0 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5605ef852160 con 0x5605ef95dd80 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.718+0000 7f7392246740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605ef960a00 con 0x5605ef9514d0 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f7392246740 10 client.0 _ll_register_callbacks cb 0x5605ef86b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef951df0 0x5605ef95aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef951df0 0x5605ef95aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49118/0 (socket says 172.21.15.19:49118) 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 -- 172.21.15.19:0/2437578081 learned_addr learned my addr 172.21.15.19:0/2437578081 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738e40e640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef95b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738dc0d640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef9514d0 0x5605ef95d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 -- 172.21.15.19:0/2437578081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef9514d0 msgr2=0x5605ef95d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef9514d0 0x5605ef95d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 -- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 msgr2=0x5605ef95b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef95b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 -- 172.21.15.19:0/2437578081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ef87fc90 con 0x5605ef951df0 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738e40e640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef95b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f738d40c640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef951df0 0x5605ef95aaa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f73780abe00 tx=0x7f7378005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269eb0fcde710966 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f73717fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f73717fa640 1 -- 172.21.15.19:0/2437578081 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780d53c0 con 0x5605ef951df0 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f73717fa640 1 -- 172.21.15.19:0/2437578081 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f73780a8370 con 0x5605ef951df0 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73780f3070 con 0x5605ef951df0 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f73717fa640 1 -- 172.21.15.19:0/2437578081 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f73780d3880 con 0x5605ef951df0 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f7392246740 10 client.16740 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.719+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5605ef96c310 con 0x5605ef951df0 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f73717fa640 1 -- 172.21.15.19:0/2437578081 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73780f3070 con 0x5605ef951df0 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f73717fa640 1 -- 172.21.15.19:0/2437578081 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f73780ac360 con 0x5605ef951df0 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f7392246740 10 client.16740 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f7392246740 10 client.16740 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f7392246740 20 client.16740 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f7392246740 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef96d660 0x5605ef96fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f7392246740 4 client.16740 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605ef8c9df0 con 0x5605ef96d660 2024-09-11T00:12:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.720+0000 7f738dc0d640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef96d660 0x5605ef96fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.721+0000 7f738dc0d640 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef96d660 0x5605ef96fa50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4fae4f733b4a378 server_cookie=612fa532f9504407 in_seq=0 out_seq=0 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.721+0000 7f73717fa640 10 client.16740 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.721+0000 7f73717fa640 1 -- 172.21.15.19:0/2437578081 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605ef8c9df0 con 0x5605ef96d660 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.721+0000 7f73717fa640 10 client.16740 handle_command_reply: tid=0 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.721+0000 7f7392246740 1 client.16740 shutdown 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef951df0 msgr2=0x5605ef95aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef951df0 0x5605ef95aaa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f73780abe00 tx=0x7f7378005bb0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 shutdown_connections 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef96d660 0x5605ef96fa50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef95b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef951df0 0x5605ef95aaa0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 --2- 172.21.15.19:0/2437578081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef9514d0 0x5605ef95d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 >> 172.21.15.19:0/2437578081 conn(0x5605ef94f300 msgr2=0x5605ef954e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f73717fa640 0 client.16740 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 shutdown_connections 2024-09-11T00:12:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 1 -- 172.21.15.19:0/2437578081 wait complete. 2024-09-11T00:12:20.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.722+0000 7f7392246740 20 client.16740 trim_cache size 0 max 16384 2024-09-11T00:12:20.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.735+0000 7f7392246740 1 Processor -- start 2024-09-11T00:12:20.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.735+0000 7f7392246740 1 -- start start 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f7392246740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef969ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f7392246740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef94e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f7392246740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef95f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f7392246740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f73881b3110 con 0x5605ef95dd80 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f7392246740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f73881b09b0 con 0x5605ef9514d0 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f7392246740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73881ae820 con 0x5605ef951df0 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef95f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef95f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49130/0 (socket says 172.21.15.19:49130) 2024-09-11T00:12:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 -- 172.21.15.19:0/434418638 learned_addr learned my addr 172.21.15.19:0/434418638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738d40c640 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef94e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738dc0d640 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef969ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 -- 172.21.15.19:0/434418638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 msgr2=0x5605ef94e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef94e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 -- 172.21.15.19:0/434418638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 msgr2=0x5605ef969ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef969ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 -- 172.21.15.19:0/434418638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ef95a850 con 0x5605ef95dd80 2024-09-11T00:12:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738dc0d640 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef969ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.736+0000 7f738e40e640 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef95f170 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7380010960 tx=0x7f7380012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c052c16370e4e561 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f73737fe640 1 -- 172.21.15.19:0/434418638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738001db40 con 0x5605ef95dd80 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f73737fe640 1 -- 172.21.15.19:0/434418638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f738001dce0 con 0x5605ef95dd80 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f73737fe640 1 -- 172.21.15.19:0/434418638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380026630 con 0x5605ef95dd80 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 -- 172.21.15.19:0/434418638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 msgr2=0x5605ef95f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef95f170 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7380010960 tx=0x7f7380012000 comp rx=0 tx=0).stop 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 -- 172.21.15.19:0/434418638 shutdown_connections 2024-09-11T00:12:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef95dd80 0x5605ef95f170 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef94e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 --2- 172.21.15.19:0/434418638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef9514d0 0x5605ef969ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 -- 172.21.15.19:0/434418638 >> 172.21.15.19:0/434418638 conn(0x5605ef94f300 msgr2=0x5605ef94dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 -- 172.21.15.19:0/434418638 shutdown_connections 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.737+0000 7f7392246740 1 -- 172.21.15.19:0/434418638 wait complete. 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 -- start start 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 Processor -- start 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef9514d0 0x5605ef973280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef96f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef96fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f73881aee70 con 0x5605ef9514d0 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f73881b02e0 con 0x5605ef95dd80 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73881af540 con 0x5605ef951df0 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f7392246740 10 client.0 _ll_register_callbacks cb 0x7f73800075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f738dc0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef9514d0 0x5605ef973280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f738dc0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef9514d0 0x5605ef973280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49134/0 (socket says 172.21.15.19:49134) 2024-09-11T00:12:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.738+0000 7f738dc0d640 1 -- 172.21.15.19:0/1408982568 learned_addr learned my addr 172.21.15.19:0/1408982568 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738e40e640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef96fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738d40c640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef96f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738dc0d640 1 -- 172.21.15.19:0/1408982568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 msgr2=0x5605ef96f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738dc0d640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef96f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738dc0d640 1 -- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 msgr2=0x5605ef96fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738dc0d640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef96fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738dc0d640 1 -- 172.21.15.19:0/1408982568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ef970530 con 0x5605ef9514d0 2024-09-11T00:12:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738e40e640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef96fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f738dc0d640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef9514d0 0x5605ef973280 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7384005ab0 tx=0x7f7384004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94583bf80881d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f73717fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f73717fa640 1 -- 172.21.15.19:0/1408982568 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384035040 con 0x5605ef9514d0 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f73717fa640 1 -- 172.21.15.19:0/1408982568 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f7384005240 con 0x5605ef9514d0 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f738001dce0 con 0x5605ef9514d0 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f73717fa640 1 -- 172.21.15.19:0/1408982568 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f7384053050 con 0x5605ef9514d0 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f7392246740 10 client.16746 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.739+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5605ef9db210 con 0x5605ef9514d0 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f73717fa640 1 -- 172.21.15.19:0/1408982568 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f738001dce0 con 0x5605ef9514d0 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f73717fa640 1 -- 172.21.15.19:0/1408982568 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f73840035f0 con 0x5605ef9514d0 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f7392246740 10 client.16746 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f7392246740 10 client.16746 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f7392246740 20 client.16746 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f7392246740 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef9db990 0x5605ef9dddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f7392246740 4 client.16746 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:12:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605ef8c58a0 con 0x5605ef9db990 2024-09-11T00:12:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.740+0000 7f738d40c640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef9db990 0x5605ef9dddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f738d40c640 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef9db990 0x5605ef9dddb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7717ed32ab4d6c26 server_cookie=26b4d72f3a63eb96 in_seq=0 out_seq=0 2024-09-11T00:12:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f73717fa640 10 client.16746 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:12:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f73717fa640 1 -- 172.21.15.19:0/1408982568 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605ef8c58a0 con 0x5605ef9db990 2024-09-11T00:12:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f73717fa640 10 client.16746 handle_command_reply: tid=0 2024-09-11T00:12:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 client.16746 shutdown 2024-09-11T00:12:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef9514d0 msgr2=0x5605ef973280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef9514d0 0x5605ef973280 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7384005ab0 tx=0x7f7384004060 comp rx=0 tx=0).stop 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 shutdown_connections 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x5605ef9db990 0x5605ef9dddb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605ef95dd80 0x5605ef96fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605ef951df0 0x5605ef96f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f73717fa640 0 client.16746 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 --2- 172.21.15.19:0/1408982568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605ef9514d0 0x5605ef973280 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 >> 172.21.15.19:0/1408982568 conn(0x5605ef94f300 msgr2=0x5605ef95c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:20.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 shutdown_connections 2024-09-11T00:12:20.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 1 -- 172.21.15.19:0/1408982568 wait complete. 2024-09-11T00:12:20.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.741+0000 7f7392246740 20 client.16746 trim_cache size 0 max 16384 2024-09-11T00:12:20.772 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:12:20.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73740b5450 msgr2=0x7f73740b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73740b5450 0x7f73740b7910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f738000f4c0 tx=0x7f7380007740 comp rx=0 tx=0).stop 2024-09-11T00:12:20.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73881076c0 msgr2=0x7f738819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73881076c0 0x7f738819b9f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f737800d950 tx=0x7f737800de10 comp rx=0 tx=0).stop 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 shutdown_connections 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7388108040 0x7f73881a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f73740b5450 0x7f73740b7910 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73881076c0 0x7f738819b9f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 --2- 172.21.15.19:0/3111779991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7388101cb0 0x7f738819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 >> 172.21.15.19:0/3111779991 conn(0x7f73880fd700 msgr2=0x7f738806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:20.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 shutdown_connections 2024-09-11T00:12:20.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:20.742+0000 7f738fe71640 1 -- 172.21.15.19:0/3111779991 wait complete. 2024-09-11T00:12:21.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:12:21.779 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:22.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:21 smithi019 ceph-mon[30859]: pgmap v627: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:22.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:21 smithi131 ceph-mon[35491]: pgmap v627: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:22.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:21 smithi135 ceph-mon[35432]: pgmap v627: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:12:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 -- 172.21.15.19:0/1446485577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c108020 msgr2=0x7f963c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 --2- 172.21.15.19:0/1446485577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c108020 0x7f963c10e820 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9634009ca0 tx=0x7f963402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 -- 172.21.15.19:0/1446485577 shutdown_connections 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 --2- 172.21.15.19:0/1446485577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c108020 0x7f963c10e820 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 --2- 172.21.15.19:0/1446485577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f963c1076a0 0x7f963c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 --2- 172.21.15.19:0/1446485577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f963c101c90 0x7f963c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 -- 172.21.15.19:0/1446485577 >> 172.21.15.19:0/1446485577 conn(0x7f963c0fd700 msgr2=0x7f963c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 -- 172.21.15.19:0/1446485577 shutdown_connections 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.684+0000 7f9640cb3640 1 -- 172.21.15.19:0/1446485577 wait complete. 2024-09-11T00:12:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 Processor -- start 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 -- start start 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f963c101c90 0x7f963c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c1076a0 0x7f963c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f963c108020 0x7f963c1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f963c111ca0 con 0x7f963c1076a0 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f963c111b20 con 0x7f963c101c90 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9640cb3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f963c111e20 con 0x7f963c108020 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9639d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c1076a0 0x7f963c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9639d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c1076a0 0x7f963c19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43120/0 (socket says 172.21.15.19:43120) 2024-09-11T00:12:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f9639d9b640 1 -- 172.21.15.19:0/2561384450 learned_addr learned my addr 172.21.15.19:0/2561384450 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.685+0000 7f963a59c640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f963c101c90 0x7f963c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f963ad9d640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f963c108020 0x7f963c1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9639d9b640 1 -- 172.21.15.19:0/2561384450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f963c108020 msgr2=0x7f963c1a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9639d9b640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f963c108020 0x7f963c1a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9639d9b640 1 -- 172.21.15.19:0/2561384450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f963c101c90 msgr2=0x7f963c19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9639d9b640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f963c101c90 0x7f963c19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9639d9b640 1 -- 172.21.15.19:0/2561384450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c1a1570 con 0x7f963c1076a0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9639d9b640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c1076a0 0x7f963c19ba00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f963000e9f0 tx=0x7f963000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f962b7fe640 1 -- 172.21.15.19:0/2561384450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963000cd80 con 0x7f963c1076a0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f962b7fe640 1 -- 172.21.15.19:0/2561384450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96300108e0 con 0x7f963c1076a0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c1a1860 con 0x7f963c1076a0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f962b7fe640 1 -- 172.21.15.19:0/2561384450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630018980 con 0x7f963c1076a0 2024-09-11T00:12:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.686+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c1a7f20 con 0x7f963c1076a0 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 Processor -- start 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 -- start start 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f1420f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f142103460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f142105d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f14206dea0 con 0x55f1421039a0 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f14205d2d0 con 0x55f1420f7a10 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9643088740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f1420610e0 con 0x55f1420f70f0 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f962b7fe640 1 -- 172.21.15.19:0/2561384450 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f9630010430 con 0x7f963c1076a0 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f9639d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f142105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f963a59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f142103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f963a59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f142103460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.19:45092/0 (socket says 172.21.15.19:45092) 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f963a59c640 1 -- 172.21.15.19:0/2389691208 learned_addr learned my addr 172.21.15.19:0/2389691208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.689+0000 7f963ad9d640 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f1420f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f963a59c640 1 -- 172.21.15.19:0/2389691208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 msgr2=0x55f1420f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f963a59c640 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f1420f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f963a59c640 1 -- 172.21.15.19:0/2389691208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 msgr2=0x55f142105d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f963a59c640 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f142105d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f963a59c640 1 -- 172.21.15.19:0/2389691208 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f141dbb650 con 0x55f1420f7a10 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f963a59c640 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f142103460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f962c00bcd0 tx=0x7f962c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebfa2810b8d3ca75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f9628ff9640 1 -- 172.21.15.19:0/2389691208 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c005220 con 0x55f1420f7a10 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f962b7fe640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96240b5450 0x7f96240b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f9628ff9640 1 -- 172.21.15.19:0/2389691208 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f962c004c50 con 0x55f1420f7a10 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f9628ff9640 1 -- 172.21.15.19:0/2389691208 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0116a0 con 0x55f1420f7a10 2024-09-11T00:12:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f963ad9d640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96240b5450 0x7f96240b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.690+0000 7f962b7fe640 1 -- 172.21.15.19:0/2561384450 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f96300e62f0 con 0x7f963c1076a0 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 -- 172.21.15.19:0/2389691208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 msgr2=0x55f142103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f963ad9d640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96240b5450 0x7f96240b7910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9634005e30 tx=0x7f9634005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f142103460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f962c00bcd0 tx=0x7f962c0107a0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 -- 172.21.15.19:0/2389691208 shutdown_connections 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f142105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f142103460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 --2- 172.21.15.19:0/2389691208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f1420f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 -- 172.21.15.19:0/2389691208 >> 172.21.15.19:0/2389691208 conn(0x55f1420f4f20 msgr2=0x55f1420f60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 -- 172.21.15.19:0/2389691208 shutdown_connections 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 -- 172.21.15.19:0/2389691208 wait complete. 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 -- start start 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.691+0000 7f9643088740 1 Processor -- start 2024-09-11T00:12:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9643088740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1421031f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9643088740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f142100640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9643088740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f142100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9643088740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f141ebe700 con 0x55f1420f70f0 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9643088740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f141ff8160 con 0x55f1421039a0 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9643088740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f142106620 con 0x55f1420f7a10 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9643088740 10 client.0 _ll_register_callbacks cb 0x55f1420119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1421031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1421031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43138/0 (socket says 172.21.15.19:43138) 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 -- 172.21.15.19:0/1264875720 learned_addr learned my addr 172.21.15.19:0/1264875720 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9639d9b640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f142100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963ad9d640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f142100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 -- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 msgr2=0x55f142100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f142100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 -- 172.21.15.19:0/1264875720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 msgr2=0x55f142100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f142100ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 -- 172.21.15.19:0/1264875720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f142025c90 con 0x55f1420f70f0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9639d9b640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f142100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f963a59c640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1421031f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f962c00bca0 tx=0x7f962c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc168feb2a65b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.692+0000 7f9621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9621ffb640 1 -- 172.21.15.19:0/1264875720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c02a060 con 0x55f1420f70f0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9621ffb640 1 -- 172.21.15.19:0/1264875720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f962c005010 con 0x55f1420f70f0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f962c004c50 con 0x55f1420f70f0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9621ffb640 1 -- 172.21.15.19:0/1264875720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f962c00b8c0 con 0x55f1420f70f0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 10 client.16758 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f142111f10 con 0x55f1420f70f0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9621ffb640 1 -- 172.21.15.19:0/1264875720 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f962c004c50 con 0x55f1420f70f0 2024-09-11T00:12:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9621ffb640 1 -- 172.21.15.19:0/1264875720 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f962c011c60 con 0x55f1420f70f0 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 10 client.16758 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 20 client.16758 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142113310 0x55f142115700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 4 client.16758 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.693+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f14206fdf0 con 0x55f142113310 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.694+0000 7f9639d9b640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142113310 0x55f142115700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.694+0000 7f9639d9b640 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142113310 0x55f142115700 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6fe5a816dd9266b server_cookie=420710f0b3b74158 in_seq=0 out_seq=0 2024-09-11T00:12:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.694+0000 7f9621ffb640 10 client.16758 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9621ffb640 1 -- 172.21.15.19:0/1264875720 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f14206fdf0 con 0x55f142113310 2024-09-11T00:12:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9621ffb640 10 client.16758 handle_command_reply: tid=0 2024-09-11T00:12:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 client.16758 shutdown 2024-09-11T00:12:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 msgr2=0x55f1421031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1421031f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f962c00bca0 tx=0x7f962c0048f0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 shutdown_connections 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f142100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f142100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142113310 0x55f142115700 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 --2- 172.21.15.19:0/1264875720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1421031f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 >> 172.21.15.19:0/1264875720 conn(0x55f1420f4f20 msgr2=0x55f1420faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9621ffb640 0 client.16758 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 shutdown_connections 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 1 -- 172.21.15.19:0/1264875720 wait complete. 2024-09-11T00:12:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.695+0000 7f9643088740 20 client.16758 trim_cache size 0 max 16384 2024-09-11T00:12:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 Processor -- start 2024-09-11T00:12:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 -- start start 2024-09-11T00:12:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1420ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f1420feec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f1420ff400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f963c1b32b0 con 0x55f1420f70f0 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f963c1b0b50 con 0x55f1421039a0 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9643088740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f963c1ae9c0 con 0x55f1420f7a10 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1420ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1420ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43144/0 (socket says 172.21.15.19:43144) 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 -- 172.21.15.19:0/888290948 learned_addr learned my addr 172.21.15.19:0/888290948 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9639d9b640 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f1420feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963ad9d640 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f1420ff400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 -- 172.21.15.19:0/888290948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 msgr2=0x55f1420feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f1420feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 -- 172.21.15.19:0/888290948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 msgr2=0x55f1420ff400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f1420ff400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963a59c640 1 -- 172.21.15.19:0/888290948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1420f59a0 con 0x55f1420f70f0 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f9639d9b640 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f1420feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.709+0000 7f963ad9d640 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f1420ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f963a59c640 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1420ffb30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f962c000c00 tx=0x7f962c00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccae7d8474ae783e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9623fff640 1 -- 172.21.15.19:0/888290948 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c01f070 con 0x55f1420f70f0 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9623fff640 1 -- 172.21.15.19:0/888290948 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f962c00be80 con 0x55f1420f70f0 2024-09-11T00:12:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9623fff640 1 -- 172.21.15.19:0/888290948 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c02a070 con 0x55f1420f70f0 2024-09-11T00:12:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9643088740 1 -- 172.21.15.19:0/888290948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 msgr2=0x55f1420ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9643088740 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1420ffb30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f962c000c00 tx=0x7f962c00b820 comp rx=0 tx=0).stop 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9643088740 1 -- 172.21.15.19:0/888290948 shutdown_connections 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9643088740 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1421039a0 0x55f1420ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9643088740 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f7a10 0x55f1420feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9643088740 1 --2- 172.21.15.19:0/888290948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1420f70f0 0x55f1420ffb30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.710+0000 7f9643088740 1 -- 172.21.15.19:0/888290948 >> 172.21.15.19:0/888290948 conn(0x55f1420f4f20 msgr2=0x55f1420f5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 -- 172.21.15.19:0/888290948 shutdown_connections 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 -- 172.21.15.19:0/888290948 wait complete. 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 -- start start 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 Processor -- start 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f14210b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f14210be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f1421068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f963c1af010 con 0x55f1421039a0 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f963c1b0480 con 0x55f1420f7a10 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f963c1af6e0 con 0x55f1420f70f0 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9643088740 10 client.0 _ll_register_callbacks cb 0x7f96300e9d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f963ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f1421068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f963ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f1421068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43156/0 (socket says 172.21.15.19:43156) 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f9639d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f14210be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.711+0000 7f963ad9d640 1 -- 172.21.15.19:0/3131509579 learned_addr learned my addr 172.21.15.19:0/3131509579 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f963a59c640 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f14210b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f963ad9d640 1 -- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 msgr2=0x55f14210b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f963ad9d640 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f14210b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f963ad9d640 1 -- 172.21.15.19:0/3131509579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 msgr2=0x55f14210be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f963ad9d640 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f14210be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f963ad9d640 1 -- 172.21.15.19:0/3131509579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f14210c550 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f9639d9b640 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f14210be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f963ad9d640 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f1421068d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9634035000 tx=0x7f963402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9816025339c7b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f9621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f9621ffb640 1 -- 172.21.15.19:0/3131509579 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634057060 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f9621ffb640 1 -- 172.21.15.19:0/3131509579 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8485+0+0 (secure 0 0 0) 0x7f9634042030 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f14206b8a0 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f9621ffb640 1 -- 172.21.15.19:0/3131509579 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f963402f9f0 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.712+0000 7f9643088740 10 client.16764 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f1421802f0 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9621ffb640 1 -- 172.21.15.19:0/3131509579 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f14206b8a0 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9621ffb640 1 -- 172.21.15.19:0/3131509579 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f9634030d30 con 0x55f1421039a0 2024-09-11T00:12:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9643088740 10 client.16764 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9643088740 10 client.16764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9643088740 20 client.16764 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9643088740 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142180ad0 0x55f142182ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9643088740 4 client.16764 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f142068cd0 con 0x55f142180ad0 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.713+0000 7f963a59c640 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142180ad0 0x55f142182ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f963a59c640 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142180ad0 0x55f142182ef0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7434be2494c54ae server_cookie=b69dd7830eeb1d60 in_seq=0 out_seq=0 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9621ffb640 10 client.16764 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9621ffb640 1 -- 172.21.15.19:0/3131509579 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f142068cd0 con 0x55f142180ad0 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9621ffb640 10 client.16764 handle_command_reply: tid=0 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 client.16764 shutdown 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 msgr2=0x55f1421068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f1421068d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9634035000 tx=0x7f963402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 shutdown_connections 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55f142180ad0 0x55f142182ef0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f1421039a0 0x55f1421068d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1420f7a10 0x55f14210be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 --2- 172.21.15.19:0/3131509579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1420f70f0 0x55f14210b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 >> 172.21.15.19:0/3131509579 conn(0x55f1420f4f20 msgr2=0x55f1420fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9621ffb640 0 client.16764 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 shutdown_connections 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.714+0000 7f9643088740 1 -- 172.21.15.19:0/3131509579 wait complete. 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9643088740 20 client.16764 trim_cache size 0 max 16384 2024-09-11T00:12:22.721 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:12:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96240b5450 msgr2=0x7f96240b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96240b5450 0x7f96240b7910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9634005e30 tx=0x7f9634005c30 comp rx=0 tx=0).stop 2024-09-11T00:12:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c1076a0 msgr2=0x7f963c19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c1076a0 0x7f963c19ba00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f963000e9f0 tx=0x7f963000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 shutdown_connections 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f963c108020 0x7f963c1a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f96240b5450 0x7f96240b7910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f963c1076a0 0x7f963c19ba00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 --2- 172.21.15.19:0/2561384450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f963c101c90 0x7f963c19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 >> 172.21.15.19:0/2561384450 conn(0x7f963c0fd700 msgr2=0x7f963c06aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 shutdown_connections 2024-09-11T00:12:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:22.715+0000 7f9640cb3640 1 -- 172.21.15.19:0/2561384450 wait complete. 2024-09-11T00:12:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:23 smithi019 ceph-mon[30859]: pgmap v628: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 174 B/s wr, 6 op/s 2024-09-11T00:12:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:23 smithi019 ceph-mon[30859]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T00:12:24.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:23 smithi131 ceph-mon[35491]: pgmap v628: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 174 B/s wr, 6 op/s 2024-09-11T00:12:24.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:23 smithi131 ceph-mon[35491]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T00:12:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:23 smithi135 ceph-mon[35432]: pgmap v628: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 174 B/s wr, 6 op/s 2024-09-11T00:12:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:23 smithi135 ceph-mon[35432]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T00:12:24.838 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:12:24.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:12:25.110 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 -- 172.21.15.19:0/3286045631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 msgr2=0x7faa5010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 --2- 172.21.15.19:0/3286045631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5010f950 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7faa48009ca0 tx=0x7faa4802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 -- 172.21.15.19:0/3286045631 shutdown_connections 2024-09-11T00:12:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 --2- 172.21.15.19:0/3286045631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5010f950 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 --2- 172.21.15.19:0/3286045631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa501087d0 0x7faa50108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 --2- 172.21.15.19:0/3286045631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50102dc0 0x7faa501031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 -- 172.21.15.19:0/3286045631 >> 172.21.15.19:0/3286045631 conn(0x7faa500fe830 msgr2=0x7faa50100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 -- 172.21.15.19:0/3286045631 shutdown_connections 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 -- 172.21.15.19:0/3286045631 wait complete. 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 Processor -- start 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.755+0000 7faa5635b640 1 -- start start 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa5635b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50102dc0 0x7faa501991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa5635b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa501087d0 0x7faa50199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa5635b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa5635b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faa50112e10 con 0x7faa50109150 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa5635b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa50112c90 con 0x7faa501087d0 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa5635b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa50112f90 con 0x7faa50102dc0 2024-09-11T00:12:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5019eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43166/0 (socket says 172.21.15.19:43166) 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 -- 172.21.15.19:0/2099721045 learned_addr learned my addr 172.21.15.19:0/2099721045 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa4ffff640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50102dc0 0x7faa501991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa501087d0 0x7faa50199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 -- 172.21.15.19:0/2099721045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50102dc0 msgr2=0x7faa501991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50102dc0 0x7faa501991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 -- 172.21.15.19:0/2099721045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa501087d0 msgr2=0x7faa50199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa501087d0 0x7faa50199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa548f8640 1 -- 172.21.15.19:0/2099721045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5019f290 con 0x7faa50109150 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.756+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa501087d0 0x7faa50199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.757+0000 7faa548f8640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5019eac0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faa48005cc0 tx=0x7faa4802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.757+0000 7faa4d7fa640 1 -- 172.21.15.19:0/2099721045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48003cf0 con 0x7faa50109150 2024-09-11T00:12:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.757+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5019f520 con 0x7faa50109150 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.757+0000 7faa4d7fa640 1 -- 172.21.15.19:0/2099721045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa480044f0 con 0x7faa50109150 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.757+0000 7faa4d7fa640 1 -- 172.21.15.19:0/2099721045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4802fc30 con 0x7faa50109150 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.757+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa501a5cc0 con 0x7faa50109150 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.759+0000 7faa58730740 1 Processor -- start 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4d7fa640 1 -- 172.21.15.19:0/2099721045 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7faa48004040 con 0x7faa50109150 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa58730740 1 -- start start 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa58730740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa58730740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa58730740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171eaa1790 0x56171eaa3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa58730740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56171ea0be60 con 0x56171eaa1790 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa58730740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56171e9fb290 con 0x56171ea94ee0 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa58730740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56171e9ff0a0 con 0x56171ea95800 2024-09-11T00:12:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171eaa1790 0x56171eaa3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171eaa1790 0x56171eaa3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43168/0 (socket says 172.21.15.19:43168) 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 -- 172.21.15.19:0/535116833 learned_addr learned my addr 172.21.15.19:0/535116833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4ffff640 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 -- 172.21.15.19:0/535116833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 msgr2=0x56171eaa1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 -- 172.21.15.19:0/535116833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 msgr2=0x56171ea952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4f7fe640 1 -- 172.21.15.19:0/535116833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171e759930 con 0x56171eaa1790 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.760+0000 7faa4d7fa640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faa380b5450 0x7faa380b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.761+0000 7faa4ffff640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faa380b5450 0x7faa380b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.761+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171eaa1790 0x56171eaa3b80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faa44008fd0 tx=0x7faa44008620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775bddd68314a62e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.761+0000 7faa4d7fa640 1 -- 172.21.15.19:0/2099721045 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7faa48107480 con 0x7faa50109150 2024-09-11T00:12:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.761+0000 7faa367fc640 1 -- 172.21.15.19:0/535116833 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44018030 con 0x56171eaa1790 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.761+0000 7faa367fc640 1 -- 172.21.15.19:0/535116833 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa44010af0 con 0x56171eaa1790 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.761+0000 7faa367fc640 1 -- 172.21.15.19:0/535116833 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4401c9c0 con 0x56171eaa1790 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 -- 172.21.15.19:0/535116833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171eaa1790 msgr2=0x56171eaa3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171eaa1790 0x56171eaa3b80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faa44008fd0 tx=0x7faa44008620 comp rx=0 tx=0).stop 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa4ffff640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faa380b5450 0x7faa380b7910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x56171ea98060 tx=0x7faa40009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 -- 172.21.15.19:0/535116833 shutdown_connections 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171eaa1790 0x56171eaa3b80 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 --2- 172.21.15.19:0/535116833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 -- 172.21.15.19:0/535116833 >> 172.21.15.19:0/535116833 conn(0x56171ea92d10 msgr2=0x56171ea93eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 -- 172.21.15.19:0/535116833 shutdown_connections 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 -- 172.21.15.19:0/535116833 wait complete. 2024-09-11T00:12:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 -- start start 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.762+0000 7faa58730740 1 Processor -- start 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea94ee0 0x56171ea9e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea95800 0x56171ea9ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171eaa1790 0x56171ea9f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56171e85c890 con 0x56171ea94ee0 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56171e995d40 con 0x56171ea95800 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56171eaa4440 con 0x56171eaa1790 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 10 client.0 _ll_register_callbacks cb 0x56171e9f9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea94ee0 0x56171ea9e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea94ee0 0x56171ea9e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43170/0 (socket says 172.21.15.19:43170) 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 -- 172.21.15.19:0/403902166 learned_addr learned my addr 172.21.15.19:0/403902166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa548f8640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171eaa1790 0x56171ea9f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea95800 0x56171ea9ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 -- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171eaa1790 msgr2=0x56171ea9f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171eaa1790 0x56171ea9f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 -- 172.21.15.19:0/403902166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea95800 msgr2=0x56171ea9ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea95800 0x56171ea9ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 -- 172.21.15.19:0/403902166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171eaad840 con 0x56171ea94ee0 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa548f8640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171eaa1790 0x56171ea9f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea95800 0x56171ea9ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa4ffff640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea94ee0 0x56171ea9e770 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7faa40014a20 tx=0x7faa400047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0d83511c1cc297 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa2f7fe640 1 -- 172.21.15.19:0/403902166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40025070 con 0x56171ea94ee0 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa2f7fe640 1 -- 172.21.15.19:0/403902166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7faa40021600 con 0x56171ea94ee0 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.763+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa44010af0 con 0x56171ea94ee0 2024-09-11T00:12:25.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa2f7fe640 1 -- 172.21.15.19:0/403902166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7faa40031050 con 0x56171ea94ee0 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 10 client.16776 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56171eab0250 con 0x56171ea94ee0 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa2f7fe640 1 -- 172.21.15.19:0/403902166 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa44010af0 con 0x56171ea94ee0 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa2f7fe640 1 -- 172.21.15.19:0/403902166 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7faa40020070 con 0x56171ea94ee0 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 10 client.16776 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 20 client.16776 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eab1750 0x56171eab3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 4 client.16776 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56171ea0ddb0 con 0x56171eab1750 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.764+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eab1750 0x56171eab3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.765+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eab1750 0x56171eab3bd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363c05d7e457f35e server_cookie=9417d3548009b760 in_seq=0 out_seq=0 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.765+0000 7faa2f7fe640 10 client.16776 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:25.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa2f7fe640 1 -- 172.21.15.19:0/403902166 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56171ea0ddb0 con 0x56171eab1750 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa2f7fe640 10 client.16776 handle_command_reply: tid=0 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 client.16776 shutdown 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea94ee0 msgr2=0x56171ea9e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea94ee0 0x56171ea9e770 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7faa40014a20 tx=0x7faa400047d0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 shutdown_connections 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171eaa1790 0x56171ea9f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea95800 0x56171ea9ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eab1750 0x56171eab3bd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 --2- 172.21.15.19:0/403902166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea94ee0 0x56171ea9e770 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 >> 172.21.15.19:0/403902166 conn(0x56171ea92d10 msgr2=0x56171ea91f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa2f7fe640 0 client.16776 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 shutdown_connections 2024-09-11T00:12:25.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 1 -- 172.21.15.19:0/403902166 wait complete. 2024-09-11T00:12:25.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.766+0000 7faa58730740 20 client.16776 trim_cache size 0 max 16384 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 Processor -- start 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 -- start start 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea9b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171ea9bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faa501b0de0 con 0x56171ea92d10 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa501ae680 con 0x56171ea94ee0 2024-09-11T00:12:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa58730740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa501ac4f0 con 0x56171ea95800 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43172/0 (socket says 172.21.15.19:43172) 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4ffff640 1 -- 172.21.15.19:0/327376552 learned_addr learned my addr 172.21.15.19:0/327376552 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea9b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4ffff640 1 -- 172.21.15.19:0/327376552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 msgr2=0x56171ea9bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4ffff640 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171ea9bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4ffff640 1 -- 172.21.15.19:0/327376552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 msgr2=0x56171ea9b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.784+0000 7faa4ffff640 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea9b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.785+0000 7faa4ffff640 1 -- 172.21.15.19:0/327376552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171ea92b40 con 0x56171ea92d10 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.785+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea9b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.785+0000 7faa4ffff640 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa04b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7faa40016040 tx=0x7faa400146d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d1f6087599dc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.785+0000 7faa35ffb640 1 -- 172.21.15.19:0/327376552 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40025040 con 0x56171ea92d10 2024-09-11T00:12:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.785+0000 7faa35ffb640 1 -- 172.21.15.19:0/327376552 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa4001b070 con 0x56171ea92d10 2024-09-11T00:12:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.785+0000 7faa35ffb640 1 -- 172.21.15.19:0/327376552 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40021ce0 con 0x56171ea92d10 2024-09-11T00:12:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- 172.21.15.19:0/327376552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 msgr2=0x56171eaa04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa04b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7faa40016040 tx=0x7faa400146d0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- 172.21.15.19:0/327376552 shutdown_connections 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171ea9bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171ea9b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 --2- 172.21.15.19:0/327376552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa04b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- 172.21.15.19:0/327376552 >> 172.21.15.19:0/327376552 conn(0x56171ea9a110 msgr2=0x56171ea9fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- 172.21.15.19:0/327376552 shutdown_connections 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- 172.21.15.19:0/327376552 wait complete. 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- start start 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 Processor -- start 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171eaa6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faa501acb40 con 0x56171ea92d10 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa501adfb0 con 0x56171ea94ee0 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.786+0000 7faa58730740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa501ad210 con 0x56171ea95800 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa58730740 10 client.0 _ll_register_callbacks cb 0x7faa40009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43174/0 (socket says 172.21.15.19:43174) 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 -- 172.21.15.19:0/294263013 learned_addr learned my addr 172.21.15.19:0/294263013 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa548f8640 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171eaa6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 -- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 msgr2=0x56171eaa6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 -- 172.21.15.19:0/294263013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 msgr2=0x56171eaa6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171eaa6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 -- 172.21.15.19:0/294263013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171ea93c00 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa4ffff640 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa9d70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faa40006b50 tx=0x7faa400218b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c5768380bc240 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa2f7fe640 1 -- 172.21.15.19:0/294263013 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4002e050 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa2f7fe640 1 -- 172.21.15.19:0/294263013 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7faa40021c60 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa4001b070 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.787+0000 7faa2f7fe640 1 -- 172.21.15.19:0/294263013 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7faa4004d050 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 10 client.16782 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56171ea93790 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa2f7fe640 1 -- 172.21.15.19:0/294263013 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa4001b070 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa2f7fe640 1 -- 172.21.15.19:0/294263013 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7faa40020040 con 0x56171ea92d10 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 10 client.16782 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 20 client.16782 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:25.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eaa1790 0x56171eb25cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:25.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 4 client.16782 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:12:25.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56171ea09860 con 0x56171eaa1790 2024-09-11T00:12:25.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.788+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eaa1790 0x56171eb25cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:25.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.789+0000 7faa4f7fe640 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eaa1790 0x56171eb25cd0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e8985ca735b316 server_cookie=4dffa6235deb875e in_seq=0 out_seq=0 2024-09-11T00:12:25.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.789+0000 7faa2f7fe640 10 client.16782 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.790+0000 7faa2f7fe640 1 -- 172.21.15.19:0/294263013 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56171ea09860 con 0x56171eaa1790 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.790+0000 7faa2f7fe640 10 client.16782 handle_command_reply: tid=0 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.790+0000 7faa58730740 1 client.16782 shutdown 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.790+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 msgr2=0x56171eaa9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.790+0000 7faa58730740 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa9d70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faa40006b50 tx=0x7faa400218b0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.790+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 shutdown_connections 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.790+0000 7faa58730740 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171ea95800 0x56171eaa6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa58730740 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56171ea94ee0 0x56171eaa6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa58730740 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x56171eaa1790 0x56171eb25cd0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa58730740 1 --2- 172.21.15.19:0/294263013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56171ea92d10 0x56171eaa9d70 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa2f7fe640 0 client.16782 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 >> 172.21.15.19:0/294263013 conn(0x56171ea9a110 msgr2=0x56171ea91f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 shutdown_connections 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa58730740 1 -- 172.21.15.19:0/294263013 wait complete. 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa58730740 20 client.16782 trim_cache size 0 max 16384 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-11T00:12:25.796 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "708c4828-80d3-440e-9d82-9e19017b2abe", 2024-09-11T00:12:25.797 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-11T00:12:25.797 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:12:25.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faa380b5450 msgr2=0x7faa380b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faa380b5450 0x7faa380b7910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x56171ea98060 tx=0x7faa40009110 comp rx=0 tx=0).stop 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 msgr2=0x7faa5019eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5019eac0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faa48005cc0 tx=0x7faa4802f470 comp rx=0 tx=0).stop 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 shutdown_connections 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faa380b5450 0x7faa380b7910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa50109150 0x7faa5019eac0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa501087d0 0x7faa50199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.791+0000 7faa5635b640 1 --2- 172.21.15.19:0/2099721045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50102dc0 0x7faa501991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.792+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 >> 172.21.15.19:0/2099721045 conn(0x7faa500fe830 msgr2=0x7faa50100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.792+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 shutdown_connections 2024-09-11T00:12:25.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:25.792+0000 7faa5635b640 1 -- 172.21.15.19:0/2099721045 wait complete. 2024-09-11T00:12:26.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:26 smithi019 ceph-mon[30859]: pgmap v630: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:26.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:26 smithi131 ceph-mon[35491]: pgmap v630: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:26.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:26 smithi135 ceph-mon[35432]: pgmap v630: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:26.465 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:12:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:27.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:27 smithi019 ceph-mon[30859]: scrub queued for path: / 2024-09-11T00:12:27.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:27 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:12:27.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:27 smithi019 ceph-mon[30859]: scrub summary: active paths [/] 2024-09-11T00:12:27.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:27 smithi019 ceph-mon[30859]: scrub summary: idle+waiting paths [/] 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 -- 172.21.15.19:0/2422504140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6870108060 msgr2=0x7f687010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 --2- 172.21.15.19:0/2422504140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6870108060 0x7f687010e860 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6868009ca0 tx=0x7f686802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 -- 172.21.15.19:0/2422504140 shutdown_connections 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 --2- 172.21.15.19:0/2422504140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6870108060 0x7f687010e860 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 --2- 172.21.15.19:0/2422504140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68701076e0 0x7f6870107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 --2- 172.21.15.19:0/2422504140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6870101cd0 0x7f68701020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 -- 172.21.15.19:0/2422504140 >> 172.21.15.19:0/2422504140 conn(0x7f68700fd720 msgr2=0x7f68700ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 -- 172.21.15.19:0/2422504140 shutdown_connections 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.221+0000 7f687806f640 1 -- 172.21.15.19:0/2422504140 wait complete. 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 Processor -- start 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 -- start start 2024-09-11T00:12:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6870101cd0 0x7f6870199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68701076e0 0x7f6870199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6870108060 0x7f687019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6870112e40 con 0x7f68701076e0 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6870112cc0 con 0x7f6870108060 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687806f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6870112fc0 con 0x7f6870101cd0 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687560a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68701076e0 0x7f6870199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687560a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68701076e0 0x7f6870199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43200/0 (socket says 172.21.15.19:43200) 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687560a640 1 -- 172.21.15.19:0/1529633787 learned_addr learned my addr 172.21.15.19:0/1529633787 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.222+0000 7f687660c640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6870108060 0x7f687019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f6875e0b640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6870101cd0 0x7f6870199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687560a640 1 -- 172.21.15.19:0/1529633787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6870101cd0 msgr2=0x7f6870199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687560a640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6870101cd0 0x7f6870199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687560a640 1 -- 172.21.15.19:0/1529633787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6870108060 msgr2=0x7f687019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687560a640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6870108060 0x7f687019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687560a640 1 -- 172.21.15.19:0/1529633787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687019f2c0 con 0x7f68701076e0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687660c640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6870108060 0x7f687019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687560a640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68701076e0 0x7f6870199750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f686000c920 tx=0x7f686000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f6866ffd640 1 -- 172.21.15.19:0/1529633787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860007c70 con 0x7f68701076e0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f6866ffd640 1 -- 172.21.15.19:0/1529633787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6860007e10 con 0x7f68701076e0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687019f5b0 con 0x7f68701076e0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f6866ffd640 1 -- 172.21.15.19:0/1529633787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860018820 con 0x7f68701076e0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.223+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68701a5e40 con 0x7f68701076e0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.225+0000 7f6866ffd640 1 -- 172.21.15.19:0/1529633787 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f686000f450 con 0x7f68701076e0 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 Processor -- start 2024-09-11T00:12:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 -- start start 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373f480 0x55ea6373f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6374bd30 0x55ea6374e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ea636b5e50 con 0x55ea6373fda0 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ea636a5280 con 0x55ea6373f480 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687a444740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ea636a9090 con 0x55ea6374bd30 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f6875e0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f6875e0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43204/0 (socket says 172.21.15.19:43204) 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f6875e0b640 1 -- 172.21.15.19:0/1660266947 learned_addr learned my addr 172.21.15.19:0/1660266947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687560a640 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6374bd30 0x55ea6374e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f687660c640 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373f480 0x55ea6373f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f6866ffd640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f685c0b54d0 0x7f685c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.226+0000 7f6875e0b640 1 -- 172.21.15.19:0/1660266947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6374bd30 msgr2=0x55ea6374e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f6875e0b640 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6374bd30 0x55ea6374e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f6875e0b640 1 -- 172.21.15.19:0/1660266947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373f480 msgr2=0x55ea6373f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f6875e0b640 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373f480 0x55ea6373f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f6875e0b640 1 -- 172.21.15.19:0/1660266947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea63403650 con 0x55ea6373fda0 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f687660c640 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373f480 0x55ea6373f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f6866ffd640 1 -- 172.21.15.19:0/1529633787 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f68600e6070 con 0x7f68701076e0 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f687660c640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f685c0b54d0 0x7f685c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f6875e0b640 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374b7f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f686c00cbe0 tx=0x7f686c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9d19a7538d8451 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f685bfff640 1 -- 172.21.15.19:0/1660266947 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c010630 con 0x55ea6373fda0 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f685bfff640 1 -- 172.21.15.19:0/1660266947 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f686c010c80 con 0x55ea6373fda0 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.227+0000 7f685bfff640 1 -- 172.21.15.19:0/1660266947 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c01ab10 con 0x55ea6373fda0 2024-09-11T00:12:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 -- 172.21.15.19:0/1660266947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 msgr2=0x55ea6374b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687660c640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f685c0b54d0 0x7f685c0b7990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6868006010 tx=0x7f68680095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374b7f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f686c00cbe0 tx=0x7f686c00e720 comp rx=0 tx=0).stop 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 -- 172.21.15.19:0/1660266947 shutdown_connections 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6374bd30 0x55ea6374e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374b7f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 --2- 172.21.15.19:0/1660266947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373f480 0x55ea6373f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 -- 172.21.15.19:0/1660266947 >> 172.21.15.19:0/1660266947 conn(0x55ea6373d2b0 msgr2=0x55ea6373e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 -- 172.21.15.19:0/1660266947 shutdown_connections 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 -- 172.21.15.19:0/1660266947 wait complete. 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 -- start start 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.228+0000 7f687a444740 1 Processor -- start 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687a444740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea6374b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687a444740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373fda0 0x55ea63748a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687a444740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6374bd30 0x55ea63749020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687a444740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ea63506700 con 0x55ea6374bd30 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687a444740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ea63640110 con 0x55ea6373fda0 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687a444740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ea6374e9b0 con 0x55ea6373f480 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687a444740 10 client.0 _ll_register_callbacks cb 0x55ea63659990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6374bd30 0x55ea63749020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6374bd30 0x55ea63749020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43206/0 (socket says 172.21.15.19:43206) 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 -- 172.21.15.19:0/4046003563 learned_addr learned my addr 172.21.15.19:0/4046003563 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f6875e0b640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea6374b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687560a640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373fda0 0x55ea63748a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 -- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 msgr2=0x55ea6374b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea6374b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 -- 172.21.15.19:0/4046003563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373fda0 msgr2=0x55ea63748a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373fda0 0x55ea63748a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687660c640 1 -- 172.21.15.19:0/4046003563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea6366dc40 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.229+0000 7f687560a640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373fda0 0x55ea63748a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687660c640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6374bd30 0x55ea63749020 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6868009430 tx=0x7f686802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a454e5d3f228a109 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f68597fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f68597fa640 1 -- 172.21.15.19:0/4046003563 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868004790 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f68597fa640 1 -- 172.21.15.19:0/4046003563 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f686802f660 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f686c010c80 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f68597fa640 1 -- 172.21.15.19:0/4046003563 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f686802f860 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 10 client.16794 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ea6375a280 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f68597fa640 1 -- 172.21.15.19:0/4046003563 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f686c010c80 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f68597fa640 1 -- 172.21.15.19:0/4046003563 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f6868043040 con 0x55ea6374bd30 2024-09-11T00:12:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 10 client.16794 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 20 client.16794 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea6375b6e0 0x55ea6375db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 4 client.16794 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.230+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea636b7da0 con 0x55ea6375b6e0 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.231+0000 7f6875e0b640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea6375b6e0 0x55ea6375db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.231+0000 7f68597fa640 10 client.16794 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.231+0000 7f6875e0b640 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea6375b6e0 0x55ea6375db40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fa9542bad06f5fa server_cookie=b113313401bc97db in_seq=0 out_seq=0 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f68597fa640 1 -- 172.21.15.19:0/4046003563 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea636b7da0 con 0x55ea6375b6e0 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f68597fa640 10 client.16794 handle_command_reply: tid=0 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 client.16794 shutdown 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6374bd30 msgr2=0x55ea63749020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6374bd30 0x55ea63749020 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6868009430 tx=0x7f686802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 shutdown_connections 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea6375b6e0 0x55ea6375db40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6374bd30 0x55ea63749020 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6373fda0 0x55ea63748a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f68597fa640 0 client.16794 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 --2- 172.21.15.19:0/4046003563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea6374b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 >> 172.21.15.19:0/4046003563 conn(0x55ea6373d2b0 msgr2=0x55ea63742e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 shutdown_connections 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 1 -- 172.21.15.19:0/4046003563 wait complete. 2024-09-11T00:12:27.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.232+0000 7f687a444740 20 client.16794 trim_cache size 0 max 16384 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 Processor -- start 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 -- start start 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea63757c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f68701b0e10 con 0x55ea6373fda0 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f68701ae6b0 con 0x55ea6374bd30 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687a444740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68701ac520 con 0x55ea6373f480 2024-09-11T00:12:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687560a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687560a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43208/0 (socket says 172.21.15.19:43208) 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687560a640 1 -- 172.21.15.19:0/1049663353 learned_addr learned my addr 172.21.15.19:0/1049663353 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f6875e0b640 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea63757c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.250+0000 7f687560a640 1 -- 172.21.15.19:0/1049663353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 msgr2=0x55ea63757c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f687560a640 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea63757c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f687660c640 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f687560a640 1 -- 172.21.15.19:0/1049663353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 msgr2=0x55ea6374d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f687560a640 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f687560a640 1 -- 172.21.15.19:0/1049663353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea637487f0 con 0x55ea6373fda0 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f687560a640 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374d120 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6860007590 tx=0x7f686000fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8df3d0facdc183 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f685b7fe640 1 -- 172.21.15.19:0/1049663353 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600abd50 con 0x55ea6373fda0 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f685b7fe640 1 -- 172.21.15.19:0/1049663353 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68600ac0f0 con 0x55ea6373fda0 2024-09-11T00:12:27.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.251+0000 7f685b7fe640 1 -- 172.21.15.19:0/1049663353 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600a8850 con 0x55ea6373fda0 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 -- 172.21.15.19:0/1049663353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 msgr2=0x55ea6374d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374d120 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6860007590 tx=0x7f686000fe60 comp rx=0 tx=0).stop 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 -- 172.21.15.19:0/1049663353 shutdown_connections 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373fda0 0x55ea6374d120 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 --2- 172.21.15.19:0/1049663353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373f480 0x55ea63757c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 -- 172.21.15.19:0/1049663353 >> 172.21.15.19:0/1049663353 conn(0x55ea6373d2b0 msgr2=0x55ea6374a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 -- 172.21.15.19:0/1049663353 shutdown_connections 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 -- 172.21.15.19:0/1049663353 wait complete. 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 -- start start 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.252+0000 7f687a444740 1 Processor -- start 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687a444740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373f480 0x55ea637546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687a444740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373fda0 0x55ea6374ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687a444740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687a444740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f68701acb70 con 0x55ea6373f480 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687a444740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f68701adfe0 con 0x55ea6374bd30 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687a444740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68701ad240 con 0x55ea6373fda0 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373f480 0x55ea637546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687a444740 10 client.0 _ll_register_callbacks cb 0x7f6868009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373f480 0x55ea637546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43212/0 (socket says 172.21.15.19:43212) 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 -- 172.21.15.19:0/2278982502 learned_addr learned my addr 172.21.15.19:0/2278982502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687560a640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373fda0 0x55ea6374ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687660c640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 -- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373fda0 msgr2=0x55ea6374ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373fda0 0x55ea6374ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 -- 172.21.15.19:0/2278982502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 msgr2=0x55ea6374f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 -- 172.21.15.19:0/2278982502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea637c8610 con 0x55ea6373f480 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f687660c640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f6875e0b640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373f480 0x55ea637546b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f686c01a7c0 tx=0x7f686c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f789025229ceb365 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f68597fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.253+0000 7f68597fa640 1 -- 172.21.15.19:0/2278982502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c004020 con 0x55ea6373f480 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f68597fa640 1 -- 172.21.15.19:0/2278982502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f686c0041c0 con 0x55ea6373f480 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68600ac0f0 con 0x55ea6373f480 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f68597fa640 1 -- 172.21.15.19:0/2278982502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f686c0043e0 con 0x55ea6373f480 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 10 client.16800 fetch_fsmap learned FSMap version 37 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ea637c98f0 con 0x55ea6373f480 2024-09-11T00:12:27.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f68597fa640 1 -- 172.21.15.19:0/2278982502 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68600ac0f0 con 0x55ea6373f480 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f68597fa640 1 -- 172.21.15.19:0/2278982502 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8354+0+0 (secure 0 0 0) 0x7f686c02b020 con 0x55ea6373f480 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 10 client.16800 fetch_fsmap finished waiting for FSMap version 37 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 20 client.16800 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea637c9d30 0x55ea637cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 4 client.16800 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ea636b3850 con 0x55ea637c9d30 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.254+0000 7f687560a640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea637c9d30 0x55ea637cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.255+0000 7f687560a640 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea637c9d30 0x55ea637cc120 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=804c6b8bb121c7f8 server_cookie=332ad5efb5dc5f29 in_seq=0 out_seq=0 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.255+0000 7f68597fa640 10 client.16800 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.255+0000 7f68597fa640 1 -- 172.21.15.19:0/2278982502 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55ea636b3850 con 0x55ea637c9d30 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.255+0000 7f68597fa640 10 client.16800 handle_command_reply: tid=0 2024-09-11T00:12:27.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.255+0000 7f687a444740 1 client.16800 shutdown 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.255+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373f480 msgr2=0x55ea637546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.255+0000 7f687a444740 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373f480 0x55ea637546b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f686c01a7c0 tx=0x7f686c005bb0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 shutdown_connections 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea6374bd30 0x55ea6374f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea6373fda0 0x55ea6374ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55ea637c9d30 0x55ea637cc120 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 --2- 172.21.15.19:0/2278982502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6373f480 0x55ea637546b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f68597fa640 0 client.16800 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 >> 172.21.15.19:0/2278982502 conn(0x55ea6373d2b0 msgr2=0x55ea6374a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 shutdown_connections 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 1 -- 172.21.15.19:0/2278982502 wait complete. 2024-09-11T00:12:27.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687a444740 20 client.16800 trim_cache size 0 max 16384 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "708c4828-80d3-440e-9d82-9e19017b2abe": { 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "708c4828-80d3-440e-9d82-9e19017b2abe", 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:12:27.268 INFO:teuthology.orchestra.run.smithi019.stdout: "708c4828-80d3-440e-9d82-9e19017b2abe": { 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:12:25.789527+0000", 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "09e8f5bb-ab99-4c46-81b2-61c40689c774": { 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:11:40.677468+0000", 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.269 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "e66baedb-0b9a-4aa0-b143-f749e4000f12": { 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:58.253354+0000", 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:12:27.270 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.271 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.272 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.274 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:12:27.275 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:27.276 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:12:27.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:12:27.277 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:12:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f685c0b54d0 msgr2=0x7f685c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687806f640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f685c0b54d0 0x7f685c0b7990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6868006010 tx=0x7f68680095c0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68701076e0 msgr2=0x7f6870199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:27.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687806f640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68701076e0 0x7f6870199750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f686000c920 tx=0x7f686000cde0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 shutdown_connections 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687806f640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6870108060 0x7f687019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.256+0000 7f687806f640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f685c0b54d0 0x7f685c0b7990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.257+0000 7f687806f640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68701076e0 0x7f6870199750 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.257+0000 7f687806f640 1 --2- 172.21.15.19:0/1529633787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6870101cd0 0x7f6870199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.257+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 >> 172.21.15.19:0/1529633787 conn(0x7f68700fd720 msgr2=0x7f6870103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.257+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 shutdown_connections 2024-09-11T00:12:27.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:27.257+0000 7f687806f640 1 -- 172.21.15.19:0/1529633787 wait complete. 2024-09-11T00:12:27.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:27 smithi131 ceph-mon[35491]: scrub queued for path: / 2024-09-11T00:12:27.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:27 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:12:27.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:27 smithi131 ceph-mon[35491]: scrub summary: active paths [/] 2024-09-11T00:12:27.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:27 smithi131 ceph-mon[35491]: scrub summary: idle+waiting paths [/] 2024-09-11T00:12:27.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:27 smithi135 ceph-mon[35432]: scrub queued for path: / 2024-09-11T00:12:27.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:27 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:12:27.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:27 smithi135 ceph-mon[35432]: scrub summary: active paths [/] 2024-09-11T00:12:27.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:27 smithi135 ceph-mon[35432]: scrub summary: idle+waiting paths [/] 2024-09-11T00:12:28.019 INFO:tasks.cephfs.filesystem:scrub status for tag:708c4828-80d3-440e-9d82-9e19017b2abe - {'path': '/', 'tag': '708c4828-80d3-440e-9d82-9e19017b2abe', 'options': 'recursive,force'} 2024-09-11T00:12:28.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:28 smithi019 ceph-mon[30859]: pgmap v631: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:28.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:28 smithi131 ceph-mon[35491]: pgmap v631: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:28.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:28 smithi135 ceph-mon[35432]: pgmap v631: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:30 smithi131 ceph-mon[35491]: pgmap v632: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:30 smithi131 ceph-mon[35491]: scrub summary: idle 2024-09-11T00:12:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:30 smithi135 ceph-mon[35432]: pgmap v632: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:30.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:30 smithi135 ceph-mon[35432]: scrub summary: idle 2024-09-11T00:12:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:30 smithi019 ceph-mon[30859]: pgmap v632: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:12:30.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:30 smithi019 ceph-mon[30859]: scrub summary: idle 2024-09-11T00:12:32.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:32 smithi131 ceph-mon[35491]: pgmap v633: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T00:12:32.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:32 smithi135 ceph-mon[35432]: pgmap v633: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T00:12:32.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:32 smithi019 ceph-mon[30859]: pgmap v633: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T00:12:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:34 smithi131 ceph-mon[35491]: pgmap v634: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T00:12:34.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:34 smithi135 ceph-mon[35432]: pgmap v634: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T00:12:34.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:34 smithi019 ceph-mon[30859]: pgmap v634: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T00:12:36.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:36 smithi135 ceph-mon[35432]: pgmap v635: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:36.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:36 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:36 smithi019 ceph-mon[30859]: pgmap v635: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:36.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:36 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:36 smithi131 ceph-mon[35491]: pgmap v635: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:36.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:36 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:38.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:38 smithi135 ceph-mon[35432]: pgmap v636: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:12:38.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:38 smithi019 ceph-mon[30859]: pgmap v636: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:12:38.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:38 smithi131 ceph-mon[35491]: pgmap v636: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-11T00:12:39.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T00:12:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 -- 172.21.15.19:0/843244942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5774103c10 msgr2=0x7f5774103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 --2- 172.21.15.19:0/843244942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5774103c10 0x7f5774103ff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5764009900 tx=0x7f576402a410 comp rx=0 tx=0).stop 2024-09-11T00:12:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 -- 172.21.15.19:0/843244942 shutdown_connections 2024-09-11T00:12:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 --2- 172.21.15.19:0/843244942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f577410d060 0x7f577410f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 --2- 172.21.15.19:0/843244942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5774104530 0x7f577410ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 --2- 172.21.15.19:0/843244942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5774103c10 0x7f5774103ff0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 -- 172.21.15.19:0/843244942 >> 172.21.15.19:0/843244942 conn(0x7f57740fd660 msgr2=0x7f57740ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 -- 172.21.15.19:0/843244942 shutdown_connections 2024-09-11T00:12:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.807+0000 7f5779517640 1 -- 172.21.15.19:0/843244942 wait complete. 2024-09-11T00:12:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 Processor -- start 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 -- start start 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5774103c10 0x7f57741018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5774104530 0x7f5774101df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f577410d060 0x7f5774102330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5774112cf0 con 0x7f577410d060 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5774112b70 con 0x7f5774103c10 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5779517640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5774112e70 con 0x7f5774104530 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f57737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f577410d060 0x7f5774102330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f57737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f577410d060 0x7f5774102330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51006/0 (socket says 172.21.15.19:51006) 2024-09-11T00:12:39.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f57737fe640 1 -- 172.21.15.19:0/3244348717 learned_addr learned my addr 172.21.15.19:0/3244348717 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f5772ffd640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5774103c10 0x7f57741018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.808+0000 7f57727fc640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5774104530 0x7f5774101df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f57737fe640 1 -- 172.21.15.19:0/3244348717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5774104530 msgr2=0x7f5774101df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f57737fe640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5774104530 0x7f5774101df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f57737fe640 1 -- 172.21.15.19:0/3244348717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5774103c10 msgr2=0x7f57741018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f57737fe640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5774103c10 0x7f57741018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f57737fe640 1 -- 172.21.15.19:0/3244348717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57741a75e0 con 0x7f577410d060 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f57727fc640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5774104530 0x7f5774101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f57737fe640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f577410d060 0x7f5774102330 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f576c00cce0 tx=0x7f576c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f576bfff640 1 -- 172.21.15.19:0/3244348717 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c00f450 con 0x7f577410d060 2024-09-11T00:12:39.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f576bfff640 1 -- 172.21.15.19:0/3244348717 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f576c00faa0 con 0x7f577410d060 2024-09-11T00:12:39.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57741a78d0 con 0x7f577410d060 2024-09-11T00:12:39.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f576bfff640 1 -- 172.21.15.19:0/3244348717 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c018b70 con 0x7f577410d060 2024-09-11T00:12:39.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.809+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57741a7dd0 con 0x7f577410d060 2024-09-11T00:12:39.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.810+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5774103ff0 con 0x7f577410d060 2024-09-11T00:12:39.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.813+0000 7f576bfff640 1 -- 172.21.15.19:0/3244348717 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f576c00f5f0 con 0x7f577410d060 2024-09-11T00:12:39.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.813+0000 7f576bfff640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f57600b5450 0x7f57600b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:39.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.814+0000 7f5772ffd640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f57600b5450 0x7f57600b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:39.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.814+0000 7f576bfff640 1 -- 172.21.15.19:0/3244348717 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f576c0e67a0 con 0x7f577410d060 2024-09-11T00:12:39.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.814+0000 7f5772ffd640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f57600b5450 0x7f57600b7910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5764031440 tx=0x7f5764005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:39.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:39.816+0000 7f576bfff640 1 -- 172.21.15.19:0/3244348717 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f576c014030 con 0x7f577410d060 2024-09-11T00:12:40.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.027+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f57740ff980 con 0x7f57600b5450 2024-09-11T00:12:40.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.035+0000 7f576bfff640 1 -- 172.21.15.19:0/3244348717 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f57740ff980 con 0x7f57600b5450 2024-09-11T00:12:40.037 INFO:teuthology.orchestra.run.smithi019.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T00:02:38", "first": "2024-09-11T00:03:00", "last": "2024-09-11T00:12:00", "last_pruned": "2024-09-11T00:12:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-11T00:12:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f57600b5450 msgr2=0x7f57600b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f57600b5450 0x7f57600b7910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5764031440 tx=0x7f5764005b50 comp rx=0 tx=0).stop 2024-09-11T00:12:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f577410d060 msgr2=0x7f5774102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f577410d060 0x7f5774102330 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f576c00cce0 tx=0x7f576c00a620 comp rx=0 tx=0).stop 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 shutdown_connections 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f57600b5450 0x7f57600b7910 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f577410d060 0x7f5774102330 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5774104530 0x7f5774101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 --2- 172.21.15.19:0/3244348717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5774103c10 0x7f57741018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.037+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 >> 172.21.15.19:0/3244348717 conn(0x7f57740fd660 msgr2=0x7f57740fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.038+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 shutdown_connections 2024-09-11T00:12:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.038+0000 7f5779517640 1 -- 172.21.15.19:0/3244348717 wait complete. 2024-09-11T00:12:40.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T00:12:40.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.154+0000 7f49b8d5d640 1 -- 172.21.15.19:0/344688391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b4102cf0 msgr2=0x7f49b41030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:40.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.154+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/344688391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b4102cf0 0x7f49b41030d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009900 tx=0x7f49a402a410 comp rx=0 tx=0).stop 2024-09-11T00:12:40.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.154+0000 7f49b8d5d640 1 -- 172.21.15.19:0/344688391 shutdown_connections 2024-09-11T00:12:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.154+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/344688391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b4109070 0x7f49b410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.154+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/344688391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b41086f0 0x7f49b4108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.154+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/344688391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b4102cf0 0x7f49b41030d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.154+0000 7f49b8d5d640 1 -- 172.21.15.19:0/344688391 >> 172.21.15.19:0/344688391 conn(0x7f49b40fe730 msgr2=0x7f49b4100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.155+0000 7f49b8d5d640 1 -- 172.21.15.19:0/344688391 shutdown_connections 2024-09-11T00:12:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.155+0000 7f49b8d5d640 1 -- 172.21.15.19:0/344688391 wait complete. 2024-09-11T00:12:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.155+0000 7f49b8d5d640 1 Processor -- start 2024-09-11T00:12:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.155+0000 7f49b8d5d640 1 -- start start 2024-09-11T00:12:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b4102cf0 0x7f49b41992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41086f0 0x7f49b4199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b4109070 0x7f49b419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4112d30 con 0x7f49b41086f0 2024-09-11T00:12:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4112bb0 con 0x7f49b4109070 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4112eb0 con 0x7f49b4102cf0 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41086f0 0x7f49b4199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41086f0 0x7f49b4199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51012/0 (socket says 172.21.15.19:51012) 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 -- 172.21.15.19:0/391678190 learned_addr learned my addr 172.21.15.19:0/391678190 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b259c640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b4102cf0 0x7f49b41992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b2d9d640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b4109070 0x7f49b419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 -- 172.21.15.19:0/391678190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b4102cf0 msgr2=0x7f49b41992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b4102cf0 0x7f49b41992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 -- 172.21.15.19:0/391678190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b4109070 msgr2=0x7f49b419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b4109070 0x7f49b419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 -- 172.21.15.19:0/391678190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b419f370 con 0x7f49b41086f0 2024-09-11T00:12:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49a9d9b640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41086f0 0x7f49b4199810 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f499c00b4a0 tx=0x7f499c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49abfff640 1 -- 172.21.15.19:0/391678190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c014070 con 0x7f49b41086f0 2024-09-11T00:12:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49abfff640 1 -- 172.21.15.19:0/391678190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f499c010ac0 con 0x7f49b41086f0 2024-09-11T00:12:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49abfff640 1 -- 172.21.15.19:0/391678190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c017c30 con 0x7f49b41086f0 2024-09-11T00:12:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b419f660 con 0x7f49b41086f0 2024-09-11T00:12:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.156+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b41a5f00 con 0x7f49b41086f0 2024-09-11T00:12:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.157+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b41030d0 con 0x7f49b41086f0 2024-09-11T00:12:40.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.159+0000 7f49abfff640 1 -- 172.21.15.19:0/391678190 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f499c010610 con 0x7f49b41086f0 2024-09-11T00:12:40.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.160+0000 7f49abfff640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a00b54d0 0x7f49a00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:40.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.160+0000 7f49b259c640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a00b54d0 0x7f49a00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:40.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.160+0000 7f49abfff640 1 -- 172.21.15.19:0/391678190 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f499c0e57f0 con 0x7f49b41086f0 2024-09-11T00:12:40.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.160+0000 7f49b259c640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a00b54d0 0x7f49a00b7990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f49a4031440 tx=0x7f49a4005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.162+0000 7f49abfff640 1 -- 172.21.15.19:0/391678190 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f499c0ac360 con 0x7f49b41086f0 2024-09-11T00:12:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.369+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 --> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f49b4063590 con 0x7f49a00b54d0 2024-09-11T00:12:40.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.377+0000 7f49abfff640 1 -- 172.21.15.19:0/391678190 <== mgr.14220 v2:172.21.15.19:6800/1170299416 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f49b4063590 con 0x7f49a00b54d0 2024-09-11T00:12:40.379 INFO:teuthology.orchestra.run.smithi019.stdout:/ 1m 6m3h 2024-09-11T00:12:40.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a00b54d0 msgr2=0x7f49a00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:40.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a00b54d0 0x7f49a00b7990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f49a4031440 tx=0x7f49a4005e80 comp rx=0 tx=0).stop 2024-09-11T00:12:40.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41086f0 msgr2=0x7f49b4199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:40.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41086f0 0x7f49b4199810 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f499c00b4a0 tx=0x7f499c00b960 comp rx=0 tx=0).stop 2024-09-11T00:12:40.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 shutdown_connections 2024-09-11T00:12:40.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49b4109070 0x7f49b419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f49a00b54d0 0x7f49a00b7990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41086f0 0x7f49b4199810 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 --2- 172.21.15.19:0/391678190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49b4102cf0 0x7f49b41992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:40.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 >> 172.21.15.19:0/391678190 conn(0x7f49b40fe730 msgr2=0x7f49b4100b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:40.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 shutdown_connections 2024-09-11T00:12:40.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:40.379+0000 7f49b8d5d640 1 -- 172.21.15.19:0/391678190 wait complete. 2024-09-11T00:12:40.390 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:40 smithi019 ceph-mon[30859]: pgmap v637: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:12:40.392 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-11T00:12:40.404 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-11T00:12:40.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:40 smithi135 ceph-mon[35432]: pgmap v637: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:12:40.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:40 smithi131 ceph-mon[35491]: pgmap v637: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-11T00:12:41.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:41 smithi135 ceph-mon[35432]: from='client.16806 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:41.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:41 smithi135 ceph-mon[35432]: from='client.16812 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:41.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:41 smithi019 ceph-mon[30859]: from='client.16806 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:41.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:41 smithi019 ceph-mon[30859]: from='client.16812 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:41 smithi131 ceph-mon[35491]: from='client.16806 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:41.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:41 smithi131 ceph-mon[35491]: from='client.16812 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:42.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:42 smithi135 ceph-mon[35432]: pgmap v638: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:42.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:42 smithi019 ceph-mon[30859]: pgmap v638: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:42.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:42 smithi131 ceph-mon[35491]: pgmap v638: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:12:44.353 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:44 smithi131 ceph-mon[35491]: pgmap v639: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:44.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:44 smithi135 ceph-mon[35432]: pgmap v639: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:44.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:44 smithi019 ceph-mon[30859]: pgmap v639: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:46.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:46 smithi135 ceph-mon[35432]: pgmap v640: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:46.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:46 smithi019 ceph-mon[30859]: pgmap v640: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:46.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:46 smithi131 ceph-mon[35491]: pgmap v640: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:48.340 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:48 smithi019 ceph-mon[30859]: pgmap v641: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T00:12:48.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:48 smithi135 ceph-mon[35432]: pgmap v641: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T00:12:48.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:48 smithi131 ceph-mon[35491]: pgmap v641: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T00:12:50.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:50 smithi135 ceph-mon[35432]: pgmap v642: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:50.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:50 smithi019 ceph-mon[30859]: pgmap v642: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:50 smithi131 ceph-mon[35491]: pgmap v642: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:52.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:52 smithi135 ceph-mon[35432]: pgmap v643: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:52.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:52 smithi019 ceph-mon[30859]: pgmap v643: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:52.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:52 smithi131 ceph-mon[35491]: pgmap v643: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:54.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:54 smithi135 ceph-mon[35432]: pgmap v644: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:54.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:54 smithi019 ceph-mon[30859]: pgmap v644: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:54.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:54 smithi131 ceph-mon[35491]: pgmap v644: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:56 smithi135 ceph-mon[35432]: pgmap v645: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-11T00:12:56.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:56 smithi135 ceph-mon[35432]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:56.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:56 smithi019 ceph-mon[30859]: pgmap v645: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-11T00:12:56.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:56 smithi019 ceph-mon[30859]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:56.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:56 smithi131 ceph-mon[35491]: pgmap v645: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-11T00:12:56.551 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:56 smithi131 ceph-mon[35491]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:12:58.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:12:58.296 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:58.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:12:58 smithi019 ceph-mon[30859]: pgmap v646: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:12:58.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:12:58 smithi135 ceph-mon[35432]: pgmap v646: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:12:58.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:12:58 smithi131 ceph-mon[35491]: pgmap v646: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T00:12:58.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1349403476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b88104600 msgr2=0x7f7b8810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1349403476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b88104600 0x7f7b8810caf0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009900 tx=0x7f7b7402a410 comp rx=0 tx=0).stop 2024-09-11T00:12:58.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1349403476 shutdown_connections 2024-09-11T00:12:58.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1349403476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b8810d140 0x7f7b8810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1349403476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b88104600 0x7f7b8810caf0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1349403476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b88103ce0 0x7f7b881040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1349403476 >> 172.21.15.19:0/1349403476 conn(0x7f7b880fd700 msgr2=0x7f7b880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1349403476 shutdown_connections 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.790+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1349403476 wait complete. 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 Processor -- start 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 -- start start 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b88103ce0 0x7f7b88101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b88104600 0x7f7b88101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8810d140 0x7f7b88102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88112db0 con 0x7f7b8810d140 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88112c30 con 0x7f7b88104600 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ec8b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88112f30 con 0x7f7b88103ce0 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8810d140 0x7f7b88102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8810d140 0x7f7b88102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34472/0 (socket says 172.21.15.19:34472) 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 -- 172.21.15.19:0/1547145695 learned_addr learned my addr 172.21.15.19:0/1547145695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b88103ce0 0x7f7b88101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b88104600 0x7f7b88101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 -- 172.21.15.19:0/1547145695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b88103ce0 msgr2=0x7f7b88101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b88103ce0 0x7f7b88101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 -- 172.21.15.19:0/1547145695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b88104600 msgr2=0x7f7b88101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b88104600 0x7f7b88101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.791+0000 7f7b8d228640 1 -- 172.21.15.19:0/1547145695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b881a7690 con 0x7f7b8810d140 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.792+0000 7f7b8d228640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8810d140 0x7f7b88102410 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000cce0 tx=0x7f7b8000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.792+0000 7f7b85ffb640 1 -- 172.21.15.19:0/1547145695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000f450 con 0x7f7b8810d140 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.792+0000 7f7b85ffb640 1 -- 172.21.15.19:0/1547145695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b8000faa0 con 0x7f7b8810d140 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.792+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b881a7980 con 0x7f7b8810d140 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.792+0000 7f7b85ffb640 1 -- 172.21.15.19:0/1547145695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80018b70 con 0x7f7b8810d140 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.792+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b881a7e40 con 0x7f7b8810d140 2024-09-11T00:12:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b85ffb640 1 -- 172.21.15.19:0/1547145695 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f7b8000f5f0 con 0x7f7b8810d140 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 Processor -- start 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 -- start start 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc233480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc241d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609bc1a9e50 con 0x5609bc2330a0 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5609bc199280 con 0x5609bc23f950 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b91060740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609bc19d090 con 0x5609bc2339c0 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc233480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc233480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34476/0 (socket says 172.21.15.19:34476) 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b87fff640 1 -- 172.21.15.19:0/1455952441 learned_addr learned my addr 172.21.15.19:0/1455952441 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b85ffb640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b780b5450 0x7f7b780b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.795+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b8d228640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b780b5450 0x7f7b780b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc241d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b85ffb640 1 -- 172.21.15.19:0/1547145695 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f7b800e6670 con 0x7f7b8810d140 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b87fff640 1 -- 172.21.15.19:0/1455952441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 msgr2=0x5609bc23f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b87fff640 1 -- 172.21.15.19:0/1455952441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 msgr2=0x5609bc241d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc241d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b87fff640 1 -- 172.21.15.19:0/1455952441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609bbef7650 con 0x5609bc2330a0 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc233480 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7b8806c330 tx=0x7f7b74009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3011fe8f1aa8b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b8d228640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b780b5450 0x7f7b780b7910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b800ac7e0 tx=0x7f7b80076b60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b72ffd640 1 -- 172.21.15.19:0/1455952441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74044020 con 0x5609bc2330a0 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b72ffd640 1 -- 172.21.15.19:0/1455952441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b74031870 con 0x5609bc2330a0 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.796+0000 7f7b72ffd640 1 -- 172.21.15.19:0/1455952441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74035040 con 0x5609bc2330a0 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 -- 172.21.15.19:0/1455952441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 msgr2=0x5609bc233480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc233480 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7b8806c330 tx=0x7f7b74009640 comp rx=0 tx=0).stop 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 -- 172.21.15.19:0/1455952441 shutdown_connections 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc241d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 --2- 172.21.15.19:0/1455952441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc233480 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 -- 172.21.15.19:0/1455952441 >> 172.21.15.19:0/1455952441 conn(0x5609bc230ed0 msgr2=0x5609bc232070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 -- 172.21.15.19:0/1455952441 shutdown_connections 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 -- 172.21.15.19:0/1455952441 wait complete. 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 -- start start 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.797+0000 7f7b91060740 1 Processor -- start 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b91060740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc2330a0 0x5609bc23f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b91060740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b91060740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc23f950 0x5609bc23cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b91060740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609bbffa700 con 0x5609bc23f950 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b91060740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5609bc134110 con 0x5609bc2330a0 2024-09-11T00:12:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b91060740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609bc242570 con 0x5609bc2339c0 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b91060740 10 client.0 _ll_register_callbacks cb 0x5609bc14d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc23f950 0x5609bc23cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc23f950 0x5609bc23cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34480/0 (socket says 172.21.15.19:34480) 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b87fff640 1 -- 172.21.15.19:0/3803707785 learned_addr learned my addr 172.21.15.19:0/3803707785 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b8ca27640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b87fff640 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc2330a0 0x5609bc23f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b8ca27640 1 -- 172.21.15.19:0/3803707785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc2330a0 msgr2=0x5609bc23f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc2330a0 0x5609bc23f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b8ca27640 1 -- 172.21.15.19:0/3803707785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc23f950 msgr2=0x5609bc23cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc23f950 0x5609bc23cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b8ca27640 1 -- 172.21.15.19:0/3803707785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609bc161c40 con 0x5609bc2339c0 2024-09-11T00:12:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.798+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23c6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00baa0 tx=0x7f7b7c00bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3838caafd02363d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b67fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-11T00:12:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b67fff640 1 -- 172.21.15.19:0/3803707785 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c003df0 con 0x5609bc2339c0 2024-09-11T00:12:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b74031870 con 0x5609bc2339c0 2024-09-11T00:12:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b67fff640 1 -- 172.21.15.19:0/3803707785 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f7b7c005020 con 0x5609bc2339c0 2024-09-11T00:12:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b67fff640 1 -- 172.21.15.19:0/3803707785 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7b7c005220 con 0x5609bc2339c0 2024-09-11T00:12:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 10 client.26332 fetch_fsmap learned FSMap version 39 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5609bc24df80 con 0x5609bc2339c0 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b67fff640 1 -- 172.21.15.19:0/3803707785 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b74031870 con 0x5609bc2339c0 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b67fff640 1 -- 172.21.15.19:0/3803707785 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7f7b7c025480 con 0x5609bc2339c0 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 10 client.26332 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 10 client.26332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 20 client.26332 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc24f3e0 0x5609bc2517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 4 client.26332 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.799+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609bc1abda0 con 0x5609bc24f3e0 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.800+0000 7f7b87fff640 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc24f3e0 0x5609bc2517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.800+0000 7f7b87fff640 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc24f3e0 0x5609bc2517d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2e6261f7c2f0a3 server_cookie=5cfdd21143df138b in_seq=0 out_seq=0 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.800+0000 7f7b67fff640 10 client.26332 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b67fff640 1 -- 172.21.15.19:0/3803707785 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609bc1abda0 con 0x5609bc24f3e0 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b67fff640 10 client.26332 handle_command_reply: tid=0 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 client.26332 shutdown 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 msgr2=0x5609bc23c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23c6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00baa0 tx=0x7f7b7c00bf60 comp rx=0 tx=0).stop 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 shutdown_connections 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc24f3e0 0x5609bc2517d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc23f950 0x5609bc23cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23c6b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b67fff640 0 client.26332 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 --2- 172.21.15.19:0/3803707785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc2330a0 0x5609bc23f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 >> 172.21.15.19:0/3803707785 conn(0x5609bc230ed0 msgr2=0x5609bc236a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 shutdown_connections 2024-09-11T00:12:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 1 -- 172.21.15.19:0/3803707785 wait complete. 2024-09-11T00:12:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.801+0000 7f7b91060740 20 client.26332 trim_cache size 0 max 16384 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 Processor -- start 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 -- start start 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc24b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc23af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881b2f80 con 0x5609bc2330a0 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881b0850 con 0x5609bc23f950 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b91060740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881ae6c0 con 0x5609bc2339c0 2024-09-11T00:12:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc24b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc24b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34486/0 (socket says 172.21.15.19:34486) 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.819+0000 7f7b87fff640 1 -- 172.21.15.19:0/2954590895 learned_addr learned my addr 172.21.15.19:0/2954590895 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b87fff640 1 -- 172.21.15.19:0/2954590895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 msgr2=0x5609bc23bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b87fff640 1 --2- 172.21.15.19:0/2954590895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b87fff640 1 -- 172.21.15.19:0/2954590895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 msgr2=0x5609bc23af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b87fff640 1 --2- 172.21.15.19:0/2954590895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc23af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b87fff640 1 -- 172.21.15.19:0/2954590895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609bc2337b0 con 0x5609bc2330a0 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b87fff640 1 --2- 172.21.15.19:0/2954590895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc24b7a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7b74033000 tx=0x7f7b74005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501aa61b4ab56f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b727fc640 1 -- 172.21.15.19:0/2954590895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74035040 con 0x5609bc2330a0 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b727fc640 1 -- 172.21.15.19:0/2954590895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b74009780 con 0x5609bc2330a0 2024-09-11T00:12:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.820+0000 7f7b727fc640 1 -- 172.21.15.19:0/2954590895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74044040 con 0x5609bc2330a0 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 -- 172.21.15.19:0/2954590895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 msgr2=0x5609bc24b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 --2- 172.21.15.19:0/2954590895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc24b7a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7b74033000 tx=0x7f7b74005410 comp rx=0 tx=0).stop 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 -- 172.21.15.19:0/2954590895 shutdown_connections 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 --2- 172.21.15.19:0/2954590895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc23af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 --2- 172.21.15.19:0/2954590895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc23bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 --2- 172.21.15.19:0/2954590895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc24b7a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 -- 172.21.15.19:0/2954590895 >> 172.21.15.19:0/2954590895 conn(0x5609bc230ed0 msgr2=0x5609bc23c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 -- 172.21.15.19:0/2954590895 shutdown_connections 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 -- 172.21.15.19:0/2954590895 wait complete. 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 -- start start 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.821+0000 7f7b91060740 1 Processor -- start 2024-09-11T00:12:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc2481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc256eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc257640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881aed10 con 0x5609bc2330a0 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881b0180 con 0x5609bc23f950 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881af3e0 con 0x5609bc2339c0 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 10 client.0 _ll_register_callbacks cb 0x7f7b7c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc2481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc2481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34488/0 (socket says 172.21.15.19:34488) 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 -- 172.21.15.19:0/178086270 learned_addr learned my addr 172.21.15.19:0/178086270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc256eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 -- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 msgr2=0x5609bc256eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc256eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 -- 172.21.15.19:0/178086270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 msgr2=0x5609bc257640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc257640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 -- 172.21.15.19:0/178086270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609bc246e00 con 0x5609bc2330a0 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc256eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b87fff640 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc2481a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7b74005700 tx=0x7f7b740315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3682048b49e96e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b67fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b67fff640 1 -- 172.21.15.19:0/178086270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74035070 con 0x5609bc2330a0 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b74009780 con 0x5609bc2330a0 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.822+0000 7f7b67fff640 1 -- 172.21.15.19:0/178086270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f7b74031a50 con 0x5609bc2330a0 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b67fff640 1 -- 172.21.15.19:0/178086270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7b74044040 con 0x5609bc2330a0 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 10 client.16830 fetch_fsmap learned FSMap version 39 2024-09-11T00:12:58.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5609bc2bc510 con 0x5609bc2330a0 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b67fff640 1 -- 172.21.15.19:0/178086270 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b74009780 con 0x5609bc2330a0 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b67fff640 1 -- 172.21.15.19:0/178086270 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7f7b7405d030 con 0x5609bc2330a0 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 10 client.16830 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 20 client.16830 populate_metadata read hostname 'smithi019' 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc2bc7f0 0x5609bc2bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 4 client.16830 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5609bc1a7850 con 0x5609bc2bc7f0 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.823+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc2bc7f0 0x5609bc2bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:58.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b8ca27640 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc2bc7f0 0x5609bc2bebe0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f550127ce2b986b server_cookie=de807a848fd8ee2b in_seq=0 out_seq=0 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b67fff640 10 client.16830 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b67fff640 1 -- 172.21.15.19:0/178086270 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x5609bc1a7850 con 0x5609bc2bc7f0 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b67fff640 10 client.16830 handle_command_reply: tid=0 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 client.16830 shutdown 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 msgr2=0x5609bc2481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc2481a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7b74005700 tx=0x7f7b740315d0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 shutdown_connections 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609bc23f950 0x5609bc257640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609bc2339c0 0x5609bc256eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x5609bc2bc7f0 0x5609bc2bebe0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 --2- 172.21.15.19:0/178086270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609bc2330a0 0x5609bc2481a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b67fff640 0 client.16830 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 >> 172.21.15.19:0/178086270 conn(0x5609bc230ed0 msgr2=0x5609bc23aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 shutdown_connections 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 1 -- 172.21.15.19:0/178086270 wait complete. 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.824+0000 7f7b91060740 20 client.16830 trim_cache size 0 max 16384 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-11T00:12:58.838 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "708c4828-80d3-440e-9d82-9e19017b2abe": { 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:12:25.789527+0000", 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "09e8f5bb-ab99-4c46-81b2-61c40689c774": { 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:11:40.677468+0000", 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.839 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: "e66baedb-0b9a-4aa0-b143-f749e4000f12": { 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:58.253354+0000", 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.840 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "f5d8d3b3-9cd5-497e-b0c3-20c5b3183008": { 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:09:32.572154+0000", 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.841 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "3d18c9fb-65cc-4d33-8a8e-789ea88b35e3": { 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:08:16.332780+0000", 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.842 INFO:teuthology.orchestra.run.smithi019.stdout: "d94c8430-0fd4-4004-964d-b1fff360fdfe": { 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:07:17.668035+0000", 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "ce46908f-d85e-4336-a09e-ef5f7957d972": { 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:05:37.615174+0000", 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.843 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "0e0bc6ee-daea-46fa-b5f6-9dd10e128072": { 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:52.638132+0000", 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "04e44eaf-9077-464d-9dfd-e4df0cb597dd": { 2024-09-11T00:12:58.844 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:10:15.854242+0000", 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "b25bf178-3e8c-4709-8b4b-03638eecafc8": { 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:06:31.207030+0000", 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.845 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "7676f127-f423-4df3-b15f-9c1b06a8392e": { 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:04:07.652090+0000", 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.846 INFO:teuthology.orchestra.run.smithi019.stdout: "74f81914-42a9-47dd-927f-09a7b533e2da": { 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:03:22.435052+0000", 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "959ea9a0-f727-40b8-aeee-c7acf5059e8e": { 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-11T00:02:39.010976+0000", 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-11T00:12:58.847 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-11T00:12:58.848 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-11T00:12:58.848 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:12:58.848 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:12:58.848 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b780b5450 msgr2=0x7f7b780b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b780b5450 0x7f7b780b7910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b800ac7e0 tx=0x7f7b80076b60 comp rx=0 tx=0).stop 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8810d140 msgr2=0x7f7b88102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8810d140 0x7f7b88102410 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000cce0 tx=0x7f7b8000a620 comp rx=0 tx=0).stop 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 shutdown_connections 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f7b780b5450 0x7f7b780b7910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8810d140 0x7f7b88102410 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b88104600 0x7f7b88101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 --2- 172.21.15.19:0/1547145695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b88103ce0 0x7f7b88101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 >> 172.21.15.19:0/1547145695 conn(0x7f7b880fd700 msgr2=0x7f7b880fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:58.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 shutdown_connections 2024-09-11T00:12:58.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:12:58.825+0000 7f7b8ec8b640 1 -- 172.21.15.19:0/1547145695 wait complete. 2024-09-11T00:12:59.714 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:12:59.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:12:59.972 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:00.375 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:00 smithi019 ceph-mon[30859]: pgmap v647: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:13:00.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:00 smithi135 ceph-mon[35432]: pgmap v647: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:13:00.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:00 smithi131 ceph-mon[35491]: pgmap v647: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T00:13:00.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 -- 172.21.15.19:0/957244160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278102dc0 msgr2=0x7fc2781031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 --2- 172.21.15.19:0/957244160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278102dc0 0x7fc2781031a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc268009860 tx=0x7fc26802a340 comp rx=0 tx=0).stop 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 -- 172.21.15.19:0/957244160 shutdown_connections 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 --2- 172.21.15.19:0/957244160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278109150 0x7fc27810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 --2- 172.21.15.19:0/957244160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2781087d0 0x7fc278108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 --2- 172.21.15.19:0/957244160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278102dc0 0x7fc2781031a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 -- 172.21.15.19:0/957244160 >> 172.21.15.19:0/957244160 conn(0x7fc2780fe830 msgr2=0x7fc278100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 -- 172.21.15.19:0/957244160 shutdown_connections 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.608+0000 7fc27c87e640 1 -- 172.21.15.19:0/957244160 wait complete. 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.609+0000 7fc27c87e640 1 Processor -- start 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.609+0000 7fc27c87e640 1 -- start start 2024-09-11T00:13:00.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.609+0000 7fc27c87e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278102dc0 0x7fc2781992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27c87e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2781087d0 0x7fc278199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27c87e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278109150 0x7fc27819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27c87e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc278112dd0 con 0x7fc2781087d0 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27c87e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc278112c50 con 0x7fc278109150 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27c87e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc278112f50 con 0x7fc278102dc0 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc275d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2781087d0 0x7fc278199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278102dc0 0x7fc2781992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278109150 0x7fc27819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc275d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2781087d0 0x7fc278199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34512/0 (socket says 172.21.15.19:34512) 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278102dc0 0x7fc2781992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57024/0 (socket says 172.21.15.19:57024) 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc275d9b640 1 -- 172.21.15.19:0/339489962 learned_addr learned my addr 172.21.15.19:0/339489962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:00.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc276d9d640 1 -- 172.21.15.19:0/339489962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278102dc0 msgr2=0x7fc2781992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc276d9d640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278102dc0 0x7fc2781992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc276d9d640 1 -- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2781087d0 msgr2=0x7fc278199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc276d9d640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2781087d0 0x7fc278199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc276d9d640 1 -- 172.21.15.19:0/339489962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27819f370 con 0x7fc278109150 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc27659c640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278102dc0 0x7fc2781992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.610+0000 7fc276d9d640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278109150 0x7fc27819eba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc27000efc0 tx=0x7fc27000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.611+0000 7fc2677fe640 1 -- 172.21.15.19:0/339489962 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270003970 con 0x7fc278109150 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.611+0000 7fc2677fe640 1 -- 172.21.15.19:0/339489962 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc270004020 con 0x7fc278109150 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.611+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27819f660 con 0x7fc278109150 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.611+0000 7fc2677fe640 1 -- 172.21.15.19:0/339489962 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27000b940 con 0x7fc278109150 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.611+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2781a5d20 con 0x7fc278109150 2024-09-11T00:13:00.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.612+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2781031a0 con 0x7fc278109150 2024-09-11T00:13:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.613+0000 7fc2677fe640 1 -- 172.21.15.19:0/339489962 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fc27000b040 con 0x7fc278109150 2024-09-11T00:13:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.614+0000 7fc2677fe640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc2600b5450 0x7fc2600b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.615+0000 7fc27659c640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc2600b5450 0x7fc2600b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.615+0000 7fc2677fe640 1 -- 172.21.15.19:0/339489962 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fc2700e6090 con 0x7fc278109150 2024-09-11T00:13:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.615+0000 7fc27659c640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc2600b5450 0x7fc2600b7910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c00 tx=0x7fc2680058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:00.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.617+0000 7fc2677fe640 1 -- 172.21.15.19:0/339489962 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc2700acc00 con 0x7fc278109150 2024-09-11T00:13:00.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.844+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc27802e5c0 con 0x7fc278109150 2024-09-11T00:13:00.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.845+0000 7fc2677fe640 1 -- 172.21.15.19:0/339489962 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11915 (secure 0 0 0) 0x7fc2700ac500 con 0x7fc278109150 2024-09-11T00:13:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:13:00.847 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-11T00:12:55:087296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:12:54.982249+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:13:00.847 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc2600b5450 msgr2=0x7fc2600b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc2600b5450 0x7fc2600b7910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c00 tx=0x7fc2680058b0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278109150 msgr2=0x7fc27819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278109150 0x7fc27819eba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc27000efc0 tx=0x7fc27000c800 comp rx=0 tx=0).stop 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 shutdown_connections 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc278109150 0x7fc27819eba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc2600b5450 0x7fc2600b7910 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2781087d0 0x7fc278199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 --2- 172.21.15.19:0/339489962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc278102dc0 0x7fc2781992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:00.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 >> 172.21.15.19:0/339489962 conn(0x7fc2780fe830 msgr2=0x7fc278100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:00.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 shutdown_connections 2024-09-11T00:13:00.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:00.847+0000 7fc27c87e640 1 -- 172.21.15.19:0/339489962 wait complete. 2024-09-11T00:13:01.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:01 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/339489962' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:01.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:01 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/339489962' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:01.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:01 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/339489962' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:01.666 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-11T00:13:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:02.342 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:02 smithi019 ceph-mon[30859]: pgmap v648: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:13:02.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:02 smithi135 ceph-mon[35432]: pgmap v648: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:13:02.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/301966056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 msgr2=0x7fe9e01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/301966056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01020b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009900 tx=0x7fe9dc02a410 comp rx=0 tx=0).stop 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/301966056 shutdown_connections 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/301966056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e0108060 0x7fe9e010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/301966056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9e01076e0 0x7fe9e0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/301966056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01020b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/301966056 >> 172.21.15.19:0/301966056 conn(0x7fe9e00fd700 msgr2=0x7fe9e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/301966056 shutdown_connections 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/301966056 wait complete. 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 Processor -- start 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.425+0000 7fe9e7b4f640 1 -- start start 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e01076e0 0x7fe9e01998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9e0108060 0x7fe9e019ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0111d20 con 0x7fe9e0101cd0 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0111ba0 con 0x7fe9e0108060 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0111ea0 con 0x7fe9e01076e0 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e0199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35746/0 (socket says 172.21.15.19:35746) 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 -- 172.21.15.19:0/1030341667 learned_addr learned my addr 172.21.15.19:0/1030341667 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e01076e0 0x7fe9e01998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9e0108060 0x7fe9e019ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 -- 172.21.15.19:0/1030341667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e01076e0 msgr2=0x7fe9e01998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e01076e0 0x7fe9e01998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 -- 172.21.15.19:0/1030341667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9e0108060 msgr2=0x7fe9e019ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9e0108060 0x7fe9e019ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 -- 172.21.15.19:0/1030341667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e019f430 con 0x7fe9e0101cd0 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9e0108060 0x7fe9e019ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e0199380 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc006010 tx=0x7fe9dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9d6ffd640 1 -- 172.21.15.19:0/1030341667 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc03f030 con 0x7fe9e0101cd0 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e019f6c0 con 0x7fe9e0101cd0 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9d6ffd640 1 -- 172.21.15.19:0/1030341667 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9dc003800 con 0x7fe9e0101cd0 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9d6ffd640 1 -- 172.21.15.19:0/1030341667 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc035070 con 0x7fe9e0101cd0 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.426+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e01a5de0 con 0x7fe9e0101cd0 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.429+0000 7fe9e9f24740 1 Processor -- start 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.429+0000 7fe9e9f24740 1 -- start start 2024-09-11T00:13:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.429+0000 7fe9d6ffd640 1 -- 172.21.15.19:0/1030341667 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fe9dc031b10 con 0x7fe9e0101cd0 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.429+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b028b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b12c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b15580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55de59a78ea0 con 0x55de59b13190 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55de59a682d0 con 0x55de59b02df0 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55de59a6c0e0 con 0x55de59b024d0 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b15580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b15580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35760/0 (socket says 172.21.15.19:35760) 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 -- 172.21.15.19:0/1601813869 learned_addr learned my addr 172.21.15.19:0/1601813869 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b12c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 -- 172.21.15.19:0/1601813869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 msgr2=0x55de59b028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 -- 172.21.15.19:0/1601813869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 msgr2=0x55de59b12c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b12c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 -- 172.21.15.19:0/1601813869 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de597c6650 con 0x55de59b13190 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b15580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000acd0 tx=0x7fe9d000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843e0d01fa9b641 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.430+0000 7fe9d6ffd640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9cc0b5450 0x7fe9cc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9cbfff640 1 -- 172.21.15.19:0/1601813869 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d001d070 con 0x55de59b13190 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9cbfff640 1 -- 172.21.15.19:0/1601813869 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d0018af0 con 0x55de59b13190 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9cbfff640 1 -- 172.21.15.19:0/1601813869 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0010bc0 con 0x55de59b13190 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9cc0b5450 0x7fe9cc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9d6ffd640 1 -- 172.21.15.19:0/1030341667 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fe9dc1068a0 con 0x7fe9e0101cd0 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e9f24740 1 -- 172.21.15.19:0/1601813869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 msgr2=0x55de59b15580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9cc0b5450 0x7fe9cc0b7910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c610 tx=0x7fe9d800e040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b15580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000acd0 tx=0x7fe9d000f790 comp rx=0 tx=0).stop 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e9f24740 1 -- 172.21.15.19:0/1601813869 shutdown_connections 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b15580 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b12c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/1601813869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.431+0000 7fe9e9f24740 1 -- 172.21.15.19:0/1601813869 >> 172.21.15.19:0/1601813869 conn(0x55de59b00300 msgr2=0x55de59b014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 -- 172.21.15.19:0/1601813869 shutdown_connections 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 -- 172.21.15.19:0/1601813869 wait complete. 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 -- start start 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 Processor -- start 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b0fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b10400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55de598c9700 con 0x55de59b13190 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55de59a03160 con 0x55de59b02df0 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55de59b15e40 con 0x55de59b024d0 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e9f24740 10 client.0 _ll_register_callbacks cb 0x55de59a1c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.432+0000 7fe9e60ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b10400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b10400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35776/0 (socket says 172.21.15.19:35776) 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 -- 172.21.15.19:0/152486603 learned_addr learned my addr 172.21.15.19:0/152486603 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b0fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 -- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 msgr2=0x55de59b12a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b12a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 -- 172.21.15.19:0/152486603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 msgr2=0x55de59b0fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b0fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 -- 172.21.15.19:0/152486603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de59a30c90 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b10400 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8007da0 tx=0x7fe9d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9909d625456f7fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9c97fa640 1 -- 172.21.15.19:0/152486603 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d801e040 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9c97fa640 1 -- 172.21.15.19:0/152486603 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fe9d8022420 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9d0018af0 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9c97fa640 1 -- 172.21.15.19:0/152486603 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe9d8022620 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e9f24740 10 client.16848 fetch_fsmap learned FSMap version 39 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.433+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55de59b217a0 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9c97fa640 1 -- 172.21.15.19:0/152486603 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d0018af0 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9c97fa640 1 -- 172.21.15.19:0/152486603 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7fe9d802c860 con 0x55de59b13190 2024-09-11T00:13:02.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9e9f24740 10 client.16848 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9e9f24740 10 client.16848 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9e9f24740 20 client.16848 populate_metadata read hostname 'smithi019' 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b22d00 0x55de59b250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9e9f24740 4 client.16848 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de59a7adf0 con 0x55de59b22d00 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.434+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b22d00 0x55de59b250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.435+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b22d00 0x55de59b250f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db79779d9955df4a server_cookie=a4052ac20e625783 in_seq=0 out_seq=0 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.435+0000 7fe9c97fa640 10 client.16848 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.435+0000 7fe9c97fa640 1 -- 172.21.15.19:0/152486603 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de59a7adf0 con 0x55de59b22d00 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.435+0000 7fe9c97fa640 10 client.16848 handle_command_reply: tid=0 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.435+0000 7fe9e9f24740 1 client.16848 shutdown 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.435+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 msgr2=0x55de59b10400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.435+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b10400 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8007da0 tx=0x7fe9d8004a40 comp rx=0 tx=0).stop 2024-09-11T00:13:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 shutdown_connections 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b22d00 0x55de59b250f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b10400 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b02df0 0x55de59b0fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9c97fa640 0 client.16848 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/152486603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b024d0 0x55de59b12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 >> 172.21.15.19:0/152486603 conn(0x55de59b00300 msgr2=0x55de59aff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 shutdown_connections 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 1 -- 172.21.15.19:0/152486603 wait complete. 2024-09-11T00:13:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.436+0000 7fe9e9f24740 20 client.16848 trim_cache size 0 max 16384 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 Processor -- start 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 -- start start 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b024d0 0x55de59b01a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b2a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b2af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aecd0 con 0x55de59b13190 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01ac5a0 con 0x55de59b024d0 2024-09-11T00:13:02.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aa410 con 0x55de59b02df0 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e60ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b2af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e60ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b2af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35780/0 (socket says 172.21.15.19:35780) 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e60ec640 1 -- 172.21.15.19:0/2077415418 learned_addr learned my addr 172.21.15.19:0/2077415418 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b2a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.449+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b024d0 0x55de59b01a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9e60ec640 1 -- 172.21.15.19:0/2077415418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 msgr2=0x55de59b2a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b2a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9e60ec640 1 -- 172.21.15.19:0/2077415418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b024d0 msgr2=0x55de59b01a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b024d0 0x55de59b01a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9e60ec640 1 -- 172.21.15.19:0/2077415418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de59b00130 con 0x55de59b13190 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b024d0 0x55de59b01a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b2af00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800cf40 tx=0x7fe9d8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30db611c621c5d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:02.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9cb7fe640 1 -- 172.21.15.19:0/2077415418 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8038070 con 0x55de59b13190 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9cb7fe640 1 -- 172.21.15.19:0/2077415418 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d8027070 con 0x55de59b13190 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.450+0000 7fe9cb7fe640 1 -- 172.21.15.19:0/2077415418 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d801e040 con 0x55de59b13190 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 -- 172.21.15.19:0/2077415418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 msgr2=0x55de59b2af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b2af00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800cf40 tx=0x7fe9d8007a00 comp rx=0 tx=0).stop 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 -- 172.21.15.19:0/2077415418 shutdown_connections 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b13190 0x55de59b2af00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b2a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/2077415418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b024d0 0x55de59b01a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 -- 172.21.15.19:0/2077415418 >> 172.21.15.19:0/2077415418 conn(0x55de59b00300 msgr2=0x55de59b01350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 -- 172.21.15.19:0/2077415418 shutdown_connections 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 -- 172.21.15.19:0/2077415418 wait complete. 2024-09-11T00:13:02.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 -- start start 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 Processor -- start 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b024d0 0x55de59b1b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b1b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.451+0000 7fe9e9f24740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b13190 0x55de59b180d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aaa60 con 0x55de59b024d0 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01abed0 con 0x55de59b13190 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e9f24740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01ab130 con 0x55de59b02df0 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e9f24740 10 client.0 _ll_register_callbacks cb 0x7fe9d801b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b024d0 0x55de59b1b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b024d0 0x55de59b1b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35788/0 (socket says 172.21.15.19:35788) 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 -- 172.21.15.19:0/3591333804 learned_addr learned my addr 172.21.15.19:0/3591333804 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:02.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b1b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b13190 0x55de59b180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 -- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 msgr2=0x55de59b1b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b1b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 -- 172.21.15.19:0/3591333804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b13190 msgr2=0x55de59b180d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b13190 0x55de59b180d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 -- 172.21.15.19:0/3591333804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de59b1bdb0 con 0x55de59b024d0 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e60ec640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b13190 0x55de59b180d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e58eb640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b024d0 0x55de59b1b100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc1040a0 tx=0x7fe9dc108d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a6984fa01cc851 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9c97fa640 1 -- 172.21.15.19:0/3591333804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc049040 con 0x55de59b024d0 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9c97fa640 1 -- 172.21.15.19:0/3591333804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fe9dc0c8fe0 con 0x55de59b024d0 2024-09-11T00:13:02.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.452+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9d8027070 con 0x55de59b024d0 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9c97fa640 1 -- 172.21.15.19:0/3591333804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe9dc0cc4e0 con 0x55de59b024d0 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 10 client.16854 fetch_fsmap learned FSMap version 39 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55de59b90170 con 0x55de59b024d0 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9c97fa640 1 -- 172.21.15.19:0/3591333804 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d8027070 con 0x55de59b024d0 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9c97fa640 1 -- 172.21.15.19:0/3591333804 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7fe9dc0a6ce0 con 0x55de59b024d0 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 10 client.16854 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 10 client.16854 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 20 client.16854 populate_metadata read hostname 'smithi019' 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b90870 0x55de59b92c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 4 client.16854 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 --> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de59a768a0 con 0x55de59b90870 2024-09-11T00:13:02.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.453+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b90870 0x55de59b92c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e50ea640 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b90870 0x55de59b92c90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=777dfc0c826703ed server_cookie=109786cad5c72a5a in_seq=0 out_seq=0 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9c97fa640 10 client.16854 ms_handle_connect on v2:172.21.15.135:6836/3873679773 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9c97fa640 1 -- 172.21.15.19:0/3591333804 <== mds.2 v2:172.21.15.135:6836/3873679773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de59a768a0 con 0x55de59b90870 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9c97fa640 10 client.16854 handle_command_reply: tid=0 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 client.16854 shutdown 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b024d0 msgr2=0x55de59b1b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b024d0 0x55de59b1b100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc1040a0 tx=0x7fe9dc108d80 comp rx=0 tx=0).stop 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 shutdown_connections 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:6836/3873679773,v1:172.21.15.135:6837/3873679773] conn(0x55de59b90870 0x55de59b92c90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de59b13190 0x55de59b180d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de59b02df0 0x55de59b1b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 --2- 172.21.15.19:0/3591333804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de59b024d0 0x55de59b1b100 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9c97fa640 0 client.16854 ms_handle_reset on v2:172.21.15.135:6836/3873679773 2024-09-11T00:13:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 >> 172.21.15.19:0/3591333804 conn(0x55de59b00300 msgr2=0x55de59b11490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 shutdown_connections 2024-09-11T00:13:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 1 -- 172.21.15.19:0/3591333804 wait complete. 2024-09-11T00:13:02.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.454+0000 7fe9e9f24740 20 client.16854 trim_cache size 0 max 16384 2024-09-11T00:13:02.464 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9cc0b5450 msgr2=0x7fe9cc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9cc0b5450 0x7fe9cc0b7910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c610 tx=0x7fe9d800e040 comp rx=0 tx=0).stop 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 msgr2=0x7fe9e0199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e0199380 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc006010 tx=0x7fe9dc0042f0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 shutdown_connections 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9e0108060 0x7fe9e019ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e01076e0 0x7fe9e01998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fe9cc0b5450 0x7fe9cc0b7910 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 --2- 172.21.15.19:0/1030341667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9e0101cd0 0x7fe9e0199380 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:02.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 >> 172.21.15.19:0/1030341667 conn(0x7fe9e00fd700 msgr2=0x7fe9e006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:02.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 shutdown_connections 2024-09-11T00:13:02.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:02.455+0000 7fe9e7b4f640 1 -- 172.21.15.19:0/1030341667 wait complete. 2024-09-11T00:13:02.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:02 smithi131 ceph-mon[35491]: pgmap v648: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T00:13:03.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-11T00:13:03.463 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:04.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 -- 172.21.15.19:0/3606785181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a01076c0 msgr2=0x7fc2a0107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 --2- 172.21.15.19:0/3606785181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a01076c0 0x7fc2a0107b00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc290009900 tx=0x7fc29002a410 comp rx=0 tx=0).stop 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 -- 172.21.15.19:0/3606785181 shutdown_connections 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 --2- 172.21.15.19:0/3606785181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2a0108040 0x7fc2a010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 --2- 172.21.15.19:0/3606785181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a01076c0 0x7fc2a0107b00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 --2- 172.21.15.19:0/3606785181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a0101cb0 0x7fc2a0102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 -- 172.21.15.19:0/3606785181 >> 172.21.15.19:0/3606785181 conn(0x7fc2a00fd700 msgr2=0x7fc2a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 -- 172.21.15.19:0/3606785181 shutdown_connections 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.985+0000 7fc2a8609640 1 -- 172.21.15.19:0/3606785181 wait complete. 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 Processor -- start 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 -- start start 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0101cb0 0x7fc2a0199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2a01076c0 0x7fc2a0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a0108040 0x7fc2a019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0111d00 con 0x7fc2a0101cb0 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0111b80 con 0x7fc2a0108040 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a8609640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0111e80 con 0x7fc2a01076c0 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a63a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0101cb0 0x7fc2a0199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a63a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0101cb0 0x7fc2a0199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35812/0 (socket says 172.21.15.19:35812) 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a63a5640 1 -- 172.21.15.19:0/952830783 learned_addr learned my addr 172.21.15.19:0/952830783 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a0108040 0x7fc2a019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.986+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2a01076c0 0x7fc2a0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a63a5640 1 -- 172.21.15.19:0/952830783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2a01076c0 msgr2=0x7fc2a0199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a63a5640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2a01076c0 0x7fc2a0199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a63a5640 1 -- 172.21.15.19:0/952830783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a0108040 msgr2=0x7fc2a019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a63a5640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a0108040 0x7fc2a019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a63a5640 1 -- 172.21.15.19:0/952830783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a019f2f0 con 0x7fc2a0101cb0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2a01076c0 0x7fc2a0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a63a5640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0101cb0 0x7fc2a0199240 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00e9f0 tx=0x7fc29c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2977fe640 1 -- 172.21.15.19:0/952830783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00cd80 con 0x7fc2a0101cb0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2977fe640 1 -- 172.21.15.19:0/952830783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc29c0108e0 con 0x7fc2a0101cb0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a019f5e0 con 0x7fc2a0101cb0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2977fe640 1 -- 172.21.15.19:0/952830783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c018980 con 0x7fc2a0101cb0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.987+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a01a5ca0 con 0x7fc2a0101cb0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 Processor -- start 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 -- start start 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9baa10 0x56107c9c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2977fe640 1 -- 172.21.15.19:0/952830783 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fc29c010430 con 0x7fc2a0101cb0 2024-09-11T00:13:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9c69a0 0x56107c9c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56107c930ea0 con 0x56107c9ba0f0 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56107c9202d0 con 0x56107c9baa10 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56107c9240e0 con 0x56107c9c69a0 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2a6ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2a6ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9ba4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35816/0 (socket says 172.21.15.19:35816) 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/2535458769 learned_addr learned my addr 172.21.15.19:0/2535458769 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/2535458769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9c69a0 msgr2=0x56107c9c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/2535458769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9c69a0 0x56107c9c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/2535458769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9baa10 msgr2=0x56107c9c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.990+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/2535458769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9baa10 0x56107c9c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/2535458769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107c67e650 con 0x56107c9ba0f0 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/2535458769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9ba4d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc298009ee0 tx=0x7fc298010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f2d4e0dd21118a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc294ff9640 1 -- 172.21.15.19:0/2535458769 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298016070 con 0x56107c9ba0f0 2024-09-11T00:13:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc294ff9640 1 -- 172.21.15.19:0/2535458769 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc298004d20 con 0x56107c9ba0f0 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc294ff9640 1 -- 172.21.15.19:0/2535458769 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298012780 con 0x56107c9ba0f0 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc2977fe640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc28c0b5450 0x7fc28c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc2a63a5640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc28c0b5450 0x7fc28c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.991+0000 7fc2977fe640 1 -- 172.21.15.19:0/952830783 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fc29c0e63e0 con 0x7fc2a0101cb0 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 -- 172.21.15.19:0/2535458769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 msgr2=0x56107c9ba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2a63a5640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc28c0b5450 0x7fc28c0b7910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x56107c9b8e00 tx=0x7fc29c0a1110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/2535458769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9ba4d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc298009ee0 tx=0x7fc298010740 comp rx=0 tx=0).stop 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 -- 172.21.15.19:0/2535458769 shutdown_connections 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/2535458769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9c69a0 0x56107c9c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/2535458769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9baa10 0x56107c9c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/2535458769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9ba4d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 -- 172.21.15.19:0/2535458769 >> 172.21.15.19:0/2535458769 conn(0x56107c9b7f20 msgr2=0x56107c9b90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 -- 172.21.15.19:0/2535458769 shutdown_connections 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 -- 172.21.15.19:0/2535458769 wait complete. 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 -- start start 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.992+0000 7fc2aa9de740 1 Processor -- start 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9c3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107c9c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56107c781700 con 0x56107c9ba0f0 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56107c8bb160 con 0x56107c9c69a0 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56107c9c9620 con 0x56107c9baa10 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 10 client.0 _ll_register_callbacks cb 0x56107c8d49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35818/0 (socket says 172.21.15.19:35818) 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/1299049246 learned_addr learned my addr 172.21.15.19:0/1299049246 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107c9c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/1299049246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 msgr2=0x56107c9c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9c3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 msgr2=0x56107c9c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107c9c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/1299049246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107c8e8c90 con 0x56107c9ba0f0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9c62d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc298009570 tx=0x7fc2980094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdc556a5768ff33 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc289ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc289ffb640 1 -- 172.21.15.19:0/1299049246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298016070 con 0x56107c9ba0f0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc289ffb640 1 -- 172.21.15.19:0/1299049246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fc2980124e0 con 0x56107c9ba0f0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.993+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc298004d20 con 0x56107c9ba0f0 2024-09-11T00:13:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc289ffb640 1 -- 172.21.15.19:0/1299049246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc29802d020 con 0x56107c9ba0f0 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 10 client.16866 fetch_fsmap learned FSMap version 39 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56107c9d4fc0 con 0x56107c9ba0f0 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc289ffb640 1 -- 172.21.15.19:0/1299049246 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc298004d20 con 0x56107c9ba0f0 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc289ffb640 1 -- 172.21.15.19:0/1299049246 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7fc29800f040 con 0x56107c9ba0f0 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 10 client.16866 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 10 client.16866 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 20 client.16866 populate_metadata read hostname 'smithi019' 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107c9d6310 0x56107c9d8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 4 client.16866 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56107c932df0 con 0x56107c9d6310 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.994+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107c9d6310 0x56107c9d8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.995+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107c9d6310 0x56107c9d8700 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ff07e224c128d13 server_cookie=406dd3e2532d2e03 in_seq=0 out_seq=0 2024-09-11T00:13:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.995+0000 7fc289ffb640 10 client.16866 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc289ffb640 1 -- 172.21.15.19:0/1299049246 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56107c932df0 con 0x56107c9d6310 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc289ffb640 10 client.16866 handle_command_reply: tid=0 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 client.16866 shutdown 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 msgr2=0x56107c9c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9c62d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc298009570 tx=0x7fc2980094c0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 shutdown_connections 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107c9d6310 0x56107c9d8700 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107c9c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc289ffb640 0 client.16866 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1299049246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9c62d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 >> 172.21.15.19:0/1299049246 conn(0x56107c9b7f20 msgr2=0x56107c9bda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 shutdown_connections 2024-09-11T00:13:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1299049246 wait complete. 2024-09-11T00:13:04.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:03.996+0000 7fc2aa9de740 20 client.16866 trim_cache size 0 max 16384 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 Processor -- start 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 -- start start 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107c9c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01b0f00 con 0x56107c9ba0f0 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01ae7d0 con 0x56107c9c69a0 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01ac640 con 0x56107c9baa10 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35826/0 (socket says 172.21.15.19:35826) 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/3349718733 learned_addr learned my addr 172.21.15.19:0/3349718733 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/3349718733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 msgr2=0x56107c9b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/3349718733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 msgr2=0x56107c9c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107c9c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a6ba6640 1 -- 172.21.15.19:0/3349718733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107c9c34d0 con 0x56107c9ba0f0 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.010+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.011+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9d2880 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc298009860 tx=0x7fc298032960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd42725855c329f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.011+0000 7fc28bfff640 1 -- 172.21.15.19:0/3349718733 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298016040 con 0x56107c9ba0f0 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.011+0000 7fc28bfff640 1 -- 172.21.15.19:0/3349718733 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc29801e030 con 0x56107c9ba0f0 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.011+0000 7fc28bfff640 1 -- 172.21.15.19:0/3349718733 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2980126b0 con 0x56107c9ba0f0 2024-09-11T00:13:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.011+0000 7fc2aa9de740 1 -- 172.21.15.19:0/3349718733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 msgr2=0x56107c9d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.011+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9d2880 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc298009860 tx=0x7fc298032960 comp rx=0 tx=0).stop 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- 172.21.15.19:0/3349718733 shutdown_connections 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107c9c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9baa10 0x56107c9b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/3349718733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9ba0f0 0x56107c9d2880 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- 172.21.15.19:0/3349718733 >> 172.21.15.19:0/3349718733 conn(0x56107c9b7f20 msgr2=0x56107c9c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- 172.21.15.19:0/3349718733 shutdown_connections 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- 172.21.15.19:0/3349718733 wait complete. 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- start start 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 Processor -- start 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9ba0f0 0x56107c9c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9baa10 0x56107c9c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107ca45f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01acc90 con 0x56107c9baa10 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01ae100 con 0x56107c9c69a0 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01ad360 con 0x56107c9ba0f0 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2aa9de740 10 client.0 _ll_register_callbacks cb 0x7fc298009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2a5ba4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9baa10 0x56107c9c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2a5ba4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9baa10 0x56107c9c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35842/0 (socket says 172.21.15.19:35842) 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.012+0000 7fc2a5ba4640 1 -- 172.21.15.19:0/1001502427 learned_addr learned my addr 172.21.15.19:0/1001502427 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9ba0f0 0x56107c9c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107ca45f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a5ba4640 1 -- 172.21.15.19:0/1001502427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9ba0f0 msgr2=0x56107c9c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9ba0f0 0x56107c9c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a5ba4640 1 -- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 msgr2=0x56107ca45f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107ca45f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a5ba4640 1 -- 172.21.15.19:0/1001502427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107ca465d0 con 0x56107c9baa10 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107ca45f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2a5ba4640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9baa10 0x56107c9c74a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc290005940 tx=0x7fc2900040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed251030840344e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc289ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc289ffb640 1 -- 172.21.15.19:0/1001502427 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290035040 con 0x56107c9baa10 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc289ffb640 1 -- 172.21.15.19:0/1001502427 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fc290005040 con 0x56107c9baa10 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc29801e030 con 0x56107c9baa10 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc289ffb640 1 -- 172.21.15.19:0/1001502427 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc290005240 con 0x56107c9baa10 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2aa9de740 10 client.16872 fetch_fsmap learned FSMap version 39 2024-09-11T00:13:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.013+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56107ca47900 con 0x56107c9baa10 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc289ffb640 1 -- 172.21.15.19:0/1001502427 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc29801e030 con 0x56107c9baa10 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc289ffb640 1 -- 172.21.15.19:0/1001502427 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7fc290045070 con 0x56107c9baa10 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2aa9de740 10 client.16872 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2aa9de740 10 client.16872 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2aa9de740 20 client.16872 populate_metadata read hostname 'smithi019' 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107ca480d0 0x56107ca4a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2aa9de740 4 client.16872 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 --> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56107c92e8a0 con 0x56107ca480d0 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107ca480d0 0x56107ca4a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc2a6ba6640 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107ca480d0 0x56107ca4a4f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d887fed1aeb88d4d server_cookie=d0209f2e5ae634eb in_seq=0 out_seq=0 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.014+0000 7fc289ffb640 10 client.16872 ms_handle_connect on v2:172.21.15.131:6838/3500650127 2024-09-11T00:13:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc289ffb640 1 -- 172.21.15.19:0/1001502427 <== mds.1 v2:172.21.15.131:6838/3500650127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56107c92e8a0 con 0x56107ca480d0 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc289ffb640 10 client.16872 handle_command_reply: tid=0 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 client.16872 shutdown 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9baa10 msgr2=0x56107c9c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9baa10 0x56107c9c74a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc290005940 tx=0x7fc2900040d0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 shutdown_connections 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:6838/3500650127,v1:172.21.15.131:6839/3500650127] conn(0x56107ca480d0 0x56107ca4a4f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56107c9c69a0 0x56107ca45f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56107c9baa10 0x56107c9c74a0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc289ffb640 0 client.16872 ms_handle_reset on v2:172.21.15.131:6838/3500650127 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 --2- 172.21.15.19:0/1001502427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56107c9ba0f0 0x56107c9c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 >> 172.21.15.19:0/1001502427 conn(0x56107c9b7f20 msgr2=0x56107c9c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 shutdown_connections 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 1 -- 172.21.15.19:0/1001502427 wait complete. 2024-09-11T00:13:04.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.015+0000 7fc2aa9de740 20 client.16872 trim_cache size 0 max 16384 2024-09-11T00:13:04.027 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:13:04.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc28c0b5450 msgr2=0x7fc28c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc28c0b5450 0x7fc28c0b7910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x56107c9b8e00 tx=0x7fc29c0a1110 comp rx=0 tx=0).stop 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0101cb0 msgr2=0x7fc2a0199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0101cb0 0x7fc2a0199240 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00e9f0 tx=0x7fc29c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 shutdown_connections 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a0108040 0x7fc2a019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2a01076c0 0x7fc2a0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc28c0b5450 0x7fc28c0b7910 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 --2- 172.21.15.19:0/952830783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0101cb0 0x7fc2a0199240 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 >> 172.21.15.19:0/952830783 conn(0x7fc2a00fd700 msgr2=0x7fc2a006b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 shutdown_connections 2024-09-11T00:13:04.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:04.016+0000 7fc2a8609640 1 -- 172.21.15.19:0/952830783 wait complete. 2024-09-11T00:13:04.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:04 smithi019 ceph-mon[30859]: pgmap v649: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:13:04.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:04 smithi135 ceph-mon[35432]: pgmap v649: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:13:04.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:04 smithi131 ceph-mon[35491]: pgmap v649: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-11T00:13:04.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:13:04.969 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:05.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 -- 172.21.15.19:0/1013091601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 msgr2=0x7f8084107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 --2- 172.21.15.19:0/1013091601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084107af0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8078009900 tx=0x7f807802a410 comp rx=0 tx=0).stop 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 -- 172.21.15.19:0/1013091601 shutdown_connections 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 --2- 172.21.15.19:0/1013091601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8084108030 0x7f808410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 --2- 172.21.15.19:0/1013091601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084107af0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 --2- 172.21.15.19:0/1013091601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8084101ca0 0x7f8084102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 -- 172.21.15.19:0/1013091601 >> 172.21.15.19:0/1013091601 conn(0x7f80840fd730 msgr2=0x7f80840ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 -- 172.21.15.19:0/1013091601 shutdown_connections 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.477+0000 7f808af3a640 1 -- 172.21.15.19:0/1013091601 wait complete. 2024-09-11T00:13:05.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 Processor -- start 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 -- start start 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8084101ca0 0x7f8084198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8084108030 0x7f808419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8084111cf0 con 0x7f80841076b0 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8084111b70 con 0x7f8084108030 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f808af3a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8084111e70 con 0x7f8084101ca0 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35854/0 (socket says 172.21.15.19:35854) 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f8083fff640 1 -- 172.21.15.19:0/1784734414 learned_addr learned my addr 172.21.15.19:0/1784734414 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f80894d7640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8084108030 0x7f808419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.478+0000 7f8088cd6640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8084101ca0 0x7f8084198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8083fff640 1 -- 172.21.15.19:0/1784734414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8084101ca0 msgr2=0x7f8084198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8083fff640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8084101ca0 0x7f8084198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8083fff640 1 -- 172.21.15.19:0/1784734414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8084108030 msgr2=0x7f808419dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8083fff640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8084108030 0x7f808419dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8083fff640 1 -- 172.21.15.19:0/1784734414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808419e2b0 con 0x7f80841076b0 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8083fff640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084198740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8078005940 tx=0x7f80780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8081ffb640 1 -- 172.21.15.19:0/1784734414 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807803f030 con 0x7f80841076b0 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8081ffb640 1 -- 172.21.15.19:0/1784734414 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8078003cb0 con 0x7f80841076b0 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808419e540 con 0x7f80841076b0 2024-09-11T00:13:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f8081ffb640 1 -- 172.21.15.19:0/1784734414 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078035070 con 0x7f80841076b0 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.479+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80841a4c60 con 0x7f80841076b0 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 Processor -- start 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 -- start start 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f8081ffb640 1 -- 172.21.15.19:0/1784734414 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f8078003800 con 0x7f80841076b0 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e77c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e77cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e78aaf0 0x55d45e78cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d45e6f0ea0 con 0x55d45e78aaf0 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d45e6e02d0 con 0x55d45e77c920 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.482+0000 7f808d30f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d45e6e40e0 con 0x55d45e77bea0 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e78aaf0 0x55d45e78cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e78aaf0 0x55d45e78cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35858/0 (socket says 172.21.15.19:35858) 2024-09-11T00:13:05.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 -- 172.21.15.19:0/3950086598 learned_addr learned my addr 172.21.15.19:0/3950086598 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f80894d7640 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e77c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8088cd6640 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e77cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 -- 172.21.15.19:0/3950086598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 msgr2=0x55d45e77c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e77c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 -- 172.21.15.19:0/3950086598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 msgr2=0x55d45e77cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e77cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 -- 172.21.15.19:0/3950086598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45e43e650 con 0x55d45e78aaf0 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8088cd6640 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e77cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8081ffb640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f806c0b54d0 0x7f806c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8083fff640 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e78aaf0 0x55d45e78cf20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f80781040f0 tx=0x7f807810ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfc648e286a6c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f80894d7640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f806c0b54d0 0x7f806c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f8081ffb640 1 -- 172.21.15.19:0/1784734414 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f80781069e0 con 0x7f80841076b0 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f806affd640 1 -- 172.21.15.19:0/3950086598 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078106e60 con 0x55d45e78aaf0 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f806affd640 1 -- 172.21.15.19:0/3950086598 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8078104600 con 0x55d45e78aaf0 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.483+0000 7f806affd640 1 -- 172.21.15.19:0/3950086598 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80780c9500 con 0x55d45e78aaf0 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 -- 172.21.15.19:0/3950086598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e78aaf0 msgr2=0x55d45e78cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f80894d7640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f806c0b54d0 0x7f806c0b7990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f807c005fd0 tx=0x7f807c0096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e78aaf0 0x55d45e78cf20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f80781040f0 tx=0x7f807810ac40 comp rx=0 tx=0).stop 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 -- 172.21.15.19:0/3950086598 shutdown_connections 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e78aaf0 0x55d45e78cf20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e77cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 --2- 172.21.15.19:0/3950086598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e77c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 -- 172.21.15.19:0/3950086598 >> 172.21.15.19:0/3950086598 conn(0x55d45e77a130 msgr2=0x55d45e77b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:05.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 -- 172.21.15.19:0/3950086598 shutdown_connections 2024-09-11T00:13:05.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.484+0000 7f808d30f740 1 -- 172.21.15.19:0/3950086598 wait complete. 2024-09-11T00:13:05.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 -- start start 2024-09-11T00:13:05.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 Processor -- start 2024-09-11T00:13:05.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77bea0 0x55d45e78a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e7877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e787dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d45e541700 con 0x55d45e77bea0 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d45e67b160 con 0x55d45e77c920 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d45e78d800 con 0x55d45e78aaf0 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f808d30f740 10 client.0 _ll_register_callbacks cb 0x55d45e6949e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f8088cd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77bea0 0x55d45e78a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f8088cd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77bea0 0x55d45e78a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35868/0 (socket says 172.21.15.19:35868) 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f8088cd6640 1 -- 172.21.15.19:0/576415005 learned_addr learned my addr 172.21.15.19:0/576415005 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.485+0000 7f8083fff640 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e7877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f80894d7640 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e787dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8088cd6640 1 -- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 msgr2=0x55d45e787dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8088cd6640 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e787dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8088cd6640 1 -- 172.21.15.19:0/576415005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 msgr2=0x55d45e7877a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8088cd6640 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e7877a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8088cd6640 1 -- 172.21.15.19:0/576415005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d45e6a8c90 con 0x55d45e77bea0 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8088cd6640 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77bea0 0x55d45e78a350 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8074009fd0 tx=0x7f80740116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f160a8923f951f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8063fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8063fff640 1 -- 172.21.15.19:0/576415005 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8074019070 con 0x55d45e77bea0 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8063fff640 1 -- 172.21.15.19:0/576415005 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f8074015870 con 0x55d45e77bea0 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8078104600 con 0x55d45e77bea0 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f8063fff640 1 -- 172.21.15.19:0/576415005 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8074025050 con 0x55d45e77bea0 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f808d30f740 10 client.16884 fetch_fsmap learned FSMap version 39 2024-09-11T00:13:05.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.486+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d45e799110 con 0x55d45e77bea0 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f8063fff640 1 -- 172.21.15.19:0/576415005 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8078104600 con 0x55d45e77bea0 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f8063fff640 1 -- 172.21.15.19:0/576415005 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7f8074014b60 con 0x55d45e77bea0 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f808d30f740 10 client.16884 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f808d30f740 10 client.16884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f808d30f740 20 client.16884 populate_metadata read hostname 'smithi019' 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f808d30f740 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e79a570 0x55d45e79c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f808d30f740 4 client.16884 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:05.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d45e6f2df0 con 0x55d45e79a570 2024-09-11T00:13:05.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f8083fff640 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e79a570 0x55d45e79c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f8083fff640 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e79a570 0x55d45e79c9c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c03f46d1f3a1523 server_cookie=67cb8d57aa2c5481 in_seq=0 out_seq=0 2024-09-11T00:13:05.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.487+0000 7f8063fff640 10 client.16884 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:13:05.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f8063fff640 1 -- 172.21.15.19:0/576415005 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d45e6f2df0 con 0x55d45e79a570 2024-09-11T00:13:05.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f8063fff640 10 client.16884 handle_command_reply: tid=0 2024-09-11T00:13:05.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 client.16884 shutdown 2024-09-11T00:13:05.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77bea0 msgr2=0x55d45e78a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77bea0 0x55d45e78a350 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8074009fd0 tx=0x7f80740116f0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 shutdown_connections 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e787dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77c920 0x55d45e7877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e79a570 0x55d45e79c9c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f8063fff640 0 client.16884 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 --2- 172.21.15.19:0/576415005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77bea0 0x55d45e78a350 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.488+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 >> 172.21.15.19:0/576415005 conn(0x55d45e77a130 msgr2=0x55d45e77fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.489+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 shutdown_connections 2024-09-11T00:13:05.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.489+0000 7f808d30f740 1 -- 172.21.15.19:0/576415005 wait complete. 2024-09-11T00:13:05.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.489+0000 7f808d30f740 20 client.16884 trim_cache size 0 max 16384 2024-09-11T00:13:05.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 Processor -- start 2024-09-11T00:13:05.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 -- start start 2024-09-11T00:13:05.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77bea0 0x55d45e779a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e77e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e781c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f80841aecc0 con 0x55d45e77c920 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f80841ac590 con 0x55d45e77bea0 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f808d30f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80841aa400 con 0x55d45e78aaf0 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e77e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e77e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35884/0 (socket says 172.21.15.19:35884) 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f8083fff640 1 -- 172.21.15.19:0/32262651 learned_addr learned my addr 172.21.15.19:0/32262651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f80894d7640 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e781c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.502+0000 7f8088cd6640 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77bea0 0x55d45e779a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f8083fff640 1 -- 172.21.15.19:0/32262651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 msgr2=0x55d45e781c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f8083fff640 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e781c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f8083fff640 1 -- 172.21.15.19:0/32262651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77bea0 msgr2=0x55d45e779a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f8083fff640 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77bea0 0x55d45e779a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f8083fff640 1 -- 172.21.15.19:0/32262651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45e77abb0 con 0x55d45e77c920 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f80894d7640 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e781c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f8083fff640 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e77e360 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8078006010 tx=0x7f8078004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8200b50670d8b6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f806a7fc640 1 -- 172.21.15.19:0/32262651 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078106e60 con 0x55d45e77c920 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f806a7fc640 1 -- 172.21.15.19:0/32262651 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80780cc9c0 con 0x55d45e77c920 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.503+0000 7f806a7fc640 1 -- 172.21.15.19:0/32262651 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078049040 con 0x55d45e77c920 2024-09-11T00:13:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 -- 172.21.15.19:0/32262651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 msgr2=0x55d45e77e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e77e360 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8078006010 tx=0x7f8078004570 comp rx=0 tx=0).stop 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 -- 172.21.15.19:0/32262651 shutdown_connections 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e78aaf0 0x55d45e781c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e77e360 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 --2- 172.21.15.19:0/32262651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e77bea0 0x55d45e779a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 -- 172.21.15.19:0/32262651 >> 172.21.15.19:0/32262651 conn(0x55d45e77a130 msgr2=0x55d45e78c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 -- 172.21.15.19:0/32262651 shutdown_connections 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 -- 172.21.15.19:0/32262651 wait complete. 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 -- start start 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.504+0000 7f808d30f740 1 Processor -- start 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f808d30f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e7782f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f808d30f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e792a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f808d30f740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e78aaf0 0x55d45e7931e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f808d30f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f80841aaa50 con 0x55d45e77c920 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f808d30f740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f80841abec0 con 0x55d45e78aaf0 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f808d30f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80841ab120 con 0x55d45e77bea0 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f808d30f740 10 client.0 _ll_register_callbacks cb 0x7f80740094c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e792a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e792a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35900/0 (socket says 172.21.15.19:35900) 2024-09-11T00:13:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 -- 172.21.15.19:0/2019209465 learned_addr learned my addr 172.21.15.19:0/2019209465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8088cd6640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e7782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f80894d7640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e78aaf0 0x55d45e7931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 -- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 msgr2=0x55d45e7782f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e7782f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 -- 172.21.15.19:0/2019209465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e78aaf0 msgr2=0x55d45e7931e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e78aaf0 0x55d45e7931e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 -- 172.21.15.19:0/2019209465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d45e7a2170 con 0x55d45e77c920 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8088cd6640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e7782f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8083fff640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e792a50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f80780ca120 tx=0x7f807810ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd18df41a39f613 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.505+0000 7f8063fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f8063fff640 1 -- 172.21.15.19:0/2019209465 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078106e60 con 0x55d45e77c920 2024-09-11T00:13:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f8063fff640 1 -- 172.21.15.19:0/2019209465 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f8078104400 con 0x55d45e77c920 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80780cc9c0 con 0x55d45e77c920 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f8063fff640 1 -- 172.21.15.19:0/2019209465 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8078049070 con 0x55d45e77c920 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 10 client.16890 fetch_fsmap learned FSMap version 39 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d45e8077a0 con 0x55d45e77c920 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f8063fff640 1 -- 172.21.15.19:0/2019209465 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80780cc9c0 con 0x55d45e77c920 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f8063fff640 1 -- 172.21.15.19:0/2019209465 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8346+0+0 (secure 0 0 0) 0x7f80780b80c0 con 0x55d45e77c920 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 10 client.16890 fetch_fsmap finished waiting for FSMap version 39 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 20 client.16890 populate_metadata read hostname 'smithi019' 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e807b30 0x55d45e809f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 4 client.16890 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:13:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 --> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d45e6ee8a0 con 0x55d45e807b30 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.506+0000 7f8088cd6640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e807b30 0x55d45e809f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f8088cd6640 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e807b30 0x55d45e809f20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58a6bb0e71ebdf39 server_cookie=d846e474cb695728 in_seq=0 out_seq=0 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f8063fff640 10 client.16890 ms_handle_connect on v2:172.21.15.135:6838/2927257252 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f8063fff640 1 -- 172.21.15.19:0/2019209465 <== mds.0 v2:172.21.15.135:6838/2927257252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d45e6ee8a0 con 0x55d45e807b30 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f8063fff640 10 client.16890 handle_command_reply: tid=0 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 client.16890 shutdown 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 msgr2=0x55d45e792a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e792a50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f80780ca120 tx=0x7f807810ac40 comp rx=0 tx=0).stop 2024-09-11T00:13:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 shutdown_connections 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d45e78aaf0 0x55d45e7931e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:6838/2927257252,v1:172.21.15.135:6839/2927257252] conn(0x55d45e807b30 0x55d45e809f20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d45e77c920 0x55d45e792a50 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 --2- 172.21.15.19:0/2019209465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d45e77bea0 0x55d45e7782f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 >> 172.21.15.19:0/2019209465 conn(0x55d45e77a130 msgr2=0x55d45e788dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f8063fff640 0 client.16890 ms_handle_reset on v2:172.21.15.135:6838/2927257252 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 shutdown_connections 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.507+0000 7f808d30f740 1 -- 172.21.15.19:0/2019209465 wait complete. 2024-09-11T00:13:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808d30f740 20 client.16890 trim_cache size 0 max 16384 2024-09-11T00:13:05.520 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-11T00:13:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f806c0b54d0 msgr2=0x7f806c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f806c0b54d0 0x7f806c0b7990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f807c005fd0 tx=0x7f807c0096a0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 msgr2=0x7f8084198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084198740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8078005940 tx=0x7f80780042f0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 shutdown_connections 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8084108030 0x7f808419dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f806c0b54d0 0x7f806c0b7990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80841076b0 0x7f8084198740 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 --2- 172.21.15.19:0/1784734414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8084101ca0 0x7f8084198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 >> 172.21.15.19:0/1784734414 conn(0x7f80840fd730 msgr2=0x7f80840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 shutdown_connections 2024-09-11T00:13:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:05.508+0000 7f808af3a640 1 -- 172.21.15.19:0/1784734414 wait complete. 2024-09-11T00:13:06.370 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:06 smithi019 ceph-mon[30859]: pgmap v650: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:13:06.370 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:06 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:06.397 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-11T00:13:06.398 INFO:tasks.fwd_scrub:done joining 2024-09-11T00:13:06.398 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T00:13:06.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:13:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:06 smithi135 ceph-mon[35432]: pgmap v650: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:13:06.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:06 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:06.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 -- 172.21.15.19:0/2323855011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 msgr2=0x7faf6c1023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 --2- 172.21.15.19:0/2323855011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c1023c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009ca0 tx=0x7faf5c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 -- 172.21.15.19:0/2323855011 shutdown_connections 2024-09-11T00:13:06.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 --2- 172.21.15.19:0/2323855011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c107f40 0x7faf6c10e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 --2- 172.21.15.19:0/2323855011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf6c1075c0 0x7faf6c107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 --2- 172.21.15.19:0/2323855011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c1023c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 -- 172.21.15.19:0/2323855011 >> 172.21.15.19:0/2323855011 conn(0x7faf6c077670 msgr2=0x7faf6c077a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:06.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 -- 172.21.15.19:0/2323855011 shutdown_connections 2024-09-11T00:13:06.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.518+0000 7faf7093d640 1 -- 172.21.15.19:0/2323855011 wait complete. 2024-09-11T00:13:06.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 Processor -- start 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 -- start start 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c0fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c1075c0 0x7faf6c0ff350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf6c107f40 0x7faf6c0ff890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c111c50 con 0x7faf6c101fe0 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c111ad0 con 0x7faf6c107f40 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf7093d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c111dd0 con 0x7faf6c1075c0 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c0fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c0fee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35918/0 (socket says 172.21.15.19:35918) 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 -- 172.21.15.19:0/3838767800 learned_addr learned my addr 172.21.15.19:0/3838767800 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf69d9b640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c1075c0 0x7faf6c0ff350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6ad9d640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf6c107f40 0x7faf6c0ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 -- 172.21.15.19:0/3838767800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c1075c0 msgr2=0x7faf6c0ff350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c1075c0 0x7faf6c0ff350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 -- 172.21.15.19:0/3838767800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf6c107f40 msgr2=0x7faf6c0ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf6c107f40 0x7faf6c0ff890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.519+0000 7faf6a59c640 1 -- 172.21.15.19:0/3838767800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c1a76b0 con 0x7faf6c101fe0 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.520+0000 7faf6a59c640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c0fee10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf5c006010 tx=0x7faf5c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.520+0000 7faf5b7fe640 1 -- 172.21.15.19:0/3838767800 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c003bf0 con 0x7faf6c101fe0 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.520+0000 7faf5b7fe640 1 -- 172.21.15.19:0/3838767800 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf5c003d90 con 0x7faf6c101fe0 2024-09-11T00:13:06.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.520+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c1a7940 con 0x7faf6c101fe0 2024-09-11T00:13:06.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.520+0000 7faf5b7fe640 1 -- 172.21.15.19:0/3838767800 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c02fc20 con 0x7faf6c101fe0 2024-09-11T00:13:06.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.520+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c1a7e90 con 0x7faf6c101fe0 2024-09-11T00:13:06.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.521+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6c1023c0 con 0x7faf6c101fe0 2024-09-11T00:13:06.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.523+0000 7faf5b7fe640 1 -- 172.21.15.19:0/3838767800 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7faf5c0046a0 con 0x7faf6c101fe0 2024-09-11T00:13:06.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.523+0000 7faf5b7fe640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf540b5450 0x7faf540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.524+0000 7faf5b7fe640 1 -- 172.21.15.19:0/3838767800 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7faf5c1073a0 con 0x7faf6c101fe0 2024-09-11T00:13:06.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.524+0000 7faf69d9b640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf540b5450 0x7faf540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.524+0000 7faf69d9b640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf540b5450 0x7faf540b7910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faf6c100900 tx=0x7faf6000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:06.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.526+0000 7faf5b7fe640 1 -- 172.21.15.19:0/3838767800 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faf5c0cdf70 con 0x7faf6c101fe0 2024-09-11T00:13:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:06 smithi131 ceph-mon[35491]: pgmap v650: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:13:06.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:06 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:06.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.718+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf6c1a8220 con 0x7faf6c101fe0 2024-09-11T00:13:06.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.720+0000 7faf5b7fe640 1 -- 172.21.15.19:0/3838767800 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+23057 (secure 0 0 0) 0x7faf5c0cd870 con 0x7faf6c101fe0 2024-09-11T00:13:06.722 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:13:06.722 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":86,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:12:23.794807+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:13:06.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf540b5450 msgr2=0x7faf540b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf540b5450 0x7faf540b7910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faf6c100900 tx=0x7faf6000b390 comp rx=0 tx=0).stop 2024-09-11T00:13:06.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 msgr2=0x7faf6c0fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c0fee10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf5c006010 tx=0x7faf5c0319f0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 shutdown_connections 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf6c107f40 0x7faf6c0ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c1075c0 0x7faf6c0ff350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf540b5450 0x7faf540b7910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 --2- 172.21.15.19:0/3838767800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf6c101fe0 0x7faf6c0fee10 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.722+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 >> 172.21.15.19:0/3838767800 conn(0x7faf6c077670 msgr2=0x7faf6c101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.723+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 shutdown_connections 2024-09-11T00:13:06.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.723+0000 7faf7093d640 1 -- 172.21.15.19:0/3838767800 wait complete. 2024-09-11T00:13:06.737 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:55:46.863932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T00:00:24.308239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T00:00:26.972884+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 85, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T00:13:06.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T00:13:06.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 -- 172.21.15.19:0/3869011067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 msgr2=0x7fd68010f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 --2- 172.21.15.19:0/3869011067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68010f4f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd678009ca0 tx=0x7fd67802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 -- 172.21.15.19:0/3869011067 shutdown_connections 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 --2- 172.21.15.19:0/3869011067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68010f4f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 --2- 172.21.15.19:0/3869011067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd680104540 0x7fd68010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 --2- 172.21.15.19:0/3869011067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd680103c20 0x7fd680104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 -- 172.21.15.19:0/3869011067 >> 172.21.15.19:0/3869011067 conn(0x7fd6800fd630 msgr2=0x7fd6800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 -- 172.21.15.19:0/3869011067 shutdown_connections 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.851+0000 7fd6866e2640 1 -- 172.21.15.19:0/3869011067 wait complete. 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 Processor -- start 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 -- start start 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd680103c20 0x7fd680199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd680104540 0x7fd6801997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd680112d50 con 0x7fd68010d070 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd680112bd0 con 0x7fd680103c20 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd6866e2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd680112ed0 con 0x7fd680104540 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.852+0000 7fd684c7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68019eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35934/0 (socket says 172.21.15.19:35934) 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 -- 172.21.15.19:0/1695267453 learned_addr learned my addr 172.21.15.19:0/1695267453 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd67ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd680103c20 0x7fd680199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd67f7fe640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd680104540 0x7fd6801997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 -- 172.21.15.19:0/1695267453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd680104540 msgr2=0x7fd6801997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd680104540 0x7fd6801997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 -- 172.21.15.19:0/1695267453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd680103c20 msgr2=0x7fd680199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd680103c20 0x7fd680199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 -- 172.21.15.19:0/1695267453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68019f310 con 0x7fd68010d070 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd67ffff640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd680103c20 0x7fd680199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd684c7f640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68019eb40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd678009430 tx=0x7fd6780317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd67d7fa640 1 -- 172.21.15.19:0/1695267453 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678003b70 con 0x7fd68010d070 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd67d7fa640 1 -- 172.21.15.19:0/1695267453 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd678003d10 con 0x7fd68010d070 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68019f5a0 con 0x7fd68010d070 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd67d7fa640 1 -- 172.21.15.19:0/1695267453 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67802fa30 con 0x7fd68010d070 2024-09-11T00:13:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.853+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6801a5cc0 con 0x7fd68010d070 2024-09-11T00:13:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.854+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd680104000 con 0x7fd68010d070 2024-09-11T00:13:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.856+0000 7fd67d7fa640 1 -- 172.21.15.19:0/1695267453 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fd67802fbd0 con 0x7fd68010d070 2024-09-11T00:13:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.857+0000 7fd67d7fa640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6680b5450 0x7fd6680b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.857+0000 7fd67d7fa640 1 -- 172.21.15.19:0/1695267453 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fd678107320 con 0x7fd68010d070 2024-09-11T00:13:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.857+0000 7fd67ffff640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6680b5450 0x7fd6680b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.857+0000 7fd67ffff640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6680b5450 0x7fd6680b7910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd670005d00 tx=0x7fd67000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:06.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:06.860+0000 7fd67d7fa640 1 -- 172.21.15.19:0/1695267453 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd6780cdef0 con 0x7fd68010d070 2024-09-11T00:13:07.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.046+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd6801a6090 con 0x7fd68010d070 2024-09-11T00:13:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.047+0000 7fd67d7fa640 1 -- 172.21.15.19:0/1695267453 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7fd6780cd7f0 con 0x7fd68010d070 2024-09-11T00:13:07.049 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6680b5450 msgr2=0x7fd6680b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6680b5450 0x7fd6680b7910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd670005d00 tx=0x7fd67000b410 comp rx=0 tx=0).stop 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 msgr2=0x7fd68019eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68019eb40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd678009430 tx=0x7fd6780317c0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 shutdown_connections 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd6680b5450 0x7fd6680b7910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd68010d070 0x7fd68019eb40 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd680104540 0x7fd6801997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 --2- 172.21.15.19:0/1695267453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd680103c20 0x7fd680199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 >> 172.21.15.19:0/1695267453 conn(0x7fd6800fd630 msgr2=0x7fd68010f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 shutdown_connections 2024-09-11T00:13:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.049+0000 7fd6866e2640 1 -- 172.21.15.19:0/1695267453 wait complete. 2024-09-11T00:13:07.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 -- 172.21.15.19:0/2172949508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 msgr2=0x7f3934104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 --2- 172.21.15.19:0/2172949508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f3934104800 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3924009ca0 tx=0x7f392402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 -- 172.21.15.19:0/2172949508 shutdown_connections 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 --2- 172.21.15.19:0/2172949508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3934104d40 0x7f393410e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 --2- 172.21.15.19:0/2172949508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f3934104800 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 --2- 172.21.15.19:0/2172949508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3934101f80 0x7f3934102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 -- 172.21.15.19:0/2172949508 >> 172.21.15.19:0/2172949508 conn(0x7f39340776b0 msgr2=0x7f3934077ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 -- 172.21.15.19:0/2172949508 shutdown_connections 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.171+0000 7f393ac95640 1 -- 172.21.15.19:0/2172949508 wait complete. 2024-09-11T00:13:07.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 Processor -- start 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 -- start start 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3934101f80 0x7f393419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f393419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3934104d40 0x7f393419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3934111c00 con 0x7f39341043a0 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3934111a80 con 0x7f3934101f80 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f393ac95640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3934111d80 con 0x7f3934104d40 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f393419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f393419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35954/0 (socket says 172.21.15.19:35954) 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 -- 172.21.15.19:0/3424524083 learned_addr learned my addr 172.21.15.19:0/3424524083 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3938a31640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3934101f80 0x7f393419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3939232640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3934104d40 0x7f393419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 -- 172.21.15.19:0/3424524083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3934104d40 msgr2=0x7f393419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3934104d40 0x7f393419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 -- 172.21.15.19:0/3424524083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3934101f80 msgr2=0x7f393419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3934101f80 0x7f393419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3933fff640 1 -- 172.21.15.19:0/3424524083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39341a5450 con 0x7f39341043a0 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.172+0000 7f3938a31640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3934101f80 0x7f393419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.173+0000 7f3933fff640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f393419a590 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3924033040 tx=0x7f39240316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.173+0000 7f3931ffb640 1 -- 172.21.15.19:0/3424524083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924003b70 con 0x7f39341043a0 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.173+0000 7f3931ffb640 1 -- 172.21.15.19:0/3424524083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3924003d10 con 0x7f39341043a0 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.173+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39341a56e0 con 0x7f39341043a0 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.173+0000 7f3931ffb640 1 -- 172.21.15.19:0/3424524083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392402f9e0 con 0x7f39341043a0 2024-09-11T00:13:07.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.173+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39341a5c30 con 0x7f39341043a0 2024-09-11T00:13:07.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.174+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3934102360 con 0x7f39341043a0 2024-09-11T00:13:07.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.176+0000 7f3931ffb640 1 -- 172.21.15.19:0/3424524083 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f392402fb80 con 0x7f39341043a0 2024-09-11T00:13:07.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.176+0000 7f3931ffb640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39200b5450 0x7f39200b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.177+0000 7f3938a31640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39200b5450 0x7f39200b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.177+0000 7f3931ffb640 1 -- 172.21.15.19:0/3424524083 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7f3924107390 con 0x7f39341043a0 2024-09-11T00:13:07.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.177+0000 7f3938a31640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39200b5450 0x7f39200b7910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f391c009fc0 tx=0x7f391c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:07.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.183+0000 7f3931ffb640 1 -- 172.21.15.19:0/3424524083 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f39240cdf60 con 0x7f39341043a0 2024-09-11T00:13:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.381+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f393402e5c0 con 0x7f39341043a0 2024-09-11T00:13:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.381+0000 7f3931ffb640 1 -- 172.21.15.19:0/3424524083 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f39240cd860 con 0x7f39341043a0 2024-09-11T00:13:07.383 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-11T00:13:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39200b5450 msgr2=0x7f39200b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39200b5450 0x7f39200b7910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f391c009fc0 tx=0x7f391c005f90 comp rx=0 tx=0).stop 2024-09-11T00:13:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 msgr2=0x7f393419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f393419a590 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3924033040 tx=0x7f39240316f0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 shutdown_connections 2024-09-11T00:13:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3934104d40 0x7f393419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f39200b5450 0x7f39200b7910 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39341043a0 0x7f393419a590 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 --2- 172.21.15.19:0/3424524083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3934101f80 0x7f393419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 >> 172.21.15.19:0/3424524083 conn(0x7f39340776b0 msgr2=0x7f3934105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:07.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 shutdown_connections 2024-09-11T00:13:07.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.383+0000 7f393ac95640 1 -- 172.21.15.19:0/3424524083 wait complete. 2024-09-11T00:13:07.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T00:13:07.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 -- 172.21.15.19:0/145449480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 msgr2=0x7fd21c101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 --2- 172.21.15.19:0/145449480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c101fe0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd218009900 tx=0x7fd21802a410 comp rx=0 tx=0).stop 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 -- 172.21.15.19:0/145449480 shutdown_connections 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 --2- 172.21.15.19:0/145449480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21c107f80 0x7fd21c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 --2- 172.21.15.19:0/145449480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd21c107600 0x7fd21c107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 --2- 172.21.15.19:0/145449480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c101fe0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 -- 172.21.15.19:0/145449480 >> 172.21.15.19:0/145449480 conn(0x7fd21c0fd640 msgr2=0x7fd21c0ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 -- 172.21.15.19:0/145449480 shutdown_connections 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.505+0000 7fd223cfe640 1 -- 172.21.15.19:0/145449480 wait complete. 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 Processor -- start 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 -- start start 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c1034b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21c107600 0x7fd21c1039f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd21c107f80 0x7fd21c103f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c111c40 con 0x7fd21c101c00 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c111ac0 con 0x7fd21c107f80 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd223cfe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c111dc0 con 0x7fd21c107600 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c1034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c1034b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35962/0 (socket says 172.21.15.19:35962) 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 -- 172.21.15.19:0/2101957806 learned_addr learned my addr 172.21.15.19:0/2101957806 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221299640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21c107600 0x7fd21c1039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd22229b640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd21c107f80 0x7fd21c103f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 -- 172.21.15.19:0/2101957806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21c107600 msgr2=0x7fd21c1039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21c107600 0x7fd21c1039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 -- 172.21.15.19:0/2101957806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd21c107f80 msgr2=0x7fd21c103f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd21c107f80 0x7fd21c103f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 -- 172.21.15.19:0/2101957806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c1a7630 con 0x7fd21c101c00 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.506+0000 7fd221a9a640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c1034b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd218005940 tx=0x7fd218004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.507+0000 7fd212ffd640 1 -- 172.21.15.19:0/2101957806 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21803f030 con 0x7fd21c101c00 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.507+0000 7fd212ffd640 1 -- 172.21.15.19:0/2101957806 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd218003aa0 con 0x7fd21c101c00 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.507+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1a78c0 con 0x7fd21c101c00 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.507+0000 7fd212ffd640 1 -- 172.21.15.19:0/2101957806 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218035070 con 0x7fd21c101c00 2024-09-11T00:13:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.507+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1a7db0 con 0x7fd21c101c00 2024-09-11T00:13:07.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.508+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c101fe0 con 0x7fd21c101c00 2024-09-11T00:13:07.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.509+0000 7fd212ffd640 1 -- 172.21.15.19:0/2101957806 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fd21803bcc0 con 0x7fd21c101c00 2024-09-11T00:13:07.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.510+0000 7fd212ffd640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd2080b5450 0x7fd2080b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.510+0000 7fd221299640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd2080b5450 0x7fd2080b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.510+0000 7fd212ffd640 1 -- 172.21.15.19:0/2101957806 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7fd218106b50 con 0x7fd21c101c00 2024-09-11T00:13:07.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.511+0000 7fd221299640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd2080b5450 0x7fd2080b7910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd21c104fa0 tx=0x7fd20c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:07.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.513+0000 7fd212ffd640 1 -- 172.21.15.19:0/2101957806 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2180cd0d0 con 0x7fd21c101c00 2024-09-11T00:13:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.712+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd21c1a80e0 con 0x7fd21c101c00 2024-09-11T00:13:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.713+0000 7fd212ffd640 1 -- 172.21.15.19:0/2101957806 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7fd2180d1b00 con 0x7fd21c101c00 2024-09-11T00:13:07.715 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-09-11T00:13:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd2080b5450 msgr2=0x7fd2080b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd2080b5450 0x7fd2080b7910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd21c104fa0 tx=0x7fd20c005f90 comp rx=0 tx=0).stop 2024-09-11T00:13:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 msgr2=0x7fd21c1034b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c1034b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd218005940 tx=0x7fd218004270 comp rx=0 tx=0).stop 2024-09-11T00:13:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 shutdown_connections 2024-09-11T00:13:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd21c107f80 0x7fd21c103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd21c107600 0x7fd21c1039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fd2080b5450 0x7fd2080b7910 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 --2- 172.21.15.19:0/2101957806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd21c101c00 0x7fd21c1034b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 >> 172.21.15.19:0/2101957806 conn(0x7fd21c0fd640 msgr2=0x7fd21c06b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 shutdown_connections 2024-09-11T00:13:07.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.715+0000 7fd223cfe640 1 -- 172.21.15.19:0/2101957806 wait complete. 2024-09-11T00:13:07.728 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.728 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.728 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: pgmap v651: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:13:07.728 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3838767800' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:07.728 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1695267453' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:13:07.728 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/3424524083' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:13:07.728 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.729 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:07 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T00:13:07.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: pgmap v651: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:13:07.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3838767800' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:07.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1695267453' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:13:07.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/3424524083' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:13:07.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:07 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 -- 172.21.15.19:0/2072096385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf38108720 msgr2=0x7faf38108b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/2072096385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf38108720 0x7faf38108b60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009900 tx=0x7faf2c02a410 comp rx=0 tx=0).stop 2024-09-11T00:13:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 -- 172.21.15.19:0/2072096385 shutdown_connections 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/2072096385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf381090a0 0x7faf3810f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/2072096385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf38108720 0x7faf38108b60 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/2072096385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf38102d20 0x7faf38103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 -- 172.21.15.19:0/2072096385 >> 172.21.15.19:0/2072096385 conn(0x7faf380fe7a0 msgr2=0x7faf38100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 -- 172.21.15.19:0/2072096385 shutdown_connections 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.844+0000 7faf3c8b0640 1 -- 172.21.15.19:0/2072096385 wait complete. 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 Processor -- start 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 -- start start 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf38102d20 0x7faf38199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38108720 0x7faf38199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf381090a0 0x7faf3819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112d20 con 0x7faf381090a0 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112ba0 con 0x7faf38108720 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.845+0000 7faf3c8b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112ea0 con 0x7faf38102d20 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf36d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf381090a0 0x7faf3819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf36d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf381090a0 0x7faf3819eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35968/0 (socket says 172.21.15.19:35968) 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf38102d20 0x7faf38199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf36d9d640 1 -- 172.21.15.19:0/634431256 learned_addr learned my addr 172.21.15.19:0/634431256 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf35d9b640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38108720 0x7faf38199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3659c640 1 -- 172.21.15.19:0/634431256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38108720 msgr2=0x7faf38199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3659c640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38108720 0x7faf38199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3659c640 1 -- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf381090a0 msgr2=0x7faf3819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3659c640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf381090a0 0x7faf3819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3659c640 1 -- 172.21.15.19:0/634431256 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3819f2c0 con 0x7faf38102d20 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf35d9b640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38108720 0x7faf38199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf36d9d640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf381090a0 0x7faf3819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3659c640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf38102d20 0x7faf38199220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e9f0 tx=0x7faf2800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf277fe640 1 -- 172.21.15.19:0/634431256 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2800ccc0 con 0x7faf38102d20 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf277fe640 1 -- 172.21.15.19:0/634431256 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf28005020 con 0x7faf38102d20 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3819f5b0 con 0x7faf38102d20 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.846+0000 7faf277fe640 1 -- 172.21.15.19:0/634431256 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28004a00 con 0x7faf38102d20 2024-09-11T00:13:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.847+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf381a5c70 con 0x7faf38102d20 2024-09-11T00:13:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.847+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf38103100 con 0x7faf38102d20 2024-09-11T00:13:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.849+0000 7faf277fe640 1 -- 172.21.15.19:0/634431256 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7faf28004ba0 con 0x7faf38102d20 2024-09-11T00:13:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.850+0000 7faf277fe640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf200b5450 0x7faf200b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.850+0000 7faf277fe640 1 -- 172.21.15.19:0/634431256 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8441+0+0 (secure 0 0 0) 0x7faf280e60d0 con 0x7faf38102d20 2024-09-11T00:13:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.850+0000 7faf35d9b640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf200b5450 0x7faf200b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.850+0000 7faf35d9b640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf200b5450 0x7faf200b7910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faf2c031440 tx=0x7faf2c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:07.853+0000 7faf277fe640 1 -- 172.21.15.19:0/634431256 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faf280accd0 con 0x7faf38102d20 2024-09-11T00:13:07.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: pgmap v651: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-11T00:13:07.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3838767800' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:07.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1695267453' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:13:07.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/3424524083' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:13:07.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:07.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:07 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:08.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.102+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7faf3802e5c0 con 0x7faf38102d20 2024-09-11T00:13:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.111+0000 7faf277fe640 1 -- 172.21.15.19:0/634431256 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+828474 (secure 0 0 0) 0x7faf280ac5d0 con 0x7faf38102d20 2024-09-11T00:13:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:13:08.123 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:13:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 26, 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "active_gid": 14220, 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "active_name": "x", 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "active_addrs": { 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6800", 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1170299416 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-11T00:13:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6801", 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1170299416 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "active_addr": "172.21.15.19:6801/1170299416", 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "active_change": "2024-09-10T23:53:52.390776+0000", 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "active_mgr_features": 4540719139924082687, 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "available": true, 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "standbys": [ 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "gid": 24136, 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "z", 2024-09-11T00:13:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_features": 4540719139924082687, 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-11T00:13:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-11T00:13:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-11T00:13:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-11T00:13:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:13:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-11T00:13:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-11T00:13:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:13:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-11T00:13:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:13:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-11T00:13:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:13:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:13:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:13:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:13:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-11T00:13:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-11T00:13:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nginx": { 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nginx", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nginx container image", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-11T00:13:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:13:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:13:08.192 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba_metrics": { 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.193 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.194 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-11T00:13:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:13:08.196 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:13:08.197 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-11T00:13:08.198 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.199 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.203 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.204 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.205 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:13:08.206 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.207 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.208 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.211 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:13:08.213 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.214 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.215 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.217 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.218 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-11T00:13:08.219 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-11T00:13:08.220 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.221 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.222 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.223 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.224 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-11T00:13:08.225 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.226 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:13:08.227 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.228 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.229 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.230 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.232 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:13:08.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:13:08.234 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-11T00:13:08.235 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.238 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.239 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.240 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.241 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.242 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.243 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.244 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.246 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.247 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.248 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.249 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.250 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.251 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.252 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:13:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.254 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.255 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.257 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.258 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.259 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.260 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.261 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.262 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.263 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:08.264 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.265 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.266 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.267 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.268 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.269 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "[]", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.270 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "{}", 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:13:08.271 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:13:08.272 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.273 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.275 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.276 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.277 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.279 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.280 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.281 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.282 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.283 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-11T00:13:08.284 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.285 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.286 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.287 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:13:08.288 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.289 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.292 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.293 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.294 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.295 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.296 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.297 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.298 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.299 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.300 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.301 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.302 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.303 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.304 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.305 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.306 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.307 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-11T00:13:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.312 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.316 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-11T00:13:08.317 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.318 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.319 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-11T00:13:08.320 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.321 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.322 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.323 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.324 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.325 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-11T00:13:08.326 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.328 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.329 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.330 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.331 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.332 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-11T00:13:08.333 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.335 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.338 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.339 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-11T00:13:08.340 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-11T00:13:08.341 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.343 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.344 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.345 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-11T00:13:08.346 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.347 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.348 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.350 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.352 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.353 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.354 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.357 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.358 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.359 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.360 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-11T00:13:08.361 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.362 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.363 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.364 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.365 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.366 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.367 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.368 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.369 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.370 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.371 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.373 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.374 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.375 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.377 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.378 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:13:08.378 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.378 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-11T00:13:08.379 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.380 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.382 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.383 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.384 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.385 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.386 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.387 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.389 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.390 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.391 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.392 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.393 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.394 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.395 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.396 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-11T00:13:08.397 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.398 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-11T00:13:08.399 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.400 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.401 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.403 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.404 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.405 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.407 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.409 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.410 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.411 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.413 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.413 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.413 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.413 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.413 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.413 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.413 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.414 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.416 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.417 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.418 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.419 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.420 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-11T00:13:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:13:08.423 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.424 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.425 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.426 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.427 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.428 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.429 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.430 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.432 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.433 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.435 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.436 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.437 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.439 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.440 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.441 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.442 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.443 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.444 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.446 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.451 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.452 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.456 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.457 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.458 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.459 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.460 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.461 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.462 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.463 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:13:08.464 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.465 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.466 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.467 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:13:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.469 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.470 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.471 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.472 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.473 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.474 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.475 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:08.477 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:08.478 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.479 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.480 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.481 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-11T00:13:08.482 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-11T00:13:08.483 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.484 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.485 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.486 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.487 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.488 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.489 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.490 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.491 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.492 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.493 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.494 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.495 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.496 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.497 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.498 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.500 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.501 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "max_requests": { 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_requests", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.502 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.503 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.504 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.505 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.507 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.510 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.511 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.511 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.511 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.511 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.512 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.513 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.514 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.516 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.517 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.518 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.519 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.521 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.522 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:13:08.523 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.524 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.525 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.526 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.527 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.529 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.530 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.531 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.532 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.533 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.534 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.535 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.536 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.538 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.539 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.541 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.542 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smb", 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "internal_store_backend": { 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "internal_store_backend", 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.545 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.546 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.548 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.549 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.550 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "update_orchestration": { 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "update_orchestration", 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.551 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.553 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.554 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.555 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.556 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.557 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.558 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.559 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.560 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.561 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.562 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.563 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.564 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.565 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.566 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.567 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.568 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.569 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.570 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.571 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.573 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.574 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.576 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.577 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.578 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.579 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.584 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-11T00:13:08.585 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-11T00:13:08.586 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-11T00:13:08.587 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.590 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.591 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.593 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.594 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-11T00:13:08.595 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.596 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.597 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.600 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.601 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.602 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.603 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.604 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.605 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.606 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.607 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:13:08.608 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.609 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.610 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.611 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.612 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.613 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.614 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.615 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.616 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.617 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.618 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.619 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.620 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.621 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.623 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:13:08.624 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:13:08.625 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.626 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.628 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.629 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.630 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.631 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.632 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.633 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.634 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.635 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.636 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.637 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.638 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-11T00:13:08.639 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.640 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:08.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "gid": 24146, 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "y", 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_features": 4540719139924082687, 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.642 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.643 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.644 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.645 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.646 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.648 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-11T00:13:08.650 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.651 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-11T00:13:08.653 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.654 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.655 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.656 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.657 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.659 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-11T00:13:08.660 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.661 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-11T00:13:08.662 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.665 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.667 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.668 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.669 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.670 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.671 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.673 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-11T00:13:08.674 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.675 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.676 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-11T00:13:08.678 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-11T00:13:08.679 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.680 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.681 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.682 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.683 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-11T00:13:08.684 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.685 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-11T00:13:08.688 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.689 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.690 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.691 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.692 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.693 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-11T00:13:08.694 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-11T00:13:08.695 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-11T00:13:08.696 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-11T00:13:08.697 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.701 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-11T00:13:08.702 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nginx": { 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nginx", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nginx container image", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.703 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.704 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-11T00:13:08.705 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:13:08.706 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:08.707 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.708 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.709 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba_metrics": { 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.710 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.711 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.712 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.713 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:13:08.714 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.716 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.717 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:13:08.718 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.719 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.720 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.721 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.722 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.723 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.724 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.726 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.727 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.728 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.729 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.730 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.731 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.732 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:13:08.733 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.734 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.735 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.736 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.737 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:13:08.738 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-11T00:13:08.739 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.741 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.742 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.743 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:13:08.744 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.745 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.746 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.747 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.748 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.749 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.750 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-11T00:13:08.751 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.752 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.753 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.754 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.755 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.757 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.758 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.760 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.761 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.762 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:13:08.763 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:13:08.764 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.765 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.768 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.769 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.771 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.772 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.773 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.774 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.775 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.776 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.777 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.778 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:13:08.779 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.780 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.781 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.783 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.784 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.785 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.786 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "[]", 2024-09-11T00:13:08.787 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.788 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "{}", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.789 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.790 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.791 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:13:08.792 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:13:08.793 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.795 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.796 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.797 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.798 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-11T00:13:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:13:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:13:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-11T00:13:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:13:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:13:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:13:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-11T00:13:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-11T00:13:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-11T00:13:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-11T00:13:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:13:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-11T00:13:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.924 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.925 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.926 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.927 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.928 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.929 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.931 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.932 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.933 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.934 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-11T00:13:08.935 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.936 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.937 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.938 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.939 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.940 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.941 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-11T00:13:08.942 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.943 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.945 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.957 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.958 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.959 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.960 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.961 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.962 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.963 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.964 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.965 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.968 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.969 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.970 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.972 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.973 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.974 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.975 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:08.976 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.977 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.978 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.979 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.980 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.981 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.982 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.984 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:08.985 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-11T00:13:08.986 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.987 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.990 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:13:08.991 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.992 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.993 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.994 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:08.995 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.997 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.998 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.001 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.002 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:13:09.003 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.004 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.006 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.007 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.008 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.009 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.010 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.012 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "max_requests": { 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_requests", 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:13:09.015 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.016 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.017 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.019 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.020 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.021 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.024 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.025 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.026 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.027 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.028 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.029 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.030 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.031 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.032 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.033 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.034 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.035 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.036 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.037 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.038 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.040 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.041 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.042 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.043 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.044 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.045 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.046 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.047 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.048 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.049 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.050 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.051 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-11T00:13:09.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-11T00:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smb", 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "internal_store_backend": { 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "internal_store_backend", 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.055 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.056 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.057 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.058 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.059 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.060 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.061 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "update_orchestration": { 2024-09-11T00:13:09.062 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "update_orchestration", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.063 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.064 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.065 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.066 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.067 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.070 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.071 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.073 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.074 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.076 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.077 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.078 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-11T00:13:09.079 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.080 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.081 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.082 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.083 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.084 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.085 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-11T00:13:09.086 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.088 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.089 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.090 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.091 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.092 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.093 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.094 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-11T00:13:09.095 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:13:09.096 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:13:09.097 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.098 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.099 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.100 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.101 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.102 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.103 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.104 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.105 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.106 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-11T00:13:09.107 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.108 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.110 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.111 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.112 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.113 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.114 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.115 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.116 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.117 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.118 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.119 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.120 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.121 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.122 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.124 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.125 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.126 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.127 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.128 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.129 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.130 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.131 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:13:09.132 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.133 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.134 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.135 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.136 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.137 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.139 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.140 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.141 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.142 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.144 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.146 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.147 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.148 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: "modules": [ 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "dashboard", 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "iostat", 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "nfs", 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "restful", 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_schedule" 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.151 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.152 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.153 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.154 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.155 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.156 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.157 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.158 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.159 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.160 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.161 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.163 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-11T00:13:09.164 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-11T00:13:09.165 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.166 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.168 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.169 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.170 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-11T00:13:09.171 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.172 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.173 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.174 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:09.175 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.176 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.177 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.178 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.179 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.182 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-11T00:13:09.183 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.184 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.186 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-11T00:13:09.187 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-11T00:13:09.188 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.190 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-11T00:13:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.192 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.193 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.195 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-11T00:13:09.196 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.197 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.198 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.199 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:13:09.200 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:09.201 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.202 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.203 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.204 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.205 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.206 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.207 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.208 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.209 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-11T00:13:09.210 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nginx": { 2024-09-11T00:13:09.211 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nginx", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nginx container image", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.212 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.215 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.216 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-11T00:13:09.217 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:13:09.218 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba_metrics": { 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.219 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.220 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.221 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:13:09.222 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:13:09.223 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.226 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.227 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:13:09.228 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.229 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.230 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.231 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.233 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.235 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.236 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.237 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.238 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:13:09.239 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:13:09.240 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.241 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-11T00:13:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.251 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.252 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.253 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.254 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-11T00:13:09.255 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-11T00:13:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.257 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.259 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:13:09.260 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.261 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.262 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.263 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.265 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.267 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.268 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.269 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.270 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:13:09.271 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.272 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.274 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.275 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.276 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.277 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.278 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.280 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.281 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.283 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.284 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:13:09.285 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:13:09.286 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.287 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.288 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.290 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.291 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.292 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.293 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.294 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "[]", 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.295 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "{}", 2024-09-11T00:13:09.296 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.297 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.298 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.299 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.300 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.301 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:13:09.302 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:13:09.303 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.304 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.307 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.308 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.309 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.310 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-11T00:13:09.311 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.312 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.313 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.314 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.315 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:13:09.316 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:13:09.317 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:13:09.318 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.319 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.322 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.323 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.324 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.329 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.330 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.333 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.334 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.335 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.336 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.337 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.338 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.339 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.340 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.341 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.343 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.344 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.349 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.351 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.353 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.354 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-11T00:13:09.355 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:09.356 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.357 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.358 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.359 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.360 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.361 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.362 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.364 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-11T00:13:09.365 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-11T00:13:09.366 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.367 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.369 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-11T00:13:09.370 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.371 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.372 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.373 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.374 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.375 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.377 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.378 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.379 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:13:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.381 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.382 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.383 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:09.384 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.385 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.386 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.387 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.389 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.390 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.391 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.392 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.393 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.394 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.395 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.396 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.398 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.399 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.400 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.404 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.405 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.406 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.407 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.408 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.409 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.410 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.412 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.414 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.415 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.416 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.417 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.418 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-11T00:13:09.419 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.420 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.421 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-11T00:13:09.423 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.424 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.425 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.426 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.427 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.430 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.431 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.435 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.436 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.437 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.438 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.439 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.440 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.441 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.442 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.443 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-11T00:13:09.444 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.445 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.446 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.447 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.448 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.449 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.451 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.456 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.457 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.458 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.460 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.461 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.462 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.463 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.465 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.466 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.467 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.468 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.469 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.470 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.471 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.472 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.474 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.475 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-11T00:13:09.476 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.477 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.478 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.479 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.480 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.481 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.483 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.484 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.485 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-11T00:13:09.486 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.487 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.488 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.489 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.491 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.492 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.493 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.494 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.498 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.499 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.500 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.501 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.502 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-11T00:13:09.503 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.504 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.505 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.507 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.508 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.509 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.510 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.511 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.514 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.515 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.516 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.518 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.519 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.520 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.521 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.522 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.523 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.524 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "max_requests": { 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_requests", 2024-09-11T00:13:09.525 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-11T00:13:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.527 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.529 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.529 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.529 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.529 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.529 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.529 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.529 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.532 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.532 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.532 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.532 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.532 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.532 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.533 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.534 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.535 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.536 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.537 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.538 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.539 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.540 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.541 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.542 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.543 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.544 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.545 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.547 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.548 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.549 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.550 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.551 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.552 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.553 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.554 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.556 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.557 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.558 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.559 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.560 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.561 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.562 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.563 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.564 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.565 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-11T00:13:09.566 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-11T00:13:09.567 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.568 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smb", 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "internal_store_backend": { 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "internal_store_backend", 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.569 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.570 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.572 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.573 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.574 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.575 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "update_orchestration": { 2024-09-11T00:13:09.576 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "update_orchestration", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.577 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.578 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.579 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.580 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.581 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.582 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.583 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.584 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.586 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.587 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.588 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.589 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.590 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.591 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.592 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.594 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.595 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.596 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.597 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.598 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.599 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:13:09.601 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-11T00:13:09.602 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.603 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.604 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.605 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.606 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.608 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.609 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.610 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.611 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.612 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.613 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-11T00:13:09.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-11T00:13:09.615 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-11T00:13:09.616 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.617 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.619 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.620 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.621 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.623 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.624 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.625 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.626 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.627 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.628 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.629 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.630 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.631 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.632 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.634 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.635 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.636 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.637 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.638 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.639 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.641 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.642 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.643 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.645 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.646 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.647 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.648 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.649 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.650 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-11T00:13:09.652 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.653 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-11T00:13:09.654 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.655 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.656 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.657 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-11T00:13:09.658 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.659 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.660 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.661 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.662 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.663 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-11T00:13:09.664 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "services": { 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "dashboard": "https://172.21.15.19:8443/" 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.665 INFO:teuthology.orchestra.run.smithi019.stdout: "always_on_modules": { 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "octopus": [ 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-11T00:13:09.666 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "pacific": [ 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.667 INFO:teuthology.orchestra.run.smithi019.stdout: "quincy": [ 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "reef": [ 2024-09-11T00:13:09.668 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "squid": [ 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-11T00:13:09.669 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "force_disabled_modules": {}, 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "last_failure_osd_epoch": 5, 2024-09-11T00:13:09.670 INFO:teuthology.orchestra.run.smithi019.stdout: "active_clients": [ 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 4080365482 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "libcephsqlite", 2024-09-11T00:13:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3646443247 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-11T00:13:09.672 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3646002506 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1151503012 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 517140134 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-11T00:13:09.674 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 4002228917 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-11T00:13:09.675 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf200b5450 msgr2=0x7faf200b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf200b5450 0x7faf200b7910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faf2c031440 tx=0x7faf2c005a20 comp rx=0 tx=0).stop 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf38102d20 msgr2=0x7faf38199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf38102d20 0x7faf38199220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e9f0 tx=0x7faf2800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 shutdown_connections 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7faf200b5450 0x7faf200b7910 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf381090a0 0x7faf3819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38108720 0x7faf38199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 --2- 172.21.15.19:0/634431256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf38102d20 0x7faf38199220 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 >> 172.21.15.19:0/634431256 conn(0x7faf380fe7a0 msgr2=0x7faf38100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 shutdown_connections 2024-09-11T00:13:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:08.117+0000 7faf3c8b0640 1 -- 172.21.15.19:0/634431256 wait complete. 2024-09-11T00:13:09.685 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T00:13:09.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2101957806' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/634431256' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:09.686 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:08 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2101957806' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:13:09.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/634431256' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:08 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2101957806' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/634431256' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:09.688 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:08 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' 2024-09-11T00:13:09.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:09 smithi019 ceph-mon[30859]: pgmap v652: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:13:09.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:09 smithi131 ceph-mon[35491]: pgmap v652: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:13:09.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:09 smithi135 ceph-mon[35432]: pgmap v652: 97 pgs: 97 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-11T00:13:09.957 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 215, 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 208, 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 1136416, 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 127888, 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.040337165, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.017013024, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.030982742, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 207, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.010945062, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000052874 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 1136416, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 127888 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 5, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 160, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 3200, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 108560, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.015709094, 2024-09-11T00:13:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.010759678, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.003400869, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 159, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.011137770, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000070048 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 108560 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.000330554, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:13:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000254818, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 149007, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 30, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-11T00:13:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 216, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 1106043, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 216, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 216, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1106043, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:10.693 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:13:11.538 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-11T00:13:11.539 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-11T00:13:11.539 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-11T00:13:11.539 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-11T00:13:11.539 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-11T00:13:11.539 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-11T00:13:11.539 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-11T00:13:11.539 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-11T00:13:11.539 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T00:13:11.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T00:13:11.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:11 smithi019 ceph-mon[30859]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T00:13:11.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:11 smithi019 ceph-mon[30859]: pgmap v654: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-11T00:13:11.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:11 smithi131 ceph-mon[35491]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T00:13:11.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:11 smithi131 ceph-mon[35491]: pgmap v654: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-11T00:13:11.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:11 smithi135 ceph-mon[35432]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T00:13:11.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:11 smithi135 ceph-mon[35432]: pgmap v654: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 826 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-11T00:13:11.992 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:12.863 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:13:12.863 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 225, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 216, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 1141088, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 132192, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.041284074, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.018047972, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.030955075, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 216, 2024-09-11T00:13:12.864 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.014884447, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000068909 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 1141088, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 132192 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1, 2024-09-11T00:13:12.865 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 163, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 108992, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.013688453, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.010827269, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.001250144, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 161, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.007089526, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000044034 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.866 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 108992 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-11T00:13:12.867 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.000327149, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000239676, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:12.868 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-11T00:13:12.869 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:12.870 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:12.871 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 149024, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 31, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-11T00:13:12.872 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-11T00:13:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 222, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 1106823, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 222, 2024-09-11T00:13:12.874 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 222, 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1106823, 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:12.875 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-11T00:13:13.931 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-11T00:13:13.931 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T00:13:13.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T00:13:14.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:13 smithi019 ceph-mon[30859]: pgmap v655: 97 pgs: 25 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 59 active+clean; 824 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:13:14.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:13 smithi131 ceph-mon[35491]: pgmap v655: 97 pgs: 25 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 59 active+clean; 824 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:13:14.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:13 smithi135 ceph-mon[35432]: pgmap v655: 97 pgs: 25 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 59 active+clean; 824 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-09-11T00:13:14.380 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:15.046 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:13:15.046 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:15.046 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-11T00:13:15.046 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-11T00:13:15.046 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.001333284, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000191759, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:15.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 221, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 212, 2024-09-11T00:13:15.048 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 1140000, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 129632, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.040331439, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.017603409, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.032046254, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 212, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.026418874, 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000124617 2024-09-11T00:13:15.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 1140000, 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 129632 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 160, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 108464, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.014715162, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.011825613, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.001314564, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 158, 2024-09-11T00:13:15.051 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.009039083, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000057209 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 108464 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-11T00:13:15.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:15.053 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:15.054 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 148967, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 29, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:15.055 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-11T00:13:15.056 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 218, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 1106303, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:15.057 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 218, 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 218, 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1106303, 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:15.058 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:13:16.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:15 smithi019 ceph-mon[30859]: pgmap v656: 97 pgs: 27 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 52 active+clean; 822 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:16.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:15 smithi131 ceph-mon[35491]: pgmap v656: 97 pgs: 27 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 52 active+clean; 822 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:16.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:15 smithi135 ceph-mon[35432]: pgmap v656: 97 pgs: 27 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 52 active+clean; 822 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:16.798 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-11T00:13:16.798 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-11T00:13:16.798 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-11T00:13:16.798 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-11T00:13:16.798 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-11T00:13:16.798 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-11T00:13:16.799 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-11T00:13:16.799 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-11T00:13:16.799 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T00:13:16.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T00:13:17.078 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:17.596 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.001436788, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:13:17.597 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000311947, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:17.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 224, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 217, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 1138928, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 133184, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.040076298, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.017756724, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.031074696, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 216, 2024-09-11T00:13:17.599 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.011024705, 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000051040 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 1138928, 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 133184 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:17.600 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 5, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 166, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 3200, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 109616, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.018216292, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.012647094, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.003963023, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 165, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.014980516, 2024-09-11T00:13:17.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000090791 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 109616 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.602 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:17.604 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 148984, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 30, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:17.605 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-11T00:13:17.606 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 225, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 1107277, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:17.607 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 225, 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 225, 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1107277, 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-11T00:13:17.608 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-11T00:13:18.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:17 smithi131 ceph-mon[35491]: pgmap v657: 97 pgs: 29 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 49 active+clean; 817 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:18.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:17 smithi135 ceph-mon[35432]: pgmap v657: 97 pgs: 29 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 49 active+clean; 817 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:18.233 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:17 smithi019 ceph-mon[30859]: pgmap v657: 97 pgs: 29 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 49 active+clean; 817 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-11T00:13:18.362 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-11T00:13:18.362 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T00:13:18.363 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T00:13:18.622 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:13:19.149 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-11T00:13:19.149 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:19.149 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 23412, 2024-09-11T00:13:19.149 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 21975, 2024-09-11T00:13:19.149 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 8518217, 2024-09-11T00:13:19.149 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 16014539, 2024-09-11T00:13:19.149 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 11, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 5, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 1.100216362, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.574367674, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.876671011, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.024491223, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 21974, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.334604550, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000015227 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 39692, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.005003873, 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000126 2024-09-11T00:13:19.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 1242464, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 141088 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 9199, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 5245, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 5885065, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 2324870, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 38, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 10, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.521932904, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.232295854, 2024-09-11T00:13:19.151 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.391156289, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.007791181, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 5244, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.116461916, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000022208 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 13181, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.001832395, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000139 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.152 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 5376, 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 373648 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 391, 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 425, 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 127590, 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 242265, 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 8, 2024-09-11T00:13:19.153 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 6, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.034536616, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.014540603, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.009659849, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.008331949, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 423, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.025322002, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000059862 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 54, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000015509, 2024-09-11T00:13:19.154 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000287 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 3296, 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 12192 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2024-09-11T00:13:19.155 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1309, 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1.194159862, 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000912268 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 438, 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.018778169, 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000042872 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 12769, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 11482, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 11482, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 230.962946514, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.020115219 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 1287, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 0, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2024-09-11T00:13:19.157 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 20, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 1, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 0, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 25, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 7, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 8, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 10, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 13, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 1276, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 1, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 1, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 4, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 26587, 2024-09-11T00:13:19.158 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 13467, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 1284, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 261, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 37, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 0, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 0, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 8, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 889, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 1, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 213, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 646, 2024-09-11T00:13:19.159 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 0, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 4, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 234, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 6, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 646, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 646, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 5, 2024-09-11T00:13:19.160 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 1945, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 2018, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 5373, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 141, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 16, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 791 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 60, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 3772, 2024-09-11T00:13:19.161 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 2062, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 2411, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 53, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 0, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 209, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 209, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 0, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 0, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:13:19.162 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 8, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 1, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "uninline_started": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "uninline_succeeded": 0, 2024-09-11T00:13:19.163 INFO:teuthology.orchestra.run.smithi131.stdout: "uninline_write_failed": 0 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "evlrg": 0, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 2108, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 0, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 0, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 2108, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 0, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 4, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 0, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 0, 2024-09-11T00:13:19.164 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 4, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "segmjr": 2, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 0, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 4194304, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 7974288, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 0, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 705, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 9.706032977, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.013767422 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 0 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 30, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 1118, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 1088, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 29, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 2007, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 1978, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 25, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 1639, 2024-09-11T00:13:19.166 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 1614, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 1, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 219, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 218, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 68708, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 276684800 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 12882, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 11, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 12769, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 22, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 42, 2024-09-11T00:13:19.167 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 137, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 2.850773311, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.020808564 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 110, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 4.767297357, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.043339066 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 10813, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 222.903395372, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.020614389 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2024-09-11T00:13:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 119, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.074216763, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000623670 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 8, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.009814275, 2024-09-11T00:13:19.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001226784 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 137, 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.165040176, 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001204672 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2024-09-11T00:13:19.174 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2024-09-11T00:13:19.176 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.177 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 158, 2024-09-11T00:13:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.192409260, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001217780 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 2, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 3, 2024-09-11T00:13:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 1, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 2, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 970, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 485, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 594, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mdthresh_evicted": 0 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:19.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:19.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 298984, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 123, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 352, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 4, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:19.183 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 8088, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 179, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 209141, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 599, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:19.184 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 1738, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 3993674, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 32, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 1738, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1738, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 11.690731502, 2024-09-11T00:13:19.185 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.006726542 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1738, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1828 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 1738, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 666, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 1072, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 0, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 10, 2024-09-11T00:13:19.186 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 20, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 725, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 40, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 1, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 221, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 646, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 20, 2024-09-11T00:13:19.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2024-09-11T00:13:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2024-09-11T00:13:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 87, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 11, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 12, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 12, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 122, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 0, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 23 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 1, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:13:19.190 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 10, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 10, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed_ops": 209, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 209, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 32998, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 11542399, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 32998, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 32998, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 11542399, 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:19.192 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:19.193 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 1738, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 4019983, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 1738, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 4019983, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:19.194 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 1738, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 1738, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 1738, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 1738, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 209, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 26309, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 209, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:19.196 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 20, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 26309, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x562d79034dc0": { 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 2108, 2024-09-11T00:13:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 3779984, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 2108, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 705, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 3779984, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "trackedop": { 2024-09-11T00:13:19.198 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 0 2024-09-11T00:13:19.199 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:19.199 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-11T00:13:19.948 INFO:tasks.check_counter:Daemon mds.b mds.exported=8 2024-09-11T00:13:19.949 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-11T00:13:19.949 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=60 2024-09-11T00:13:19.949 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=3772 2024-09-11T00:13:19.949 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-11T00:13:19.949 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-11T00:13:19.949 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T00:13:19.949 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=1 2024-09-11T00:13:19.949 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T00:13:19.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T00:13:20.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:19 smithi019 ceph-mon[30859]: pgmap v658: 97 pgs: 20 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 67 active+clean; 813 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:20.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:19 smithi131 ceph-mon[35491]: pgmap v658: 97 pgs: 20 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 67 active+clean; 813 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:20.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:19 smithi135 ceph-mon[35432]: pgmap v658: 97 pgs: 20 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 67 active+clean; 813 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-11T00:13:20.200 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:13:21.015 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 0, 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 2, 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 0, 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 0, 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.001049618, 2024-09-11T00:13:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.000194625, 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 226, 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 217, 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 1141360, 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 132832, 2024-09-11T00:13:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 2, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 1, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.042927418, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.018673815, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.034737232, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 217, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.016255540, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000074910 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 1141360, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 132832 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 1, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 164, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:13:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 109168, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 3, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.012650007, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.010028679, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.000874155, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 162, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.009452328, 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000058347 2024-09-11T00:13:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 109168 2024-09-11T00:13:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 0, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 149007, 2024-09-11T00:13:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 30, 2024-09-11T00:13:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2024-09-11T00:13:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 968, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 2, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 223, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 1106953, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 223, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 223, 2024-09-11T00:13:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 1106953, 2024-09-11T00:13:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:21.034 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-11T00:13:22.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:21 smithi131 ceph-mon[35491]: pgmap v659: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 812 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 200 B/s wr, 6 op/s 2024-09-11T00:13:22.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:21 smithi135 ceph-mon[35432]: pgmap v659: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 812 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 200 B/s wr, 6 op/s 2024-09-11T00:13:22.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:21 smithi019 ceph-mon[30859]: pgmap v659: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 812 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 200 B/s wr, 6 op/s 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-11T00:13:23.154 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-11T00:13:23.155 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T00:13:23.155 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T00:13:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 2245, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 2247, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 4413861, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 713917, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 6, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.191422195, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.084849225, 2024-09-11T00:13:23.918 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.042640255, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.051094471, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 2245, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.076186309, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000033935 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:23.919 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 7, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 167, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 3756, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 371930, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 3, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.013923097, 2024-09-11T00:13:23.920 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.009042291, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.003371605, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000041897, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 166, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.013829450, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000083309 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.921 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 371232 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 255, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 232, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 1228876, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 135006, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 3, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:23.922 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.041856393, 2024-09-11T00:13:23.923 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.019176864, 2024-09-11T00:13:23.923 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.033378231, 2024-09-11T00:13:23.923 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000014739, 2024-09-11T00:13:23.923 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:23.924 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 231, 2024-09-11T00:13:23.924 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.012724136, 2024-09-11T00:13:23.924 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000055082 2024-09-11T00:13:23.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.924 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:23.924 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.925 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.925 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.925 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 1228608, 2024-09-11T00:13:23.926 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 134688 2024-09-11T00:13:23.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.926 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2024-09-11T00:13:23.926 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2024-09-11T00:13:23.926 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3818, 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.084016412, 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000022005 2024-09-11T00:13:23.927 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 0, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 0, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 0, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 0, 2024-09-11T00:13:23.929 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 211, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 211, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 211, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 0, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 1, 2024-09-11T00:13:23.930 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 0, 2024-09-11T00:13:23.931 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 0, 2024-09-11T00:13:23.931 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 0, 2024-09-11T00:13:23.931 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 0, 2024-09-11T00:13:23.931 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:13:23.931 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2024-09-11T00:13:23.931 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 0, 2024-09-11T00:13:23.932 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 0, 2024-09-11T00:13:23.932 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 0, 2024-09-11T00:13:23.932 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 0, 2024-09-11T00:13:23.932 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 0, 2024-09-11T00:13:23.932 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 0, 2024-09-11T00:13:23.933 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 0, 2024-09-11T00:13:23.933 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2024-09-11T00:13:23.933 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:13:23.933 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 0, 2024-09-11T00:13:23.933 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 0, 2024-09-11T00:13:23.933 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 0, 2024-09-11T00:13:23.934 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 0, 2024-09-11T00:13:23.934 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:13:23.934 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2024-09-11T00:13:23.934 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:13:23.934 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:13:23.935 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:13:23.935 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:13:23.935 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:13:23.935 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 0, 2024-09-11T00:13:23.935 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:13:23.935 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T00:13:23.936 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:13:23.936 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:13:23.936 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:13:23.936 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:13:23.936 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 0, 2024-09-11T00:13:23.937 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:13:23.937 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 0, 2024-09-11T00:13:23.937 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 0 2024-09-11T00:13:23.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.937 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2024-09-11T00:13:23.938 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 0, 2024-09-11T00:13:23.938 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 0, 2024-09-11T00:13:23.938 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 0, 2024-09-11T00:13:23.938 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 0, 2024-09-11T00:13:23.938 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 0, 2024-09-11T00:13:23.938 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 0, 2024-09-11T00:13:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2024-09-11T00:13:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:13:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 0, 2024-09-11T00:13:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 0, 2024-09-11T00:13:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 0, 2024-09-11T00:13:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 0, 2024-09-11T00:13:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2024-09-11T00:13:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:13:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:13:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2024-09-11T00:13:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2024-09-11T00:13:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:13:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:13:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:13:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 0, 2024-09-11T00:13:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2024-09-11T00:13:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:13:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2024-09-11T00:13:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0, 2024-09-11T00:13:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "uninline_started": 0, 2024-09-11T00:13:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "uninline_succeeded": 0, 2024-09-11T00:13:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "uninline_write_failed": 0 2024-09-11T00:13:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2024-09-11T00:13:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "evlrg": 0, 2024-09-11T00:13:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 0, 2024-09-11T00:13:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 0, 2024-09-11T00:13:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 0, 2024-09-11T00:13:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 2108, 2024-09-11T00:13:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2024-09-11T00:13:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 0, 2024-09-11T00:13:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 0, 2024-09-11T00:13:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 0, 2024-09-11T00:13:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 0, 2024-09-11T00:13:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 4, 2024-09-11T00:13:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "segmjr": 2, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 0, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 4194304, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 7974288, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 7968563, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 2108 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 5, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 865, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 860, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 3, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 24, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 21, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 211, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 1240, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 1029, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 0, 2024-09-11T00:13:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 52072, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 253485056 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2024-09-11T00:13:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2024-09-11T00:13:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:13:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 2, 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 3, 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 1, 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 3, 2024-09-11T00:13:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 2679, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "mdthresh_evicted": 0 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 181360, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 48, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 8088, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 179, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 168192, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 898, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2024-09-11T00:13:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 2248, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 21, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 3, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 2248, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 2248, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1.363968738, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000606747 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 2248, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 2249 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 2248, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 2248, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 0, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 1416, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 0, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 830, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 0, 2024-09-11T00:13:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 1, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:13:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2024-09-11T00:13:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 88, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 12, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 4, 2024-09-11T00:13:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 4, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 0, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 2, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 0 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 0, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2024-09-11T00:13:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed_ops": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 2503, 2024-09-11T00:13:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 5405233, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 2503, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 2503, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 5405233, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2024-09-11T00:13:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 2248, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 3779989, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 2248, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 3779989, 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2024-09-11T00:13:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 2248, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 2248, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 2248, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 2248, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2024-09-11T00:13:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x5575d331f040": { 2024-09-11T00:13:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2024-09-11T00:13:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2024-09-11T00:13:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "trackedop": { 2024-09-11T00:13:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 0 2024-09-11T00:13:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:23.981 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-11T00:13:24.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:23 smithi131 ceph-mon[35491]: pgmap v660: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T00:13:24.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:23 smithi135 ceph-mon[35432]: pgmap v660: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T00:13:24.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:23 smithi019 ceph-mon[30859]: pgmap v660: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T00:13:24.633 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-11T00:13:24.633 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-11T00:13:24.633 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-11T00:13:24.634 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-11T00:13:24.634 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-11T00:13:24.634 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-11T00:13:24.634 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T00:13:24.634 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-11T00:13:24.634 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T00:13:24.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T00:13:24.878 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:13:25.152 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:24 smithi131 ceph-mon[35491]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:13:25.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:24 smithi135 ceph-mon[35432]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:13:25.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:24 smithi019 ceph-mon[30859]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:13:25.435 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 4, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 4, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 3040, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 448, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 0, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.002920939, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.000027253, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.002086315, 2024-09-11T00:13:25.436 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.004238291, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001412763 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:13:25.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 226, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 219, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 1139472, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 134464, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 2, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 1, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.042073115, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.018540826, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.033845603, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 218, 2024-09-11T00:13:25.438 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.014439924, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000066238 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 1139472, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 134464 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 1, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 167, 2024-09-11T00:13:25.439 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 109696, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 3, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 2, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.013000438, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.010240037, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.000944296, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 165, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.009934601, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000060209 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.440 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 109696 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 0, 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2024-09-11T00:13:25.441 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:25.442 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:25.443 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 148945, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 29, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:25.444 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2024-09-11T00:13:25.445 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 968, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 2, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 227, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 1107537, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:25.446 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 227, 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 227, 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 1107537, 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-11T00:13:25.447 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-11T00:13:26.130 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:25 smithi131 ceph-mon[35491]: pgmap v662: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:26.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:25 smithi135 ceph-mon[35432]: pgmap v662: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-11T00:13:26.211 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-11T00:13:26.211 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T00:13:26.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T00:13:26.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:25 smithi019 ceph-mon[30859]: pgmap v662: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:26.793 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 578680, 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 739382, 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 187356777, 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 793524180, 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 39, 2024-09-11T00:13:27.380 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 8, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 32.475701081, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 19.017915363, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 54.189590849, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 1.621278027, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 739380, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 32.279580527, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000043657 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 984358, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.141528135, 2024-09-11T00:13:27.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000143 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1440 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 78031, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 78010, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 26978965, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 320110962, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 7.718549460, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 4.167597567, 2024-09-11T00:13:27.382 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 1.123602673, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 2.057248835, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 78010, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 26.140229306, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000335088 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1245552, 2024-09-11T00:13:27.383 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 149200 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 61011, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 68044, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 27083452, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 171142912, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 10, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 5.243177847, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 2.440018395, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 1.304830879, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 1.379067492, 2024-09-11T00:13:27.384 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 68042, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 12.066098612, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000177333 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 37418, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.008359186, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000223 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 373968 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.385 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 39100, 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 262.244396440, 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.006707017 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 56529, 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 26.588844911, 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000470357 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 262066, 2024-09-11T00:13:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 258042, 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 258042, 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 13046.718038559, 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.050560443 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 4024, 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 2, 2024-09-11T00:13:27.388 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 2435, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 128, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 9, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 62998, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 19932, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 42920, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 146, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 34521, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 2211, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 2, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 2, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 13, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 548792, 2024-09-11T00:13:27.389 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 533293, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 3988, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 51, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 1, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 74, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 14, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 1312, 2024-09-11T00:13:27.390 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 101, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 6278, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 92063, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 6, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 92063, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 608, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:13:27.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 608, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 91455, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 82, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 187436, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 101717, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 265927, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 44901, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 3365, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 74887 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-09-11T00:13:27.392 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 2681, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 37, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 25, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 63, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 3690, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 135, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 36607, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 36472, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:13:27.393 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 14, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 141, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_started": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_succeeded": 0, 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_write_failed": 0 2024-09-11T00:13:27.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 253248, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 171426, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 159771, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 93477, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 11655, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 373, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 245, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 230, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 143, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 8, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-09-11T00:13:27.395 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 15, 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 488232938, 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 845959139, 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 21958, 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 648.886773436, 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.029551269 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-09-11T00:13:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.397 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-09-11T00:13:27.397 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 37417, 2024-09-11T00:13:27.397 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 74369, 2024-09-11T00:13:27.397 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 36952, 2024-09-11T00:13:27.397 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 1062, 2024-09-11T00:13:27.397 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1312, 2024-09-11T00:13:27.397 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 250, 2024-09-11T00:13:27.398 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 62998, 2024-09-11T00:13:27.398 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 122606, 2024-09-11T00:13:27.398 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 59608, 2024-09-11T00:13:27.398 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 2, 2024-09-11T00:13:27.398 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 37619, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 37617, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 272556, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 521986048 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 267662, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 262, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 262066, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 19, 2024-09-11T00:13:27.399 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 622, 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 35650, 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 930.412611809, 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.026098530 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 126770, 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 9994.222351286, 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.078837440 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.400 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 31617, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 563.955455774, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.017837095 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2, 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000244744, 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000122372 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-09-11T00:13:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-09-11T00:13:27.404 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 125, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 6.111067753, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.048888542 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.405 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5162, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 137.980519789, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.026730050 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 994, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2.427739121, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002442393 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 35651, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1361.550413765, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.038191086 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.406 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 137, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 15.300849851, 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.111685035 2024-09-11T00:13:27.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-09-11T00:13:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.410 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 21934, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 34.756784667, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001584607 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.411 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 51429, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 51429, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 644, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-11T00:13:27.412 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:27.413 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:27.414 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:27.415 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 2594474, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 32802, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:27.416 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7968, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 176, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 132379790, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 1251488, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-11T00:13:27.417 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 171879, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 903806121, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 33, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 171879, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 171879, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1136.087771572, 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.006609811 2024-09-11T00:13:27.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 171879, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 210424 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 171879, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 92718, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 79161, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1263, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 16423, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 647, 2024-09-11T00:13:27.419 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 22605, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 301, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 128, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 36889, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 92063, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 32846, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:13:27.420 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-11T00:13:27.421 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 12, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2024-09-11T00:13:27.422 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 5585, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 10, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 1664 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-09-11T00:13:27.423 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 18, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 10, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 36488, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 36472, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 717718, 2024-09-11T00:13:27.424 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 176805861, 2024-09-11T00:13:27.425 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:27.425 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 717718, 2024-09-11T00:13:27.425 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:27.425 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:27.425 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 717718, 2024-09-11T00:13:27.425 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 176805861, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:27.426 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 171879, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 908161829, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 171879, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 908161829, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:27.427 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 171879, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 171879, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 171879, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 171879, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 36472, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 4355936, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 36472, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:27.429 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 647, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 4355936, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55f2bcc94dc0": { 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 253248, 2024-09-11T00:13:27.430 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 841764835, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 253248, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 21958, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 841764835, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-11T00:13:27.431 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 6762 2024-09-11T00:13:27.432 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:27.432 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-11T00:13:28.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:27 smithi135 ceph-mon[35432]: pgmap v663: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:28.273 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:27 smithi019 ceph-mon[30859]: pgmap v663: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:28.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:27 smithi131 ceph-mon[35491]: pgmap v663: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:28.404 INFO:tasks.check_counter:Daemon mds.c mds.exported=14 2024-09-11T00:13:28.405 INFO:tasks.check_counter:Daemon mds.c mds.imported=101 2024-09-11T00:13:28.405 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=2681 2024-09-11T00:13:28.405 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=37 2024-09-11T00:13:28.405 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-11T00:13:28.405 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-11T00:13:28.405 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T00:13:28.405 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=128 2024-09-11T00:13:28.405 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T00:13:28.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T00:13:28.653 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:13:29.144 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-11T00:13:29.144 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:29.144 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1411, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1413, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 8809915, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 448708, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.150188793, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.062550761, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.037040639, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.038680955, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1411, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.050484671, 2024-09-11T00:13:29.145 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000035779 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 741, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 903, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 13644880, 2024-09-11T00:13:29.146 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 607346, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.080393599, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.035717049, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.024423075, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.014884248, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 902, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.037312993, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000041366 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:29.147 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 373232 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 640, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 617, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 9715176, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 257923, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-09-11T00:13:29.148 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.082274397, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.033538406, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.048198711, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.009857137, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 616, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.024082381, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000039094 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.149 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1229312, 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 136128 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.150 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4224, 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.101094793, 2024-09-11T00:13:29.151 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000023933 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.152 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-09-11T00:13:29.153 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 2135, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 2135, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 2135, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-09-11T00:13:29.154 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 2, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-09-11T00:13:29.155 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 6, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:13:29.156 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:13:29.157 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:13:29.158 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-09-11T00:13:29.159 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_started": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_succeeded": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_write_failed": 0 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 14982, 2024-09-11T00:13:29.160 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 20, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 3, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 34424496, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 34424384, 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-09-11T00:13:29.161 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 14982 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 102, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 4882, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 4780, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 33, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 161, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 128, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 2135, 2024-09-11T00:13:29.162 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 8410, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 6275, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 61516, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 263655424 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-09-11T00:13:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.165 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-09-11T00:13:29.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.168 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.168 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.168 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-09-11T00:13:29.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.170 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.171 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-09-11T00:13:29.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-09-11T00:13:29.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.176 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 4, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 2, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 3, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2682, 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-09-11T00:13:29.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:29.178 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:29.179 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 211366, 2024-09-11T00:13:29.180 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 177, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7968, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 176, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:29.181 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 1813278, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 12059, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 2530, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 26, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 4, 2024-09-11T00:13:29.182 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 2530, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2530, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.464926131, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001369536 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2530, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2531 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 2530, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2530, 2024-09-11T00:13:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1530, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 997, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-11T00:13:29.184 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 2, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-11T00:13:29.185 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-11T00:13:29.186 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 12, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 7, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 7, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-11T00:13:29.187 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-09-11T00:13:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 2788, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 31902911, 2024-09-11T00:13:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 2788, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2788, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 31902911, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-11T00:13:29.190 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2530, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 30231937, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2530, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 30231937, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.191 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2530, 2024-09-11T00:13:29.192 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2530, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2530, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2530, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:29.193 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55bd143ed040": { 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:29.195 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:29.196 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-11T00:13:29.972 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-11T00:13:29.972 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-11T00:13:29.973 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-11T00:13:29.973 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-11T00:13:29.973 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-11T00:13:29.973 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-11T00:13:29.973 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T00:13:29.973 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-11T00:13:29.973 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T00:13:29.973 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T00:13:30.165 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:29 smithi019 ceph-mon[30859]: pgmap v664: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:30.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:29 smithi135 ceph-mon[35432]: pgmap v664: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:30.217 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:13:30.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:29 smithi131 ceph-mon[35491]: pgmap v664: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-11T00:13:30.690 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-11T00:13:30.690 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 4896, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 5465, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1398012, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 15602146, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 104, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.581319566, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.205246442, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.371123213, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.099379942, 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:30.691 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5467, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.233504968, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000042711 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3837, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000688030, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000179 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 42352, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 2384 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.692 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 19017, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 15637, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 10415616, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 21984979, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 12, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 1.377433138, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.650349621, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.662456441, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.191355708, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 15639, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.699134837, 2024-09-11T00:13:30.693 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000044704 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 25222, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.003542731, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000140 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1589248, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 264240 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 54607, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 62735, 2024-09-11T00:13:30.694 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 18114504, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 37481607, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 23, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 8, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 3.063871337, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 1.708220938, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 4.126474689, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.159240001, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 62727, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2.690330354, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000042889 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 96054, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.016298490, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000169 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 48576, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 410128 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:30.696 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5019, 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 12.430374818, 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002476663 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2861, 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.450701452, 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000157532 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 22809, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 21346, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 21346, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 399.367007995, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.018709219 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 1463, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 117, 2024-09-11T00:13:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 12, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 507, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 6, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 157, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 344, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 498, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 6601, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 2, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 2, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 4, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 45673, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 39792, 2024-09-11T00:13:30.699 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 1462, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 225, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 164, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 93, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 5389, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 13, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 1099, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 4843, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-09-11T00:13:30.700 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 6, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 4843, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 146, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 13, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 133, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 4697, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 147, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 9508, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 10257, 2024-09-11T00:13:30.701 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 5, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 20308, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 1640, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 138, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 6486 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 385, 2024-09-11T00:13:30.702 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 3048, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 1644, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 1710, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 442, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 8, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 1645, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 1637, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:13:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 13, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 93, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 12, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_started": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_succeeded": 0, 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_write_failed": 0 2024-09-11T00:13:30.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 14982, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 14982, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 20, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-09-11T00:13:30.705 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 20, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 3, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 34424496, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2554, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 57.525991067, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.022523880 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.706 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 112, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 5132, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 5020, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 43, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1900, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 1857, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 507, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 9113, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 8606, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 2, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 3724, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 3722, 2024-09-11T00:13:30.707 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 83676, 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 299753472 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 24175, 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 86, 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 22809, 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 60, 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 398, 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-09-11T00:13:30.708 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2527, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 15.716702238, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.006219510 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1026, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 27.667699519, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.026966568 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 12970, 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 327.177440797, 2024-09-11T00:13:30.710 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.025225708 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-09-11T00:13:30.711 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 11, 2024-09-11T00:13:30.713 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001833533, 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000166684 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 30, 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.069515229, 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002317174 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-09-11T00:13:30.714 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 11, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 7.281270959, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.661933723 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1167, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 5.926547296, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005078446 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.715 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 129, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.494100212, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.003830234 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2147, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 12.946539270, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.006030060 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.716 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 12, 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.119331172, 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.009944264 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.717 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.113628384, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.022725676 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.031492658, 2024-09-11T00:13:30.718 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005248776 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-09-11T00:13:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8, 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.020371380, 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002546422 2024-09-11T00:13:30.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.002007922, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000669307 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1294, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.798527426, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001389897 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:13:30.721 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 4, 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 2, 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2024-09-11T00:13:30.722 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 356, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 178, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 645, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:30.723 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:30.724 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 378241, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 201, 2024-09-11T00:13:30.726 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 176, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 2, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7968, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 176, 2024-09-11T00:13:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 817332, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 7156, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.728 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 10240, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 32505501, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 37, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 10240, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10240, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 73.941421391, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.007220841 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.729 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10240, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 10631 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 10240, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 4971, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 5269, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 11, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 115, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 2656, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 101, 2024-09-11T00:13:30.730 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 9, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 2159, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 4856, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 22, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:13:30.731 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 5, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-11T00:13:30.732 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 12, 2024-09-11T00:13:30.733 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 596, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 101 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.734 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 10, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 10, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 1637, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 1637, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 78516, 2024-09-11T00:13:30.735 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 22797428, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 78516, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 78516, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 22797428, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 10240, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 32701622, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 10240, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 32701622, 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:30.737 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 10240, 2024-09-11T00:13:30.738 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 10240, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 10240, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 10240, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:30.739 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1637, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 196121, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1637, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 102, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 196121, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.740 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55b78092adc0": { 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 14982, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 30230192, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 14982, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2554, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 30230192, 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:30.741 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:30.742 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-11T00:13:31.471 INFO:tasks.check_counter:Daemon mds.i mds.exported=93 2024-09-11T00:13:31.471 INFO:tasks.check_counter:Daemon mds.i mds.imported=13 2024-09-11T00:13:31.472 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=385 2024-09-11T00:13:31.472 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=3048 2024-09-11T00:13:31.472 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-11T00:13:31.472 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-09-11T00:13:31.472 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-09-11T00:13:31.472 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=12 2024-09-11T00:13:31.472 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T00:13:31.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T00:13:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:13:32.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:31 smithi135 ceph-mon[35432]: pgmap v665: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:13:32.256 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1276, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1278, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 344329136, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 405832, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.289835126, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.042988812, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.210669997, 2024-09-11T00:13:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.026901154, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1276, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.034938550, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000027381 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:13:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1439, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1414, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 306510848, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 512795, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.275906681, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.061676270, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.194851936, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.024558346, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1414, 2024-09-11T00:13:32.259 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.051063285, 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000036112 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1233888, 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 139776 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:13:32.260 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1301, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1469, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 193361151, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 788536, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.235148187, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.059547100, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.132745987, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.031583235, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1467, 2024-09-11T00:13:32.261 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.051246639, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000034932 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 375136 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-09-11T00:13:32.262 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5558, 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.393449984, 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000070789 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-11T00:13:32.263 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.264 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 118273, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 28393, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 89880, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 77711, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-09-11T00:13:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 1, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-09-11T00:13:32.266 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:13:32.267 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-09-11T00:13:32.269 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_started": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_succeeded": 0, 2024-09-11T00:13:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_write_failed": 0 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 253248, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 143, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 22, 2024-09-11T00:13:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 488232938, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 845959139, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 845949912, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 253248 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.272 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 37405, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 74341, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 36936, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 1049, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1293, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 244, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 118273, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 120210, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 1937, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-09-11T00:13:32.273 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 250344, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 461115392 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-09-11T00:13:32.274 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.275 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-09-11T00:13:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.279 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.281 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.282 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.283 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2011, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.288 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:13:32.289 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:13:32.290 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 1643376, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 38023, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:13:32.291 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7968, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 176, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 169771166, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 1739395, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-11T00:13:32.292 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 3749, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 3749, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3749, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 5.161890062, 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001376871 2024-09-11T00:13:32.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3749, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3750 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 3749, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 3749, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 2445, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1302, 2024-09-11T00:13:32.294 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:13:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-11T00:13:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 12, 2024-09-11T00:13:32.297 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 11, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 11, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.298 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 4012, 2024-09-11T00:13:32.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 843823649, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 4012, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 4012, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 843823649, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-11T00:13:32.300 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3749, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 841944267, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3749, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 841944267, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.301 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3749, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 3749, 2024-09-11T00:13:32.302 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3749, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 3749, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x56502c75d040": { 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-11T00:13:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-11T00:13:32.305 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-11T00:13:32.306 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-11T00:13:32.306 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-09-11T00:13:32.306 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-11T00:13:32.306 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-11T00:13:32.306 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:31 smithi131 ceph-mon[35491]: pgmap v665: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:13:32.307 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:31 smithi019 ceph-mon[30859]: pgmap v665: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:13:32.957 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-11T00:13:32.957 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-11T00:13:32.957 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-11T00:13:32.957 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-11T00:13:32.957 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-11T00:13:32.957 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-11T00:13:32.957 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T00:13:32.958 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-11T00:13:32.958 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T00:13:32.984 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T00:13:32.985 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-11T00:13:32.985 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:13:33.007 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-11T00:13:33.008 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:13:33.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T00:13:33.380 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 -- 172.21.15.19:0/2639681592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb0102dc0 msgr2=0x7fabb01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 --2- 172.21.15.19:0/2639681592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb0102dc0 0x7fabb01031a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fabac009900 tx=0x7fabac02a410 comp rx=0 tx=0).stop 2024-09-11T00:13:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 -- 172.21.15.19:0/2639681592 shutdown_connections 2024-09-11T00:13:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 --2- 172.21.15.19:0/2639681592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb0109150 0x7fabb010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 --2- 172.21.15.19:0/2639681592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabb01087d0 0x7fabb0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 --2- 172.21.15.19:0/2639681592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb0102dc0 0x7fabb01031a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 -- 172.21.15.19:0/2639681592 >> 172.21.15.19:0/2639681592 conn(0x7fabb00fe830 msgr2=0x7fabb0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 -- 172.21.15.19:0/2639681592 shutdown_connections 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.981+0000 7fabb7beb640 1 -- 172.21.15.19:0/2639681592 wait complete. 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 Processor -- start 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 -- start start 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabb0102dc0 0x7fabb0199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb01087d0 0x7fabb0199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb0109150 0x7fabb019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0112dd0 con 0x7fabb01087d0 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0112c50 con 0x7fabb0109150 2024-09-11T00:13:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb7beb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0112f50 con 0x7fabb0102dc0 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.982+0000 7fabb5186640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb01087d0 0x7fabb0199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb01087d0 0x7fabb0199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45660/0 (socket says 172.21.15.19:45660) 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 -- 172.21.15.19:0/1654884548 learned_addr learned my addr 172.21.15.19:0/1654884548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb6188640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb0109150 0x7fabb019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5987640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabb0102dc0 0x7fabb0199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 -- 172.21.15.19:0/1654884548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabb0102dc0 msgr2=0x7fabb0199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabb0102dc0 0x7fabb0199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 -- 172.21.15.19:0/1654884548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb0109150 msgr2=0x7fabb019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb0109150 0x7fabb019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 -- 172.21.15.19:0/1654884548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb019f2d0 con 0x7fabb01087d0 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb5186640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb01087d0 0x7fabb0199760 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7faba000c920 tx=0x7faba000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7faba6ffd640 1 -- 172.21.15.19:0/1654884548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0007c70 con 0x7fabb01087d0 2024-09-11T00:13:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb019f5c0 con 0x7fabb01087d0 2024-09-11T00:13:33.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7faba6ffd640 1 -- 172.21.15.19:0/1654884548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faba0007e10 con 0x7fabb01087d0 2024-09-11T00:13:33.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7faba6ffd640 1 -- 172.21.15.19:0/1654884548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0018820 con 0x7fabb01087d0 2024-09-11T00:13:33.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.983+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01a5c80 con 0x7fabb01087d0 2024-09-11T00:13:33.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.984+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb01031a0 con 0x7fabb01087d0 2024-09-11T00:13:33.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.986+0000 7faba6ffd640 1 -- 172.21.15.19:0/1654884548 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7faba000f450 con 0x7fabb01087d0 2024-09-11T00:13:33.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.987+0000 7faba6ffd640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab9c0b5450 0x7fab9c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:33.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.987+0000 7fabb5987640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab9c0b5450 0x7fab9c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:33.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.987+0000 7faba6ffd640 1 -- 172.21.15.19:0/1654884548 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8441+0+0 (secure 0 0 0) 0x7faba00e6320 con 0x7fabb01087d0 2024-09-11T00:13:33.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.987+0000 7fabb5987640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab9c0b5450 0x7fab9c0b7910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fabac031440 tx=0x7fabac005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:33.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:33.990+0000 7faba6ffd640 1 -- 172.21.15.19:0/1654884548 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faba0014030 con 0x7fabb01087d0 2024-09-11T00:13:34.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:33 smithi019 ceph-mon[30859]: pgmap v666: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:13:34.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:33 smithi135 ceph-mon[35432]: pgmap v666: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:13:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.193+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fabb019a350 con 0x7fabb01087d0 2024-09-11T00:13:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.193+0000 7faba6ffd640 1 -- 172.21.15.19:0/1654884548 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v88) ==== 81+0+885 (secure 0 0 0) 0x7faba00acf20 con 0x7fabb01087d0 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/3470391779 2024-09-11T23:53:52.390665+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/3913578653 2024-09-11T23:53:52.390665+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6800/2022256684 2024-09-11T23:52:27.323340+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6801/2022256684 2024-09-11T23:52:27.323340+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/1979169918 2024-09-11T23:52:27.323340+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/172869376 2024-09-11T23:52:51.509685+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6800/3829413546 2024-09-11T23:52:51.509685+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2017286086 2024-09-11T23:52:51.509685+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6801/3829413546 2024-09-11T23:52:51.509685+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/963841749 2024-09-11T23:52:51.509685+0000 2024-09-11T00:13:34.196 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/885611356 2024-09-11T23:52:27.323340+0000 2024-09-11T00:13:34.197 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2168429169 2024-09-11T23:52:27.323340+0000 2024-09-11T00:13:34.197 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6800/3641264705 2024-09-11T23:53:52.390665+0000 2024-09-11T00:13:34.197 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6801/3641264705 2024-09-11T23:53:52.390665+0000 2024-09-11T00:13:34.197 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/3578109266 2024-09-11T23:53:52.390665+0000 2024-09-11T00:13:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:listed 15 entries 2024-09-11T00:13:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab9c0b5450 msgr2=0x7fab9c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab9c0b5450 0x7fab9c0b7910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fabac031440 tx=0x7fabac005b50 comp rx=0 tx=0).stop 2024-09-11T00:13:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb01087d0 msgr2=0x7fabb0199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb01087d0 0x7fabb0199760 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7faba000c920 tx=0x7faba000cde0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 shutdown_connections 2024-09-11T00:13:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb0109150 0x7fabb019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fab9c0b5450 0x7fab9c0b7910 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabb01087d0 0x7fabb0199760 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 --2- 172.21.15.19:0/1654884548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabb0102dc0 0x7fabb0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 >> 172.21.15.19:0/1654884548 conn(0x7fabb00fe830 msgr2=0x7fabb0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.195+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 shutdown_connections 2024-09-11T00:13:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:34.196+0000 7fabb7beb640 1 -- 172.21.15.19:0/1654884548 wait complete. 2024-09-11T00:13:34.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:33 smithi131 ceph-mon[35491]: pgmap v666: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T00:13:34.912 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:34 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1654884548' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:13:34.948 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T00:13:34.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:13:34.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T00:13:35.076 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T00:13:35.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:13:35.076 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T00:13:35.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:13:35.122 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-11T00:13:35.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:34 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1654884548' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:13:35.188 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T00:13:35.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:13:35.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:13:35.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:13:35.247 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-11T00:13:35.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:34 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1654884548' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:13:35.330 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T00:13:35.343 INFO:tasks.cephadm:Teardown begin 2024-09-11T00:13:35.343 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T00:13:35.343 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:35.637 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:36.023 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:35 smithi019 ceph-mon[30859]: pgmap v667: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:13:36.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:35 smithi135 ceph-mon[35432]: pgmap v667: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:13:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 -- 172.21.15.19:0/2037530312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8108020 msgr2=0x7ff2f810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 --2- 172.21.15.19:0/2037530312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8108020 0x7ff2f810e820 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009900 tx=0x7ff2e802a410 comp rx=0 tx=0).stop 2024-09-11T00:13:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 -- 172.21.15.19:0/2037530312 shutdown_connections 2024-09-11T00:13:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 --2- 172.21.15.19:0/2037530312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8108020 0x7ff2f810e820 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 --2- 172.21.15.19:0/2037530312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2f81076a0 0x7ff2f8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 --2- 172.21.15.19:0/2037530312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f8101c90 0x7ff2f8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 -- 172.21.15.19:0/2037530312 >> 172.21.15.19:0/2037530312 conn(0x7ff2f80fd700 msgr2=0x7ff2f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 -- 172.21.15.19:0/2037530312 shutdown_connections 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.156+0000 7ff2feeea640 1 -- 172.21.15.19:0/2037530312 wait complete. 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 Processor -- start 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 -- start start 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8101c90 0x7ff2f8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2f81076a0 0x7ff2f8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f8108020 0x7ff2f819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8112df0 con 0x7ff2f8101c90 2024-09-11T00:13:36.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8112c70 con 0x7ff2f81076a0 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2feeea640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8112f70 con 0x7ff2f8108020 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8101c90 0x7ff2f8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8101c90 0x7ff2f8199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45684/0 (socket says 172.21.15.19:45684) 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 -- 172.21.15.19:0/1318749556 learned_addr learned my addr 172.21.15.19:0/1318749556 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fd487640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f8108020 0x7ff2f819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2f7fff640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2f81076a0 0x7ff2f8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 -- 172.21.15.19:0/1318749556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f8108020 msgr2=0x7ff2f819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f8108020 0x7ff2f819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 -- 172.21.15.19:0/1318749556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2f81076a0 msgr2=0x7ff2f8199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2f81076a0 0x7ff2f8199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.157+0000 7ff2fcc86640 1 -- 172.21.15.19:0/1318749556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f819f300 con 0x7ff2f8101c90 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.158+0000 7ff2fcc86640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8101c90 0x7ff2f8199250 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000d950 tx=0x7ff2f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.158+0000 7ff2f5ffb640 1 -- 172.21.15.19:0/1318749556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0017070 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.158+0000 7ff2f5ffb640 1 -- 172.21.15.19:0/1318749556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f0009c30 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.158+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f819f5f0 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.158+0000 7ff2f5ffb640 1 -- 172.21.15.19:0/1318749556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f000f620 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.158+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f81a5cb0 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.159+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f8102070 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.160+0000 7ff2f5ffb640 1 -- 172.21.15.19:0/1318749556 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7ff2f0010460 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.161+0000 7ff2f5ffb640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff2e40b5450 0x7ff2e40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.162+0000 7ff2f7fff640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff2e40b5450 0x7ff2e40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.162+0000 7ff2f5ffb640 1 -- 172.21.15.19:0/1318749556 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8441+0+0 (secure 0 0 0) 0x7ff2f00e5ba0 con 0x7ff2f8101c90 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.162+0000 7ff2f7fff640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff2e40b5450 0x7ff2e40b7910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8103d70 tx=0x7ff2e000a780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:36.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.165+0000 7ff2f5ffb640 1 -- 172.21.15.19:0/1318749556 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff2f00ac770 con 0x7ff2f8101c90 2024-09-11T00:13:36.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:35 smithi131 ceph-mon[35491]: pgmap v667: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-11T00:13:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.386+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2f802e5c0 con 0x7ff2f8101c90 2024-09-11T00:13:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.387+0000 7ff2f5ffb640 1 -- 172.21.15.19:0/1318749556 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11915 (secure 0 0 0) 0x7ff2f0009de0 con 0x7ff2f8101c90 2024-09-11T00:13:36.390 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:13:36.390 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-11T00:12:55:087296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:12:54.982249+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:13:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff2e40b5450 msgr2=0x7ff2e40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff2e40b5450 0x7ff2e40b7910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8103d70 tx=0x7ff2e000a780 comp rx=0 tx=0).stop 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8101c90 msgr2=0x7ff2f8199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8101c90 0x7ff2f8199250 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000d950 tx=0x7ff2f000de10 comp rx=0 tx=0).stop 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 shutdown_connections 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f8108020 0x7ff2f819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2f81076a0 0x7ff2f8199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7ff2e40b5450 0x7ff2e40b7910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 --2- 172.21.15.19:0/1318749556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2f8101c90 0x7ff2f8199250 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 >> 172.21.15.19:0/1318749556 conn(0x7ff2f80fd700 msgr2=0x7ff2f80fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 shutdown_connections 2024-09-11T00:13:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:36.390+0000 7ff2feeea640 1 -- 172.21.15.19:0/1318749556 wait complete. 2024-09-11T00:13:37.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:37.051 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:36 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1318749556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:37.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:36 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1318749556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:37.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:36 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1318749556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:37.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 -- 172.21.15.19:0/3514154644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 msgr2=0x7fcfec10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:37.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 --2- 172.21.15.19:0/3514154644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec10f950 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009ca0 tx=0x7fcfe402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 -- 172.21.15.19:0/3514154644 shutdown_connections 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 --2- 172.21.15.19:0/3514154644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec10f950 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 --2- 172.21.15.19:0/3514154644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfec1087d0 0x7fcfec108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 --2- 172.21.15.19:0/3514154644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec102dc0 0x7fcfec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 -- 172.21.15.19:0/3514154644 >> 172.21.15.19:0/3514154644 conn(0x7fcfec0fe830 msgr2=0x7fcfec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 -- 172.21.15.19:0/3514154644 shutdown_connections 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.789+0000 7fcff202e640 1 -- 172.21.15.19:0/3514154644 wait complete. 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 Processor -- start 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 -- start start 2024-09-11T00:13:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfec102dc0 0x7fcfec0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec1087d0 0x7fcfec0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec112e10 con 0x7fcfec109150 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec112c90 con 0x7fcfec102dc0 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcff202e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec112f90 con 0x7fcfec1087d0 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcfebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcfebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45702/0 (socket says 172.21.15.19:45702) 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcfebfff640 1 -- 172.21.15.19:0/1422891307 learned_addr learned my addr 172.21.15.19:0/1422891307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.790+0000 7fcfeb7fe640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfec102dc0 0x7fcfec0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfeaffd640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec1087d0 0x7fcfec0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfebfff640 1 -- 172.21.15.19:0/1422891307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec1087d0 msgr2=0x7fcfec0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfebfff640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec1087d0 0x7fcfec0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfebfff640 1 -- 172.21.15.19:0/1422891307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfec102dc0 msgr2=0x7fcfec0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfebfff640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfec102dc0 0x7fcfec0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfebfff640 1 -- 172.21.15.19:0/1422891307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec1a7680 con 0x7fcfec109150 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfeaffd640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec1087d0 0x7fcfec0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfeb7fe640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfec102dc0 0x7fcfec0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfebfff640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec075f20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4005cc0 tx=0x7fcfe402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/1422891307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4003cf0 con 0x7fcfec109150 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/1422891307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfe40044f0 con 0x7fcfec109150 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfec1a7910 con 0x7fcfec109150 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/1422891307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe402fd10 con 0x7fcfec109150 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.791+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfec1a7ed0 con 0x7fcfec109150 2024-09-11T00:13:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.792+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfec1031a0 con 0x7fcfec109150 2024-09-11T00:13:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.794+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/1422891307 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fcfe4004040 con 0x7fcfec109150 2024-09-11T00:13:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.795+0000 7fcfe8ff9640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcfd40b5450 0x7fcfd40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.795+0000 7fcfeb7fe640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcfd40b5450 0x7fcfd40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.795+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/1422891307 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8441+0+0 (secure 0 0 0) 0x7fcfe41076a0 con 0x7fcfec109150 2024-09-11T00:13:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.795+0000 7fcfeb7fe640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcfd40b5450 0x7fcfd40b7910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009930 tx=0x7fcfdc008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:37.799+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/1422891307 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcfe40ce270 con 0x7fcfec109150 2024-09-11T00:13:38.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:37 smithi019 ceph-mon[30859]: pgmap v668: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:13:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.021+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfec1a82b0 con 0x7fcfec109150 2024-09-11T00:13:38.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.022+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/1422891307 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11915 (secure 0 0 0) 0x7fcfe40cdb70 con 0x7fcfec109150 2024-09-11T00:13:38.024 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:13:38.024 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-11T00:12:55:087296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14727,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2693320130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":2693320130},{"type":"v1","addr":"172.21.15.19:6835","nonce":2693320130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/2350271990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":2350271990},{"type":"v1","addr":"172.21.15.19:6837","nonce":2350271990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/1245997055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":1245997055},{"type":"v1","addr":"172.21.15.19:6839","nonce":1245997055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/84271943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":84271943},{"type":"v1","addr":"172.21.15.19:6841","nonce":84271943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/173201568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":173201568},{"type":"v1","addr":"172.21.15.131:6833","nonce":173201568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1584755478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1584755478},{"type":"v1","addr":"172.21.15.131:6835","nonce":1584755478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:00:28.916347+0000","modified":"2024-09-11T00:12:54.982249+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24625,"mds_1":24605,"mds_2":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24565":{"gid":24565,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/324976573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":324976573},{"type":"v1","addr":"172.21.15.135:6833","nonce":324976573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6837/3685381952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3685381952},{"type":"v1","addr":"172.21.15.131:6837","nonce":3685381952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3910864085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3910864085},{"type":"v1","addr":"172.21.15.135:6835","nonce":3910864085}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6837/3873679773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3873679773},{"type":"v1","addr":"172.21.15.135:6837","nonce":3873679773}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6839/3500650127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":3500650127},{"type":"v1","addr":"172.21.15.131:6839","nonce":3500650127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2927257252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2927257252},{"type":"v1","addr":"172.21.15.135:6839","nonce":2927257252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24625,"qdb_cluster":[24625,24605,24604]},"id":1}]} 2024-09-11T00:13:38.025 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcfd40b5450 msgr2=0x7fcfd40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcfd40b5450 0x7fcfd40b7910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009930 tx=0x7fcfdc008040 comp rx=0 tx=0).stop 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 msgr2=0x7fcfec075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec075f20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4005cc0 tx=0x7fcfe402f470 comp rx=0 tx=0).stop 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 shutdown_connections 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcfd40b5450 0x7fcfd40b7910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec109150 0x7fcfec075f20 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec1087d0 0x7fcfec0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 --2- 172.21.15.19:0/1422891307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfec102dc0 0x7fcfec0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 >> 172.21.15.19:0/1422891307 conn(0x7fcfec0fe830 msgr2=0x7fcfec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 shutdown_connections 2024-09-11T00:13:38.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:38.024+0000 7fcff202e640 1 -- 172.21.15.19:0/1422891307 wait complete. 2024-09-11T00:13:38.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:37 smithi135 ceph-mon[35432]: pgmap v668: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:13:38.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:37 smithi131 ceph-mon[35491]: pgmap v668: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:13:38.921 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:13:39.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:38 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/1422891307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:39.223 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:39.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:38 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/1422891307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:39.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:38 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/1422891307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 -- 172.21.15.19:0/794880311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0102dc0 msgr2=0x7fccb01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 --2- 172.21.15.19:0/794880311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0102dc0 0x7fccb01031a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009900 tx=0x7fcca002a410 comp rx=0 tx=0).stop 2024-09-11T00:13:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 -- 172.21.15.19:0/794880311 shutdown_connections 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 --2- 172.21.15.19:0/794880311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccb0109150 0x7fccb010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 --2- 172.21.15.19:0/794880311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb01087d0 0x7fccb0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 --2- 172.21.15.19:0/794880311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0102dc0 0x7fccb01031a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 -- 172.21.15.19:0/794880311 >> 172.21.15.19:0/794880311 conn(0x7fccb00fe830 msgr2=0x7fccb0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 -- 172.21.15.19:0/794880311 shutdown_connections 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.720+0000 7fccb55ad640 1 -- 172.21.15.19:0/794880311 wait complete. 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 Processor -- start 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 -- start start 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb0102dc0 0x7fccb0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccb01087d0 0x7fccb01998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0109150 0x7fccb019ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0112e60 con 0x7fccb0109150 2024-09-11T00:13:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0112ce0 con 0x7fccb01087d0 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccb55ad640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0112fe0 con 0x7fccb0102dc0 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccaf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0109150 0x7fccb019ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccaf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0109150 0x7fccb019ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45716/0 (socket says 172.21.15.19:45716) 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.721+0000 7fccaf7fe640 1 -- 172.21.15.19:0/2599327010 learned_addr learned my addr 172.21.15.19:0/2599327010 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fcca7fff640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccb01087d0 0x7fccb01998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccaeffd640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb0102dc0 0x7fccb0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccaf7fe640 1 -- 172.21.15.19:0/2599327010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb0102dc0 msgr2=0x7fccb0199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccaf7fe640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb0102dc0 0x7fccb0199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccaf7fe640 1 -- 172.21.15.19:0/2599327010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccb01087d0 msgr2=0x7fccb01998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccaf7fe640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccb01087d0 0x7fccb01998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccaf7fe640 1 -- 172.21.15.19:0/2599327010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb019f430 con 0x7fccb0109150 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fcca7fff640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccb01087d0 0x7fccb01998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccaf7fe640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0109150 0x7fccb019ec60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcca800eaa0 tx=0x7fcca800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:39.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccacff9640 1 -- 172.21.15.19:0/2599327010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca800cdb0 con 0x7fccb0109150 2024-09-11T00:13:39.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb019f720 con 0x7fccb0109150 2024-09-11T00:13:39.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccacff9640 1 -- 172.21.15.19:0/2599327010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcca8005020 con 0x7fccb0109150 2024-09-11T00:13:39.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccacff9640 1 -- 172.21.15.19:0/2599327010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca80116d0 con 0x7fccb0109150 2024-09-11T00:13:39.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.722+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01a5de0 con 0x7fccb0109150 2024-09-11T00:13:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.723+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb01031a0 con 0x7fccb0109150 2024-09-11T00:13:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.725+0000 7fccacff9640 1 -- 172.21.15.19:0/2599327010 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fcca800f040 con 0x7fccb0109150 2024-09-11T00:13:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.725+0000 7fccacff9640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc9c0b5450 0x7fcc9c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.726+0000 7fccacff9640 1 -- 172.21.15.19:0/2599327010 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8441+0+0 (secure 0 0 0) 0x7fcca80e62a0 con 0x7fccb0109150 2024-09-11T00:13:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.726+0000 7fccaeffd640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc9c0b5450 0x7fcc9c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.726+0000 7fccaeffd640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc9c0b5450 0x7fcc9c0b7910 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.729+0000 7fccacff9640 1 -- 172.21.15.19:0/2599327010 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcca8016030 con 0x7fccb0109150 2024-09-11T00:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.915+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccb019a4b0 con 0x7fccb0109150 2024-09-11T00:13:39.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:39 smithi019 ceph-mon[30859]: pgmap v669: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T00:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.917+0000 7fccacff9640 1 -- 172.21.15.19:0/2599327010 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23057 (secure 0 0 0) 0x7fccb019a4b0 con 0x7fccb0109150 2024-09-11T00:13:39.919 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-11T00:13:39.920 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":88,"fsid":"8be8ba00-6fcf-11ef-bcea-c7b262605968","created":"2024-09-10T23:51:51.848622+0000","modified":"2024-09-11T00:13:23.809955+0000","last_up_change":"2024-09-10T23:59:36.297898+0000","last_in_change":"2024-09-10T23:59:13.338681+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:55:46.863932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:00:24.308239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:00:26.972884+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c65b9f44-41c2-4115-8a1a-db391d0f931a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6803","nonce":2233994763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6805","nonce":2233994763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6809","nonce":2233994763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2233994763},{"type":"v1","addr":"172.21.15.19:6807","nonce":2233994763}]},"public_addr":"172.21.15.19:6803/2233994763","cluster_addr":"172.21.15.19:6805/2233994763","heartbeat_back_addr":"172.21.15.19:6809/2233994763","heartbeat_front_addr":"172.21.15.19:6807/2233994763","state":["exists","up"]},{"osd":1,"uuid":"a58b033b-2df1-4c5a-a9eb-45a186da817c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6801","nonce":832175696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6803","nonce":832175696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6807","nonce":832175696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":832175696},{"type":"v1","addr":"172.21.15.131:6805","nonce":832175696}]},"public_addr":"172.21.15.131:6801/832175696","cluster_addr":"172.21.15.131:6803/832175696","heartbeat_back_addr":"172.21.15.131:6807/832175696","heartbeat_front_addr":"172.21.15.131:6805/832175696","state":["exists","up"]},{"osd":2,"uuid":"b965c6c5-f9c6-4405-a12d-fbbb3a9db549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6801","nonce":3850868245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6803","nonce":3850868245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6807","nonce":3850868245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3850868245},{"type":"v1","addr":"172.21.15.135:6805","nonce":3850868245}]},"public_addr":"172.21.15.135:6801/3850868245","cluster_addr":"172.21.15.135:6803/3850868245","heartbeat_back_addr":"172.21.15.135:6807/3850868245","heartbeat_front_addr":"172.21.15.135:6805/3850868245","state":["exists","up"]},{"osd":3,"uuid":"3e420e13-bffd-43e5-a862-e5d93b92b5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6811","nonce":1691087553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6813","nonce":1691087553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6817","nonce":1691087553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1691087553},{"type":"v1","addr":"172.21.15.19:6815","nonce":1691087553}]},"public_addr":"172.21.15.19:6811/1691087553","cluster_addr":"172.21.15.19:6813/1691087553","heartbeat_back_addr":"172.21.15.19:6817/1691087553","heartbeat_front_addr":"172.21.15.19:6815/1691087553","state":["exists","up"]},{"osd":4,"uuid":"491c3970-0871-473e-9346-4f960d917f97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6809","nonce":250661719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6811","nonce":250661719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6815","nonce":250661719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":250661719},{"type":"v1","addr":"172.21.15.131:6813","nonce":250661719}]},"public_addr":"172.21.15.131:6809/250661719","cluster_addr":"172.21.15.131:6811/250661719","heartbeat_back_addr":"172.21.15.131:6815/250661719","heartbeat_front_addr":"172.21.15.131:6813/250661719","state":["exists","up"]},{"osd":5,"uuid":"cd207285-b240-4e77-a654-99fac9fa4349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6809","nonce":1638601368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6811","nonce":1638601368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6815","nonce":1638601368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1638601368},{"type":"v1","addr":"172.21.15.135:6813","nonce":1638601368}]},"public_addr":"172.21.15.135:6809/1638601368","cluster_addr":"172.21.15.135:6811/1638601368","heartbeat_back_addr":"172.21.15.135:6815/1638601368","heartbeat_front_addr":"172.21.15.135:6813/1638601368","state":["exists","up"]},{"osd":6,"uuid":"a0306c2d-d4e6-4369-b19c-f3b947a2098a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6819","nonce":912073333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6821","nonce":912073333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6825","nonce":912073333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":912073333},{"type":"v1","addr":"172.21.15.19:6823","nonce":912073333}]},"public_addr":"172.21.15.19:6819/912073333","cluster_addr":"172.21.15.19:6821/912073333","heartbeat_back_addr":"172.21.15.19:6825/912073333","heartbeat_front_addr":"172.21.15.19:6823/912073333","state":["exists","up"]},{"osd":7,"uuid":"a074eb86-fefd-4818-9c8b-0acceff1769c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6817","nonce":844665956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6819","nonce":844665956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6823","nonce":844665956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":844665956},{"type":"v1","addr":"172.21.15.131:6821","nonce":844665956}]},"public_addr":"172.21.15.131:6817/844665956","cluster_addr":"172.21.15.131:6819/844665956","heartbeat_back_addr":"172.21.15.131:6823/844665956","heartbeat_front_addr":"172.21.15.131:6821/844665956","state":["exists","up"]},{"osd":8,"uuid":"2127bf94-dfd0-46c0-885d-53f1144476d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6817","nonce":1258842145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6819","nonce":1258842145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6823","nonce":1258842145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1258842145},{"type":"v1","addr":"172.21.15.135:6821","nonce":1258842145}]},"public_addr":"172.21.15.135:6817/1258842145","cluster_addr":"172.21.15.135:6819/1258842145","heartbeat_back_addr":"172.21.15.135:6823/1258842145","heartbeat_front_addr":"172.21.15.135:6821/1258842145","state":["exists","up"]},{"osd":9,"uuid":"cccb62ba-6dfe-49a3-9f16-698180c729b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6827","nonce":1472748928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6829","nonce":1472748928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6833","nonce":1472748928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1472748928},{"type":"v1","addr":"172.21.15.19:6831","nonce":1472748928}]},"public_addr":"172.21.15.19:6827/1472748928","cluster_addr":"172.21.15.19:6829/1472748928","heartbeat_back_addr":"172.21.15.19:6833/1472748928","heartbeat_front_addr":"172.21.15.19:6831/1472748928","state":["exists","up"]},{"osd":10,"uuid":"09ffbe08-03ae-468f-bf97-3e4698091550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6825","nonce":4074216082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6827","nonce":4074216082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6831","nonce":4074216082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4074216082},{"type":"v1","addr":"172.21.15.131:6829","nonce":4074216082}]},"public_addr":"172.21.15.131:6825/4074216082","cluster_addr":"172.21.15.131:6827/4074216082","heartbeat_back_addr":"172.21.15.131:6831/4074216082","heartbeat_front_addr":"172.21.15.131:6829/4074216082","state":["exists","up"]},{"osd":11,"uuid":"cc762f9a-dc74-4101-8173-04b4736231d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6825","nonce":555413250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6827","nonce":555413250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6831","nonce":555413250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":555413250},{"type":"v1","addr":"172.21.15.135:6829","nonce":555413250}]},"public_addr":"172.21.15.135:6825/555413250","cluster_addr":"172.21.15.135:6827/555413250","heartbeat_back_addr":"172.21.15.135:6831/555413250","heartbeat_front_addr":"172.21.15.135:6829/555413250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:54:53.551706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:17.601334+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:55:42.961895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:08.998176+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:56:35.574929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:00.611572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:27.834028+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:57:53.792264+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:17.801129+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:58:44.585716+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:09.802848+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:34.767237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3470391779":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3913578653":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6800/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6801/2022256684":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/1979169918":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/172869376":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6800/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/2017286086":"2024-09-11T23:52:51.509685+0000","172.21.15.19:6801/3829413546":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/963841749":"2024-09-11T23:52:51.509685+0000","172.21.15.19:0/885611356":"2024-09-11T23:52:27.323340+0000","172.21.15.19:0/2168429169":"2024-09-11T23:52:27.323340+0000","172.21.15.19:6800/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:6801/3641264705":"2024-09-11T23:53:52.390665+0000","172.21.15.19:0/3578109266":"2024-09-11T23:53:52.390665+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:13:39.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc9c0b5450 msgr2=0x7fcc9c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:39.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc9c0b5450 0x7fcc9c0b7910 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca0031400 comp rx=0 tx=0).stop 2024-09-11T00:13:39.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0109150 msgr2=0x7fccb019ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:39.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0109150 0x7fccb019ec60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcca800eaa0 tx=0x7fcca800ef60 comp rx=0 tx=0).stop 2024-09-11T00:13:39.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 shutdown_connections 2024-09-11T00:13:39.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fcc9c0b5450 0x7fcc9c0b7910 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccb0109150 0x7fccb019ec60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccb01087d0 0x7fccb01998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 --2- 172.21.15.19:0/2599327010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb0102dc0 0x7fccb0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:39.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 >> 172.21.15.19:0/2599327010 conn(0x7fccb00fe830 msgr2=0x7fccb0106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:39.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 shutdown_connections 2024-09-11T00:13:39.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:39.919+0000 7fccb55ad640 1 -- 172.21.15.19:0/2599327010 wait complete. 2024-09-11T00:13:40.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:39 smithi135 ceph-mon[35432]: pgmap v669: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T00:13:40.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:39 smithi131 ceph-mon[35491]: pgmap v669: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T00:13:40.585 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T00:13:40.843 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:41.112 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:40 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2599327010' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:41.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:40 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2599327010' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:41.300 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:40 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2599327010' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.346+0000 7f669df45640 1 -- 172.21.15.19:0/721370140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669810f3e0 msgr2=0x7f66981117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.346+0000 7f669df45640 1 --2- 172.21.15.19:0/721370140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669810f3e0 0x7f66981117d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6690009ca0 tx=0x7f669002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 -- 172.21.15.19:0/721370140 shutdown_connections 2024-09-11T00:13:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 --2- 172.21.15.19:0/721370140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669810f3e0 0x7f66981117d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 --2- 172.21.15.19:0/721370140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698075f40 0x7f669810ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 --2- 172.21.15.19:0/721370140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698075540 0x7f6698075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 -- 172.21.15.19:0/721370140 >> 172.21.15.19:0/721370140 conn(0x7f66980fe830 msgr2=0x7f6698100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 -- 172.21.15.19:0/721370140 shutdown_connections 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 -- 172.21.15.19:0/721370140 wait complete. 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 Processor -- start 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.347+0000 7f669df45640 1 -- start start 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f669df45640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6698075540 0x7f669819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f669df45640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698075f40 0x7f669819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f669df45640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669810f3e0 0x7f66981a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f669df45640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6698114f70 con 0x7f6698075540 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f669df45640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6698114df0 con 0x7f6698075f40 2024-09-11T00:13:41.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f669df45640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f66981150f0 con 0x7f669810f3e0 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6698075540 0x7f669819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6698075540 0x7f669819b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45738/0 (socket says 172.21.15.19:45738) 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 -- 172.21.15.19:0/501882055 learned_addr learned my addr 172.21.15.19:0/501882055 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f6696ffd640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698075f40 0x7f669819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f6697fff640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669810f3e0 0x7f66981a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 -- 172.21.15.19:0/501882055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669810f3e0 msgr2=0x7f66981a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669810f3e0 0x7f66981a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 -- 172.21.15.19:0/501882055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698075f40 msgr2=0x7f669819b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698075f40 0x7f669819b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 -- 172.21.15.19:0/501882055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981a14f0 con 0x7f6698075540 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f66977fe640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6698075540 0x7f669819b440 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f668800e9f0 tx=0x7f668800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f6694ff9640 1 -- 172.21.15.19:0/501882055 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668800cd80 con 0x7f6698075540 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66981a17e0 con 0x7f6698075540 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f6694ff9640 1 -- 172.21.15.19:0/501882055 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66880054d0 con 0x7f6698075540 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.348+0000 7f6694ff9640 1 -- 172.21.15.19:0/501882055 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688010690 con 0x7f6698075540 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.349+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66981a7ea0 con 0x7f6698075540 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.349+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6698075920 con 0x7f6698075540 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.352+0000 7f6694ff9640 1 -- 172.21.15.19:0/501882055 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f6688004e30 con 0x7f6698075540 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.352+0000 7f6694ff9640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f66800b5450 0x7f66800b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.353+0000 7f6696ffd640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f66800b5450 0x7f66800b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.353+0000 7f6694ff9640 1 -- 172.21.15.19:0/501882055 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8441+0+0 (secure 0 0 0) 0x7f66880e6600 con 0x7f6698075540 2024-09-11T00:13:41.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.353+0000 7f6696ffd640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f66800b5450 0x7f66800b7910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f66981109d0 tx=0x7f668c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.355+0000 7f6694ff9640 1 -- 172.21.15.19:0/501882055 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6688056220 con 0x7f6698075540 2024-09-11T00:13:41.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.580+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f66981a8280 con 0x7f6698075540 2024-09-11T00:13:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.583+0000 7f6694ff9640 1 -- 172.21.15.19:0/501882055 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) ==== 161+0+0 (secure 0 0 0) 0x7f66880ad1d0 con 0x7f6698075540 2024-09-11T00:13:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T00:13:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f66800b5450 msgr2=0x7f66800b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f66800b5450 0x7f66800b7910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f66981109d0 tx=0x7f668c00b390 comp rx=0 tx=0).stop 2024-09-11T00:13:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6698075540 msgr2=0x7f669819b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6698075540 0x7f669819b440 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f668800e9f0 tx=0x7f668800edf0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 shutdown_connections 2024-09-11T00:13:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669810f3e0 0x7f66981a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698075f40 0x7f669819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f66800b5450 0x7f66800b7910 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 --2- 172.21.15.19:0/501882055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6698075540 0x7f669819b440 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.585+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 >> 172.21.15.19:0/501882055 conn(0x7f66980fe830 msgr2=0x7f66980ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.586+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 shutdown_connections 2024-09-11T00:13:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:41.586+0000 7f669df45640 1 -- 172.21.15.19:0/501882055 wait complete. 2024-09-11T00:13:41.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a[30855]: 2024-09-11T00:13:41.581+0000 7f7182514640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:13:41.864 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c[66878]: ignoring --setuser ceph since I am not root 2024-09-11T00:13:41.864 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c[66878]: ignoring --setgroup ceph since I am not root 2024-09-11T00:13:41.864 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mds[66882]: -- 172.21.15.135:0/543792454 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5644302b5860 con 0x564430293000 2024-09-11T00:13:41.864 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c[66878]: starting mds.c at 2024-09-11T00:13:41.864 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i[67194]: ignoring --setuser ceph since I am not root 2024-09-11T00:13:41.865 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i[67194]: ignoring --setgroup ceph since I am not root 2024-09-11T00:13:41.865 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mds[67198]: -- 172.21.15.135:0/258332643 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8fd1e5860 con 0x55a8fd1c3000 2024-09-11T00:13:41.865 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i[67194]: starting mds.i at 2024-09-11T00:13:41.865 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l[66265]: ignoring --setuser ceph since I am not root 2024-09-11T00:13:41.865 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l[66265]: ignoring --setgroup ceph since I am not root 2024-09-11T00:13:41.865 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l[66265]: starting mds.l at 2024-09-11T00:13:41.865 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f[66582]: ignoring --setuser ceph since I am not root 2024-09-11T00:13:41.866 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f[66582]: ignoring --setgroup ceph since I am not root 2024-09-11T00:13:41.866 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mds[66586]: -- 172.21.15.135:0/3435624029 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622011d9860 con 0x5622011b6800 2024-09-11T00:13:41.866 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f[66582]: starting mds.f at 2024-09-11T00:13:41.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-mon[30859]: pgmap v670: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T00:13:41.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/501882055' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:13:41.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-mon[30859]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:13:41.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-mon[30859]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:13:41.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/501882055' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:13:41.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-mon[30859]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:13:41.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:41 smithi019 ceph-mon[30859]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T00:13:42.050 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b[66435]: ignoring --setuser ceph since I am not root 2024-09-11T00:13:42.051 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b[66435]: ignoring --setgroup ceph since I am not root 2024-09-11T00:13:42.051 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mds[66439]: -- 172.21.15.131:0/3270305581 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563b2408f860 con 0x563b2406d000 2024-09-11T00:13:42.051 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b[66435]: starting mds.b at 2024-09-11T00:13:42.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mon[35491]: pgmap v670: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T00:13:42.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/501882055' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:13:42.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mon[35491]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:13:42.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mon[35491]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/501882055' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mon[35491]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mon[35491]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h[66123]: ignoring --setuser ceph since I am not root 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h[66123]: ignoring --setgroup ceph since I am not root 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-mds[66127]: -- 172.21.15.131:0/2190767839 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b36b0d860 con 0x561b36aea800 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h[66123]: starting mds.h at 2024-09-11T00:13:42.052 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:13:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h[66123]: 2024-09-11T00:13:41.631+0000 7f6a887c3640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6836/0: (98) Address already in use 2024-09-11T00:13:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mon[35432]: pgmap v670: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T00:13:42.175 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/501882055' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:13:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mon[35432]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:13:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mon[35432]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:13:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/501882055' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:13:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mon[35432]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:13:42.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:41 smithi135 ceph-mon[35432]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T00:13:42.272 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T00:13:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.031+0000 7fc093aa2640 1 -- 172.21.15.19:0/3661382484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 msgr2=0x7fc08c101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.031+0000 7fc093aa2640 1 --2- 172.21.15.19:0/3661382484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c101c50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc088009900 tx=0x7fc08802a410 comp rx=0 tx=0).stop 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.031+0000 7fc093aa2640 1 -- 172.21.15.19:0/3661382484 shutdown_connections 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.031+0000 7fc093aa2640 1 --2- 172.21.15.19:0/3661382484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc08c10f420 0x7fc08c111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.031+0000 7fc093aa2640 1 --2- 172.21.15.19:0/3661382484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c102190 0x7fc08c10eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.031+0000 7fc093aa2640 1 --2- 172.21.15.19:0/3661382484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c101c50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.031+0000 7fc093aa2640 1 -- 172.21.15.19:0/3661382484 >> 172.21.15.19:0/3661382484 conn(0x7fc08c0fd700 msgr2=0x7fc08c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 -- 172.21.15.19:0/3661382484 shutdown_connections 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 -- 172.21.15.19:0/3661382484 wait complete. 2024-09-11T00:13:43.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 Processor -- start 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 -- start start 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c19b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c102190 0x7fc08c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc08c10f420 0x7fc08c1a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c114f70 con 0x7fc08c101870 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c114df0 con 0x7fc08c102190 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc093aa2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c1150f0 con 0x7fc08c10f420 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc09183e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c19b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.032+0000 7fc09183e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c19b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52880/0 (socket says 172.21.15.19:52880) 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09183e640 1 -- 172.21.15.19:0/2556391489 learned_addr learned my addr 172.21.15.19:0/2556391489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09103d640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c102190 0x7fc08c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09203f640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc08c10f420 0x7fc08c1a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09183e640 1 -- 172.21.15.19:0/2556391489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc08c10f420 msgr2=0x7fc08c1a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09183e640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc08c10f420 0x7fc08c1a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09183e640 1 -- 172.21.15.19:0/2556391489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c102190 msgr2=0x7fc08c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09183e640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c102190 0x7fc08c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09183e640 1 -- 172.21.15.19:0/2556391489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c1a1550 con 0x7fc08c101870 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc09183e640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c19b4a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc088005940 tx=0x7fc0880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc07effd640 1 -- 172.21.15.19:0/2556391489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08803f030 con 0x7fc08c101870 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc07effd640 1 -- 172.21.15.19:0/2556391489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc088003cb0 con 0x7fc08c101870 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c1a17e0 con 0x7fc08c101870 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc07effd640 1 -- 172.21.15.19:0/2556391489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088035070 con 0x7fc08c101870 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.033+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c1a7f00 con 0x7fc08c101870 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.034+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c101c50 con 0x7fc08c101870 2024-09-11T00:13:43.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.036+0000 7fc07effd640 1 -- 172.21.15.19:0/2556391489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fc08803bbf0 con 0x7fc08c101870 2024-09-11T00:13:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.037+0000 7fc07effd640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc0780b5450 0x7fc0780b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.037+0000 7fc09103d640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc0780b5450 0x7fc0780b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.037+0000 7fc07effd640 1 -- 172.21.15.19:0/2556391489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8655+0+0 (secure 0 0 0) 0x7fc088106e60 con 0x7fc08c101870 2024-09-11T00:13:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.038+0000 7fc09103d640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc0780b5450 0x7fc0780b7910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc08c1035b0 tx=0x7fc08000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:43.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.041+0000 7fc07effd640 1 -- 172.21.15.19:0/2556391489 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0880cd310 con 0x7fc08c101870 2024-09-11T00:13:43.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.265+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc08c1a81a0 con 0x7fc08c101870 2024-09-11T00:13:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.591+0000 7fc07effd640 1 -- 172.21.15.19:0/2556391489 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7fc0880d1d40 con 0x7fc08c101870 2024-09-11T00:13:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc0780b5450 msgr2=0x7fc0780b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc0780b5450 0x7fc0780b7910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc08c1035b0 tx=0x7fc08000b390 comp rx=0 tx=0).stop 2024-09-11T00:13:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 msgr2=0x7fc08c19b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c19b4a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc088005940 tx=0x7fc0880042f0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 shutdown_connections 2024-09-11T00:13:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc08c10f420 0x7fc08c1a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c102190 0x7fc08c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fc0780b5450 0x7fc0780b7910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 --2- 172.21.15.19:0/2556391489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc08c101870 0x7fc08c19b4a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 >> 172.21.15.19:0/2556391489 conn(0x7fc08c0fd700 msgr2=0x7fc08c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:43.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 shutdown_connections 2024-09-11T00:13:43.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:43.594+0000 7fc093aa2640 1 -- 172.21.15.19:0/2556391489 wait complete. 2024-09-11T00:13:43.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.131:6836/3498778773,v1:172.21.15.131:6838/3498778773] up:boot 2024-09-11T00:13:43.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.131:6837/710604564,v1:172.21.15.131:6839/710604564] up:boot 2024-09-11T00:13:43.921 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6834/122812409,v1:172.21.15.135:6836/122812409] up:boot 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6832/824807191,v1:172.21.15.135:6835/824807191] up:boot 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6833/1934210908,v1:172.21.15.135:6837/1934210908] up:boot 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: mds.? [v2:172.21.15.135:6838/2415146681,v1:172.21.15.135:6839/2415146681] up:boot 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: pgmap v672: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-11T00:13:43.922 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:43 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2556391489' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:13:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.131:6836/3498778773,v1:172.21.15.131:6838/3498778773] up:boot 2024-09-11T00:13:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.131:6837/710604564,v1:172.21.15.131:6839/710604564] up:boot 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6834/122812409,v1:172.21.15.135:6836/122812409] up:boot 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6832/824807191,v1:172.21.15.135:6835/824807191] up:boot 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6833/1934210908,v1:172.21.15.135:6837/1934210908] up:boot 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: mds.? [v2:172.21.15.135:6838/2415146681,v1:172.21.15.135:6839/2415146681] up:boot 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:13:43.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:13:43.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: pgmap v672: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-11T00:13:43.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:43 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2556391489' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:13:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.131:6836/3498778773,v1:172.21.15.131:6838/3498778773] up:boot 2024-09-11T00:13:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.131:6837/710604564,v1:172.21.15.131:6839/710604564] up:boot 2024-09-11T00:13:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6834/122812409,v1:172.21.15.135:6836/122812409] up:boot 2024-09-11T00:13:44.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6832/824807191,v1:172.21.15.135:6835/824807191] up:boot 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6833/1934210908,v1:172.21.15.135:6837/1934210908] up:boot 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: mds.? [v2:172.21.15.135:6838/2415146681,v1:172.21.15.135:6839/2415146681] up:boot 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: from='mgr.14220 172.21.15.19:0/2575308862' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: pgmap v672: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-11T00:13:44.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:43 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2556391489' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:13:44.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T00:13:44.547 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:44.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:44 smithi135 ceph-mon[35432]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:13:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:44 smithi135 ceph-mon[35432]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:13:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:44 smithi135 ceph-mon[35432]: Cluster is now healthy 2024-09-11T00:13:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:44 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2556391489' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:13:44.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:44 smithi135 ceph-mon[35432]: fsmap 12 up:standby 2024-09-11T00:13:44.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:44 smithi019 ceph-mon[30859]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:13:44.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:44 smithi019 ceph-mon[30859]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:13:44.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:44 smithi019 ceph-mon[30859]: Cluster is now healthy 2024-09-11T00:13:44.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:44 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2556391489' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:13:44.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:44 smithi019 ceph-mon[30859]: fsmap 12 up:standby 2024-09-11T00:13:44.951 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:44 smithi131 ceph-mon[35491]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:13:44.952 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:44 smithi131 ceph-mon[35491]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:13:44.952 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:44 smithi131 ceph-mon[35491]: Cluster is now healthy 2024-09-11T00:13:44.952 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:44 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2556391489' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:13:44.952 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:44 smithi131 ceph-mon[35491]: fsmap 12 up:standby 2024-09-11T00:13:45.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 -- 172.21.15.19:0/995841749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec0101c90 msgr2=0x7f2ec0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:45.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 --2- 172.21.15.19:0/995841749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec0101c90 0x7f2ec0102070 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009900 tx=0x7f2eb802a410 comp rx=0 tx=0).stop 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 -- 172.21.15.19:0/995841749 shutdown_connections 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 --2- 172.21.15.19:0/995841749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0108020 0x7f2ec010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 --2- 172.21.15.19:0/995841749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec01076a0 0x7f2ec0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 --2- 172.21.15.19:0/995841749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec0101c90 0x7f2ec0102070 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 -- 172.21.15.19:0/995841749 >> 172.21.15.19:0/995841749 conn(0x7f2ec00fd700 msgr2=0x7f2ec00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 -- 172.21.15.19:0/995841749 shutdown_connections 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 -- 172.21.15.19:0/995841749 wait complete. 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 Processor -- start 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.025+0000 7f2ec598d640 1 -- start start 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ec598d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0101c90 0x7f2ec01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ec598d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec01076a0 0x7f2ec01997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ec598d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0108020 0x7f2ec019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ec598d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0111ce0 con 0x7f2ec01076a0 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ec598d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0111b60 con 0x7f2ec0101c90 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ec598d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0111e60 con 0x7f2ec0108020 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec01076a0 0x7f2ec01997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec01076a0 0x7f2ec01997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52900/0 (socket says 172.21.15.19:52900) 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 -- 172.21.15.19:0/160585553 learned_addr learned my addr 172.21.15.19:0/160585553 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebf7fe640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0108020 0x7f2ec019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebeffd640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0101c90 0x7f2ec01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 -- 172.21.15.19:0/160585553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0108020 msgr2=0x7f2ec019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0108020 0x7f2ec019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 -- 172.21.15.19:0/160585553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0101c90 msgr2=0x7f2ec01992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0101c90 0x7f2ec01992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 -- 172.21.15.19:0/160585553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec019f360 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebeffd640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0101c90 0x7f2ec01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.026+0000 7f2ebe7fc640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec01076a0 0x7f2ec01997f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800d950 tx=0x7f2ea800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.027+0000 7f2ec498b640 1 -- 172.21.15.19:0/160585553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8017070 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.027+0000 7f2ec498b640 1 -- 172.21.15.19:0/160585553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea8009c30 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.027+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec019f650 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.027+0000 7f2ec498b640 1 -- 172.21.15.19:0/160585553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800f620 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.027+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec01a5d10 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.028+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec0102070 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.029+0000 7f2ec498b640 1 -- 172.21.15.19:0/160585553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7f2ea8010460 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.030+0000 7f2ec498b640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2eac0b5450 0x7f2eac0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.030+0000 7f2ebeffd640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2eac0b5450 0x7f2eac0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.030+0000 7f2ec498b640 1 -- 172.21.15.19:0/160585553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8655+0+0 (secure 0 0 0) 0x7f2ea80e5ca0 con 0x7f2ec01076a0 2024-09-11T00:13:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.030+0000 7f2ebeffd640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2eac0b5450 0x7f2eac0b7910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8031440 tx=0x7f2eb8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:45.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.033+0000 7f2ec498b640 1 -- 172.21.15.19:0/160585553 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2ea80ac7a0 con 0x7f2ec01076a0 2024-09-11T00:13:45.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.221+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ec019a3e0 con 0x7f2ec01076a0 2024-09-11T00:13:45.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.599+0000 7f2ec498b640 1 -- 172.21.15.19:0/160585553 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7f2ea8009de0 con 0x7f2ec01076a0 2024-09-11T00:13:45.603 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-11T00:13:45.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2eac0b5450 msgr2=0x7f2eac0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:45.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2eac0b5450 0x7f2eac0b7910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8031440 tx=0x7f2eb8005a20 comp rx=0 tx=0).stop 2024-09-11T00:13:45.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec01076a0 msgr2=0x7f2ec01997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:45.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec01076a0 0x7f2ec01997f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800d950 tx=0x7f2ea800de10 comp rx=0 tx=0).stop 2024-09-11T00:13:45.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 shutdown_connections 2024-09-11T00:13:45.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0108020 0x7f2ec019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7f2eac0b5450 0x7f2eac0b7910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec01076a0 0x7f2ec01997f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 --2- 172.21.15.19:0/160585553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0101c90 0x7f2ec01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:45.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.603+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 >> 172.21.15.19:0/160585553 conn(0x7f2ec00fd700 msgr2=0x7f2ec006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:45.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.604+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 shutdown_connections 2024-09-11T00:13:45.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:45.604+0000 7f2ec598d640 1 -- 172.21.15.19:0/160585553 wait complete. 2024-09-11T00:13:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:45 smithi135 ceph-mon[35432]: pgmap v673: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 6 op/s 2024-09-11T00:13:45.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:45 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/160585553' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:13:45.937 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:45 smithi019 ceph-mon[30859]: pgmap v673: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 6 op/s 2024-09-11T00:13:45.937 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:45 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/160585553' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:13:45.967 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:45 smithi131 ceph-mon[35491]: pgmap v673: 97 pgs: 97 active+clean; 811 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 6 op/s 2024-09-11T00:13:45.967 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:45 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/160585553' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:13:46.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T00:13:46.543 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:46.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:46 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/160585553' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:13:46.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:46 smithi131 ceph-mon[35491]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:13:46.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:46 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/160585553' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:13:46.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:46 smithi135 ceph-mon[35432]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:13:46.940 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:46 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/160585553' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:13:46.941 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:46 smithi019 ceph-mon[30859]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:13:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 -- 172.21.15.19:0/3349248736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 msgr2=0x7fac0c104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 --2- 172.21.15.19:0/3349248736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c104080 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009900 tx=0x7fabfc02a410 comp rx=0 tx=0).stop 2024-09-11T00:13:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 -- 172.21.15.19:0/3349248736 shutdown_connections 2024-09-11T00:13:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 --2- 172.21.15.19:0/3349248736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c10d100 0x7fac0c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 --2- 172.21.15.19:0/3349248736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac0c1045c0 0x7fac0c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 --2- 172.21.15.19:0/3349248736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c104080 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 -- 172.21.15.19:0/3349248736 >> 172.21.15.19:0/3349248736 conn(0x7fac0c0fd700 msgr2=0x7fac0c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:47.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 -- 172.21.15.19:0/3349248736 shutdown_connections 2024-09-11T00:13:47.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.024+0000 7fac10abd640 1 -- 172.21.15.19:0/3349248736 wait complete. 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.025+0000 7fac10abd640 1 Processor -- start 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac10abd640 1 -- start start 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac10abd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac10abd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c1045c0 0x7fac0c101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac10abd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac0c10d100 0x7fac0c1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac10abd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c112d70 con 0x7fac0c103ca0 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac10abd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c112bf0 con 0x7fac0c1045c0 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac10abd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c112ef0 con 0x7fac0c10d100 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52912/0 (socket says 172.21.15.19:52912) 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 -- 172.21.15.19:0/2548853992 learned_addr learned my addr 172.21.15.19:0/2548853992 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac01d9b640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c1045c0 0x7fac0c101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0ad9d640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac0c10d100 0x7fac0c1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 -- 172.21.15.19:0/2548853992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac0c10d100 msgr2=0x7fac0c1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac0c10d100 0x7fac0c1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 -- 172.21.15.19:0/2548853992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c1045c0 msgr2=0x7fac0c101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c1045c0 0x7fac0c101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.026+0000 7fac0a59c640 1 -- 172.21.15.19:0/2548853992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c1a7620 con 0x7fac0c103ca0 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.027+0000 7fac0a59c640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c101950 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fabfc005940 tx=0x7fabfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.027+0000 7fac03fff640 1 -- 172.21.15.19:0/2548853992 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc03f030 con 0x7fac0c103ca0 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.027+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c1a78b0 con 0x7fac0c103ca0 2024-09-11T00:13:47.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.027+0000 7fac03fff640 1 -- 172.21.15.19:0/2548853992 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabfc003aa0 con 0x7fac0c103ca0 2024-09-11T00:13:47.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.027+0000 7fac03fff640 1 -- 172.21.15.19:0/2548853992 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc035070 con 0x7fac0c103ca0 2024-09-11T00:13:47.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.027+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c1a7de0 con 0x7fac0c103ca0 2024-09-11T00:13:47.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.028+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c104080 con 0x7fac0c103ca0 2024-09-11T00:13:47.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.029+0000 7fac03fff640 1 -- 172.21.15.19:0/2548853992 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 26) ==== 153381+0+0 (secure 0 0 0) 0x7fabfc03bab0 con 0x7fac0c103ca0 2024-09-11T00:13:47.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.031+0000 7fac03fff640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fabf80b54d0 0x7fabf80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.031+0000 7fac01d9b640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fabf80b54d0 0x7fabf80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:47.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.031+0000 7fac03fff640 1 -- 172.21.15.19:0/2548853992 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8130+0+0 (secure 0 0 0) 0x7fabfc106a90 con 0x7fac0c103ca0 2024-09-11T00:13:47.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.031+0000 7fac01d9b640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fabf80b54d0 0x7fabf80b7990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fac0c103440 tx=0x7fabf4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:47.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.034+0000 7fac03fff640 1 -- 172.21.15.19:0/2548853992 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fabfc0cd740 con 0x7fac0c103ca0 2024-09-11T00:13:47.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.218+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac0c1a8170 con 0x7fac0c103ca0 2024-09-11T00:13:47.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.611+0000 7fac03fff640 1 -- 172.21.15.19:0/2548853992 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7fabfc0cd040 con 0x7fac0c103ca0 2024-09-11T00:13:47.614 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fabf80b54d0 msgr2=0x7fabf80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fabf80b54d0 0x7fabf80b7990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fac0c103440 tx=0x7fabf4005f90 comp rx=0 tx=0).stop 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 msgr2=0x7fac0c101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c101950 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fabfc005940 tx=0x7fabfc004270 comp rx=0 tx=0).stop 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 shutdown_connections 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac0c10d100 0x7fac0c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c1045c0 0x7fac0c101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:6800/1170299416,v1:172.21.15.19:6801/1170299416] conn(0x7fabf80b54d0 0x7fabf80b7990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 --2- 172.21.15.19:0/2548853992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac0c103ca0 0x7fac0c101950 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 >> 172.21.15.19:0/2548853992 conn(0x7fac0c0fd700 msgr2=0x7fac0c10f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:47.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 shutdown_connections 2024-09-11T00:13:47.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-11T00:13:47.614+0000 7fac10abd640 1 -- 172.21.15.19:0/2548853992 wait complete. 2024-09-11T00:13:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:47 smithi135 ceph-mon[35432]: pgmap v675: 65 pgs: 65 active+clean; 435 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:47 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2548853992' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:13:48.003 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:47 smithi019 ceph-mon[30859]: pgmap v675: 65 pgs: 65 active+clean; 435 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:48.003 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:47 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2548853992' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:13:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:47 smithi131 ceph-mon[35491]: pgmap v675: 65 pgs: 65 active+clean; 435 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:48.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:47 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2548853992' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:13:48.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:13:48.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:13:48.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:13:48.463 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T00:13:48.463 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:13:48.486 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:13:48.502 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:13:48.519 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T00:13:48.520 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T00:13:48.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a 2024-09-11T00:13:48.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:48 smithi131 ceph-mon[35491]: from='client.? 172.21.15.19:0/2548853992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:13:48.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:48 smithi131 ceph-mon[35491]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T00:13:48.925 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:48 smithi019 systemd[1]: Stopping Ceph mon.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:13:48.925 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:48 smithi019 ceph-mon[30859]: from='client.? 172.21.15.19:0/2548853992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:13:48.926 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:48 smithi019 ceph-mon[30859]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T00:13:48.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:48 smithi135 ceph-mon[35432]: from='client.? 172.21.15.19:0/2548853992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:13:48.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:48 smithi135 ceph-mon[35432]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T00:13:49.258 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a[30855]: 2024-09-11T00:13:48.923+0000 7f7187d1f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:13:49.259 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a[30855]: 2024-09-11T00:13:48.923+0000 7f7187d1f640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T00:13:49.259 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:48 smithi019 podman[107270]: 2024-09-11 00:13:48.965070028 +0000 UTC m=+0.157345987 container died 1f3c3449861044c84a0861a7af18fcfcad64fdc7cd9be44fc09b3f2df7864f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T00:13:49.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:49 smithi019 podman[107270]: 2024-09-11 00:13:49.348400947 +0000 UTC m=+0.540676888 container cleanup 1f3c3449861044c84a0861a7af18fcfcad64fdc7cd9be44fc09b3f2df7864f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T00:13:49.523 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 11 00:13:49 smithi019 bash[107270]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-a 2024-09-11T00:13:49.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T00:13:49.840 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:13:49.841 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T00:13:49.841 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T00:13:49.841 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.b 2024-09-11T00:13:50.186 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:49 smithi131 systemd[1]: Stopping Ceph mon.b for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:13:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-b[35487]: 2024-09-11T00:13:50.184+0000 7fe46a920640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:13:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-b[35487]: 2024-09-11T00:13:50.184+0000 7fe46a920640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T00:13:50.550 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:50 smithi131 podman[70686]: 2024-09-11 00:13:50.337892904 +0000 UTC m=+0.298703546 container died 471db5df2c43aa04a7ba4fc38b55912bb611251d29dd08bf5d2def3399ebb7d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T00:13:50.962 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:50 smithi131 podman[70686]: 2024-09-11 00:13:50.726326876 +0000 UTC m=+0.687137510 container cleanup 471db5df2c43aa04a7ba4fc38b55912bb611251d29dd08bf5d2def3399ebb7d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T00:13:50.962 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 11 00:13:50 smithi131 bash[70686]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-b 2024-09-11T00:13:51.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T00:13:51.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:13:51.135 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T00:13:51.135 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T00:13:51.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.c 2024-09-11T00:13:51.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:51 smithi135 systemd[1]: Stopping Ceph mon.c for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:13:51.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-c[35426]: 2024-09-11T00:13:51.630+0000 7f5ecc198640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:13:51.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-c[35426]: 2024-09-11T00:13:51.630+0000 7f5ecc198640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T00:13:51.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:51 smithi135 podman[71996]: 2024-09-11 00:13:51.875841245 +0000 UTC m=+0.416249145 container died bf91465b581a555f36167546a779637a688eeb5bd1a1637f46ec7cfb8f9b05b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:13:52.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:52 smithi135 podman[71996]: 2024-09-11 00:13:52.264951317 +0000 UTC m=+0.805359218 container cleanup bf91465b581a555f36167546a779637a688eeb5bd1a1637f46ec7cfb8f9b05b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T00:13:52.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Sep 11 00:13:52 smithi135 bash[71996]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mon-c 2024-09-11T00:13:52.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T00:13:52.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:13:52.729 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T00:13:52.729 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T00:13:52.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.x 2024-09-11T00:13:53.023 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:13:52 smithi019 systemd[1]: Stopping Ceph mgr.x for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:13:54.023 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:13:53 smithi019 podman[107391]: 2024-09-11 00:13:53.721736148 +0000 UTC m=+0.800078631 container died 06c2442c6e82f13966ce3e955c16c45c5c0a8be223ca5b15b85d3ad292f5a3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:13:54.749 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:13:54 smithi019 podman[107391]: 2024-09-11 00:13:54.463204283 +0000 UTC m=+1.541546828 container cleanup 06c2442c6e82f13966ce3e955c16c45c5c0a8be223ca5b15b85d3ad292f5a3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T00:13:54.749 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 11 00:13:54 smithi019 bash[107391]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-x 2024-09-11T00:13:54.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T00:13:54.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:13:54.923 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T00:13:54.923 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T00:13:54.923 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.y 2024-09-11T00:13:55.300 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 11 00:13:54 smithi131 systemd[1]: Stopping Ceph mgr.y for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:13:55.867 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 11 00:13:55 smithi131 podman[70810]: 2024-09-11 00:13:55.563632086 +0000 UTC m=+0.446914570 container died 1bac838ac984d0b1c7e424f177d88eedf1366fc4895bd89c6928e8737ffc1226 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:13:56.209 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 11 00:13:55 smithi131 podman[70810]: 2024-09-11 00:13:55.973809801 +0000 UTC m=+0.857092278 container cleanup 1bac838ac984d0b1c7e424f177d88eedf1366fc4895bd89c6928e8737ffc1226 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:13:56.210 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Sep 11 00:13:55 smithi131 bash[70810]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-y 2024-09-11T00:13:56.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T00:13:56.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:13:56.377 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T00:13:56.377 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T00:13:56.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.z 2024-09-11T00:13:56.675 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 11 00:13:56 smithi135 systemd[1]: Stopping Ceph mgr.z for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:13:57.175 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 11 00:13:56 smithi135 podman[72117]: 2024-09-11 00:13:56.917915809 +0000 UTC m=+0.344067756 container died 391ca49c29deb8931f0a590327fc26d5e69fd2efff485b94fa92769f9a47dee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-11T00:13:57.540 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 11 00:13:57 smithi135 podman[72117]: 2024-09-11 00:13:57.303945025 +0000 UTC m=+0.730096961 container cleanup 391ca49c29deb8931f0a590327fc26d5e69fd2efff485b94fa92769f9a47dee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:13:57.540 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 11 00:13:57 smithi135 bash[72117]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-z 2024-09-11T00:13:57.798 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 11 00:13:57 smithi135 podman[72129]: 2024-09-11 00:13:57.538959579 +0000 UTC m=+0.625175849 container remove 391ca49c29deb8931f0a590327fc26d5e69fd2efff485b94fa92769f9a47dee7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mgr-z, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T00:13:57.798 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Sep 11 00:13:57 smithi135 systemd[1]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-11T00:13:57.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T00:13:57.838 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:13:57.838 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T00:13:57.838 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T00:13:57.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.0 2024-09-11T00:13:58.152 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:13:57 smithi019 systemd[1]: Stopping Ceph osd.0 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:13:58.523 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:13:58 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0[49043]: 2024-09-11T00:13:58.150+0000 7f13edf2f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:13:58.523 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:13:58 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0[49043]: 2024-09-11T00:13:58.150+0000 7f13edf2f640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-11T00:13:58.523 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:13:58 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0[49043]: 2024-09-11T00:13:58.150+0000 7f13edf2f640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:03.817 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:03 smithi019 podman[107511]: 2024-09-11 00:14:03.564175734 +0000 UTC m=+5.532502431 container died 88fca869e54f53cf2b0c53e88513491eb3e95cf7fb99a04a28683c3bdb27781e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:14:04.220 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:03 smithi019 podman[107511]: 2024-09-11 00:14:03.976088936 +0000 UTC m=+5.944415632 container cleanup 88fca869e54f53cf2b0c53e88513491eb3e95cf7fb99a04a28683c3bdb27781e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T00:14:04.220 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:03 smithi019 bash[107511]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0 2024-09-11T00:14:04.522 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:04 smithi019 podman[107526]: 2024-09-11 00:14:04.21934792 +0000 UTC m=+0.649608073 container remove 88fca869e54f53cf2b0c53e88513491eb3e95cf7fb99a04a28683c3bdb27781e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:04.940 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:04 smithi019 podman[107621]: 2024-09-11 00:14:04.563109478 +0000 UTC m=+0.016513674 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:04.940 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:04 smithi019 podman[107621]: 2024-09-11 00:14:04.678353679 +0000 UTC m=+0.131757865 container create 795f966a7af6fbc40873292b119c67eee3666b1af112dd543c05563985719f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T00:14:05.273 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:04 smithi019 podman[107621]: 2024-09-11 00:14:04.93932191 +0000 UTC m=+0.392726112 container init 795f966a7af6fbc40873292b119c67eee3666b1af112dd543c05563985719f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T00:14:05.273 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:04 smithi019 podman[107621]: 2024-09-11 00:14:04.942908008 +0000 UTC m=+0.396312195 container start 795f966a7af6fbc40873292b119c67eee3666b1af112dd543c05563985719f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T00:14:05.273 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:05 smithi019 podman[107621]: 2024-09-11 00:14:05.039546158 +0000 UTC m=+0.492950344 container attach 795f966a7af6fbc40873292b119c67eee3666b1af112dd543c05563985719f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T00:14:05.273 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 11 00:14:05 smithi019 podman[107621]: 2024-09-11 00:14:05.144052473 +0000 UTC m=+0.597456659 container died 795f966a7af6fbc40873292b119c67eee3666b1af112dd543c05563985719f44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-11T00:14:05.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T00:14:05.880 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:14:05.884 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T00:14:05.884 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T00:14:05.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.1 2024-09-11T00:14:06.196 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:05 smithi131 systemd[1]: Stopping Ceph osd.1 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:14:06.550 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1[41187]: 2024-09-11T00:14:06.193+0000 7f11121f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:06.550 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1[41187]: 2024-09-11T00:14:06.193+0000 7f11121f8640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-11T00:14:06.550 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1[41187]: 2024-09-11T00:14:06.193+0000 7f11121f8640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:11.955 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:11 smithi131 podman[70932]: 2024-09-11 00:14:11.639139012 +0000 UTC m=+5.564427182 container died 789848ef3662a7a4a256dc515b166aac800b162ed482c250f88f2b8a422b6681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:14:12.297 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 podman[70932]: 2024-09-11 00:14:12.053190199 +0000 UTC m=+5.978478365 container cleanup 789848ef3662a7a4a256dc515b166aac800b162ed482c250f88f2b8a422b6681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:14:12.297 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 bash[70932]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1 2024-09-11T00:14:12.550 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 podman[70947]: 2024-09-11 00:14:12.296470676 +0000 UTC m=+0.651507501 container remove 789848ef3662a7a4a256dc515b166aac800b162ed482c250f88f2b8a422b6681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T00:14:12.917 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 podman[71037]: 2024-09-11 00:14:12.605632238 +0000 UTC m=+0.105483058 container create 4f506003700032fd40be6f5543f884d2826a51ef80983cb97548ea2157c056e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T00:14:12.918 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 podman[71037]: 2024-09-11 00:14:12.515813864 +0000 UTC m=+0.015664680 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:12.918 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 podman[71037]: 2024-09-11 00:14:12.816555259 +0000 UTC m=+0.316406072 container init 4f506003700032fd40be6f5543f884d2826a51ef80983cb97548ea2157c056e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T00:14:12.918 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 podman[71037]: 2024-09-11 00:14:12.819923735 +0000 UTC m=+0.319774549 container start 4f506003700032fd40be6f5543f884d2826a51ef80983cb97548ea2157c056e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T00:14:12.918 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:12 smithi131 podman[71037]: 2024-09-11 00:14:12.916577139 +0000 UTC m=+0.416427969 container attach 4f506003700032fd40be6f5543f884d2826a51ef80983cb97548ea2157c056e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:13.281 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 11 00:14:13 smithi131 podman[71037]: 2024-09-11 00:14:13.006401698 +0000 UTC m=+0.506252520 container died 4f506003700032fd40be6f5543f884d2826a51ef80983cb97548ea2157c056e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T00:14:13.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T00:14:13.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:14:13.758 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T00:14:13.758 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T00:14:13.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.2 2024-09-11T00:14:14.067 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:13 smithi135 systemd[1]: Stopping Ceph osd.2 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:14:14.326 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2[41588]: 2024-09-11T00:14:14.065+0000 7f8c6e2bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:14.326 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2[41588]: 2024-09-11T00:14:14.065+0000 7f8c6e2bf640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-11T00:14:14.326 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2[41588]: 2024-09-11T00:14:14.065+0000 7f8c6e2bf640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:19.926 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:19 smithi135 podman[72244]: 2024-09-11 00:14:19.566359152 +0000 UTC m=+5.623586750 container died 7c70ce3e7ab5cf15b5360831898fc47914998162edb2db97d8f78e8ac71e1ce8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:14:20.345 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:20 smithi135 podman[72244]: 2024-09-11 00:14:20.033132929 +0000 UTC m=+6.090360523 container cleanup 7c70ce3e7ab5cf15b5360831898fc47914998162edb2db97d8f78e8ac71e1ce8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:20.345 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:20 smithi135 bash[72244]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2 2024-09-11T00:14:20.675 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:20 smithi135 podman[72271]: 2024-09-11 00:14:20.344757047 +0000 UTC m=+0.773486816 container remove 7c70ce3e7ab5cf15b5360831898fc47914998162edb2db97d8f78e8ac71e1ce8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:20.990 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:20 smithi135 podman[72360]: 2024-09-11 00:14:20.608520822 +0000 UTC m=+0.016370340 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:20.990 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:20 smithi135 podman[72360]: 2024-09-11 00:14:20.727858813 +0000 UTC m=+0.135708325 container create 43e41c009ed7befced0fb3f2971504671ae8febf1d9bae29b60ae441b72dda07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T00:14:21.346 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:20 smithi135 podman[72360]: 2024-09-11 00:14:20.988875916 +0000 UTC m=+0.396725427 container init 43e41c009ed7befced0fb3f2971504671ae8febf1d9bae29b60ae441b72dda07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:21.346 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:20 smithi135 podman[72360]: 2024-09-11 00:14:20.993151373 +0000 UTC m=+0.401000891 container start 43e41c009ed7befced0fb3f2971504671ae8febf1d9bae29b60ae441b72dda07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T00:14:21.346 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:21 smithi135 podman[72360]: 2024-09-11 00:14:21.097181248 +0000 UTC m=+0.505030761 container attach 43e41c009ed7befced0fb3f2971504671ae8febf1d9bae29b60ae441b72dda07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T00:14:21.675 INFO:journalctl@ceph.osd.2.smithi135.stdout:Sep 11 00:14:21 smithi135 podman[72360]: 2024-09-11 00:14:21.345049274 +0000 UTC m=+0.752898787 container died 43e41c009ed7befced0fb3f2971504671ae8febf1d9bae29b60ae441b72dda07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:22.048 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T00:14:22.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:14:22.090 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T00:14:22.090 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T00:14:22.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.3 2024-09-11T00:14:22.405 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:22 smithi019 systemd[1]: Stopping Ceph osd.3 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:14:22.772 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:22 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-11T00:14:22.403+0000 7f88a4ecf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:22.773 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:22 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-11T00:14:22.403+0000 7f88a4ecf640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-11T00:14:22.773 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:22 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-11T00:14:22.403+0000 7f88a4ecf640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:24.425 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:24.068+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:24.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:24 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:24.536+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:24.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:24.575+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:25.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:24 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:24.641+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:25.373 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:25.100+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:25.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:25.536+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:26.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:25 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:25.680+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:26.050 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:25 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:25.554+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:26.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:25.926+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:26.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:26.129+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:26.719 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:26 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-11T00:14:26.342+0000 7f889d4dc640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:59.528574+0000 front 2024-09-11T00:13:59.528624+0000 (oldest deadline 2024-09-11T00:14:25.428782+0000) 2024-09-11T00:14:26.720 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:26 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:26.330+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:26.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:26 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:26.517+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:26.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:26.555+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:27.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:26 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:26.718+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:27.425 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:27.121+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:27.426 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:26.965+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:27.694 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:27 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3[55464]: 2024-09-11T00:14:27.332+0000 7f889d4dc640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:59.528574+0000 front 2024-09-11T00:13:59.528624+0000 (oldest deadline 2024-09-11T00:14:25.428782+0000) 2024-09-11T00:14:27.694 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:27 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:27.379+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:27.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:27 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:27.480+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:27.926 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:27.535+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:28.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:27 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:27.692+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:28.023 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:27 smithi019 podman[107724]: 2024-09-11 00:14:27.846740005 +0000 UTC m=+5.558945995 container died 9330c1601b579344782297eaaf410bf5f48a6e0667b18875259c19a3ad91a64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T00:14:28.428 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:28.015+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:28.429 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:28.144+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:28.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:28 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:28.342+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:28.523 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:28 smithi019 podman[107724]: 2024-09-11 00:14:28.345756969 +0000 UTC m=+6.057963021 container cleanup 9330c1601b579344782297eaaf410bf5f48a6e0667b18875259c19a3ad91a64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T00:14:28.523 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:28 smithi019 bash[107724]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3 2024-09-11T00:14:28.526 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:28 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:28.237+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:28.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:28 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:28.525+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:28.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:28.563+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:29.022 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:28 smithi019 podman[107739]: 2024-09-11 00:14:28.73042009 +0000 UTC m=+0.880663347 container remove 9330c1601b579344782297eaaf410bf5f48a6e0667b18875259c19a3ad91a64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:29.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:28 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:28.719+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:29.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:29.026+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:29.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:29.155+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:29.451 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:29 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:29.294+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:29.451 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:29 smithi019 podman[107827]: 2024-09-11 00:14:29.025567644 +0000 UTC m=+0.016803067 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:29.452 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:29 smithi019 podman[107827]: 2024-09-11 00:14:29.156306605 +0000 UTC m=+0.147542056 container create ccb468dd2c9bef5d4a2cb045e994a1cbbcfa39b9edcbdfeaca13b20fbbe0245b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:29.491 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:29 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:29.191+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:29.717 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:29 smithi019 podman[107827]: 2024-09-11 00:14:29.450407196 +0000 UTC m=+0.441642605 container init ccb468dd2c9bef5d4a2cb045e994a1cbbcfa39b9edcbdfeaca13b20fbbe0245b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T00:14:29.717 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:29 smithi019 podman[107827]: 2024-09-11 00:14:29.453943546 +0000 UTC m=+0.445178954 container start ccb468dd2c9bef5d4a2cb045e994a1cbbcfa39b9edcbdfeaca13b20fbbe0245b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:29.717 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:29 smithi019 podman[107827]: 2024-09-11 00:14:29.558741062 +0000 UTC m=+0.549976473 container attach ccb468dd2c9bef5d4a2cb045e994a1cbbcfa39b9edcbdfeaca13b20fbbe0245b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-11T00:14:29.717 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 11 00:14:29 smithi019 podman[107827]: 2024-09-11 00:14:29.64871891 +0000 UTC m=+0.639954329 container died ccb468dd2c9bef5d4a2cb045e994a1cbbcfa39b9edcbdfeaca13b20fbbe0245b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T00:14:29.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:29 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:29.489+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:29.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:29.560+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:29.988 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:29 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:29.714+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:30.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T00:14:30.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:30.064+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:30.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:30.127+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:30.430 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:14:30.430 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T00:14:30.430 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T00:14:30.430 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.4 2024-09-11T00:14:30.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:30 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:30.154+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:30.704 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:30.298+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:30.733 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:30 smithi131 systemd[1]: Stopping Ceph osd.4 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:14:30.733 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:30 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:30.513+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:30.733 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:30 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:30.731+0000 7fda051e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:30.734 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:30 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:30.731+0000 7fda051e0640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-11T00:14:30.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:30.552+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:31.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:30 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:30.703+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:31.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:31 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:31.092+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:31.426 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:31 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:31.074+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:31.522 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:31 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:31.149+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:31.523 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:30 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:30.731+0000 7fda051e0640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:31.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:31 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:31.261+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:31.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:31 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:31.521+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:31.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:31 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:31.524+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:32.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:31 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:31.713+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:32.425 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:32 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:32.049+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:32.426 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:32 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:32.093+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:32.473 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:32 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:32.126+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:32.473 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:32 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:32.126+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:32.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:32.246+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:32.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:32 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:32.472+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:32.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:32 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:32.512+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:33.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:32 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:32.727+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:33.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:33 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:33.049+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:33.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:33 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:33.003+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:33.484 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:33 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:33.172+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:33.485 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:33 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:33.172+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:33.522 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:33 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:33.262+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:33.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:33 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:33.483+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:33.925 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:33 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:33.500+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:34.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:33 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:33.701+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:34.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:34 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:34.007+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:34.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:33 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:33.965+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:34.492 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:34 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:34.420+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:34.493 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:34 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:34.177+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:34.493 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:34 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:34.177+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:34.698 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:34 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:34.302+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:34.698 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:34 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:34.302+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:34.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:34 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:34.490+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:34.918 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:34 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:34.463+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:34.918 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:34 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:34.463+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:35.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:34 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:34.696+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:35.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:34 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:34.916+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:35.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:34 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:34.970+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:35.504 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:35 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:35.395+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:35.504 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:35 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:35.179+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:35.504 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:35 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:35.179+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:35.712 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:35 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:35.336+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:35.712 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:35 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:35.337+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:35.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:35 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4[47910]: 2024-09-11T00:14:35.503+0000 7fd9fd7ed640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.613128+0000 front 2024-09-11T00:13:58.613261+0000 (oldest deadline 2024-09-11T00:14:24.414169+0000) 2024-09-11T00:14:35.893 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:35 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:35.428+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:35.893 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:35 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:35.428+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:36.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:35 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:35.710+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:36.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:35 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:35.924+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:36.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:35 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:35.891+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:36.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:35 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:35.891+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:36.550 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:36 smithi131 podman[71152]: 2024-09-11 00:14:36.243537096 +0000 UTC m=+5.618261299 container died aede56d2cbc2e05b8e30540a77a8a4836412a4337c547d4c3340450a4976930f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-11T00:14:36.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:36 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:36.359+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:36.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:36 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:36.175+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:36.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:36 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:36.175+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:36.702 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:36 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:36.335+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:36.702 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:36 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:36.335+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:36.844 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:36 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:36.437+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:36.845 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:36 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:36.438+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:36.900 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:36 smithi131 podman[71152]: 2024-09-11 00:14:36.648831573 +0000 UTC m=+6.023555772 container cleanup aede56d2cbc2e05b8e30540a77a8a4836412a4337c547d4c3340450a4976930f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:14:36.901 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:36 smithi131 bash[71152]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4 2024-09-11T00:14:37.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:36 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:36.701+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:37.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:36 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:36.701+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:37.158 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:36 smithi131 podman[71169]: 2024-09-11 00:14:36.900076001 +0000 UTC m=+0.657913104 container remove aede56d2cbc2e05b8e30540a77a8a4836412a4337c547d4c3340450a4976930f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T00:14:37.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:36 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:36.919+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:37.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:36 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:36.919+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:37.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:36 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:36.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:37.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:36 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:36.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:37.471 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:37 smithi131 podman[71254]: 2024-09-11 00:14:37.242555505 +0000 UTC m=+0.097439091 container create cc7fd986edabec204fecfd7aec665eac5c9bd910ba8229b4952cddb480d2dd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T00:14:37.471 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:37 smithi131 podman[71254]: 2024-09-11 00:14:37.16087394 +0000 UTC m=+0.015757489 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:37.471 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:37 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:37.345+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:37.471 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:37 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:37.157+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:37.472 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:37 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:37.157+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:37.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:37 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:37.421+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:37.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:37 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:37.421+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:37.707 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:37 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:37.285+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:37.707 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:37 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:37.285+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:37.800 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:37 smithi131 podman[71254]: 2024-09-11 00:14:37.469840736 +0000 UTC m=+0.324724278 container init cc7fd986edabec204fecfd7aec665eac5c9bd910ba8229b4952cddb480d2dd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T00:14:37.801 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:37 smithi131 podman[71254]: 2024-09-11 00:14:37.473300195 +0000 UTC m=+0.328183745 container start cc7fd986edabec204fecfd7aec665eac5c9bd910ba8229b4952cddb480d2dd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-11T00:14:37.801 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:37 smithi131 podman[71254]: 2024-09-11 00:14:37.536538377 +0000 UTC m=+0.391421918 container attach cc7fd986edabec204fecfd7aec665eac5c9bd910ba8229b4952cddb480d2dd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T00:14:37.801 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 11 00:14:37 smithi131 podman[71254]: 2024-09-11 00:14:37.657837655 +0000 UTC m=+0.512721196 container died cc7fd986edabec204fecfd7aec665eac5c9bd910ba8229b4952cddb480d2dd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-11T00:14:38.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:37 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:37.705+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:38.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:37 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:37.705+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:38.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:37 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:37.947+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:38.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:37 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:37.947+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:38.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:37 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:37.835+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:38.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:37 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:37.835+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:38.297 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:38 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:38.123+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:38.297 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:38 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:38.123+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:38.356 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T00:14:38.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:14:38.439 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T00:14:38.439 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T00:14:38.439 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.5 2024-09-11T00:14:38.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:38 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:38.296+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:38.719 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:38 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:38.271+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:38.719 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:38 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:38.271+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:38.738 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:38.454+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:38.738 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:38.454+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:38.738 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:38 smithi135 systemd[1]: Stopping Ceph osd.5 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:14:38.738 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:38.736+0000 7fd685d87640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:38.739 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:38.736+0000 7fd685d87640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-11T00:14:38.739 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:38.736+0000 7fd685d87640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:39.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:38 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:38.717+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:39.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:38 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:38.717+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:39.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:38.976+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:39.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:38.976+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:39.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:38.875+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:39.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:38 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:38.875+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:39.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:39 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:39.312+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:39.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:39 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:39.084+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:39.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:39 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:39.084+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:39.735 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:39 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:39.286+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:39.735 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:39 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:39.286+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:39.836 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:39 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:39.451+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:39.836 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:39 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:39.451+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:40.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:39 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:39.733+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:40.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:39 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:39.733+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:40.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:40.024+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:40.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:40.024+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:40.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:39 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:39.834+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:40.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:39 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:39.834+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:40.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:40 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:40.278+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:40.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:40 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:40.120+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:40.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:40 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:40.120+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:40.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:40 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:40.120+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:40.715 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:40 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:40.281+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:40.715 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:40 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:40.281+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:40.806 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:40.468+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:40.807 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:40.468+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:41.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:40 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:40.713+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:41.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:40 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:40.713+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:41.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:40 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:40.713+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:41.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:40.805+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:41.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:40.805+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:41.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:40.805+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:41.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:40.976+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:41.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:40 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:40.976+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:41.552 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:41.273+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:41.553 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:41.089+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:41.553 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:41.089+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:41.553 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:41 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:41.089+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:41.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:41.422+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:41.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:41.422+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:41.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:41.422+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.755033+0000 front 2024-09-11T00:14:15.755076+0000 (oldest deadline 2024-09-11T00:14:41.055052+0000) 2024-09-11T00:14:41.726 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:41.293+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:41.726 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:41.293+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:41.726 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:41.293+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:42.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:41.724+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:42.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:41.724+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:42.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:41.724+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:42.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:42.003+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:42.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:42.003+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:42.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:41.837+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:42.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:41.837+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:42.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:41 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:41.837+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:42.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:42 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:42.287+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:42.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:42 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:42.052+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:42.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:42 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:42.052+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:42.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:42 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:42.052+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:42.763 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:42 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:42.316+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:42.763 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:42 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:42.316+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:42.763 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:42 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:42.316+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:42.790 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:42.462+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:42.791 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:42.462+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:42.791 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:42.462+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.755033+0000 front 2024-09-11T00:14:15.755076+0000 (oldest deadline 2024-09-11T00:14:41.055052+0000) 2024-09-11T00:14:43.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:42 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:42.761+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:43.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:42 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:42.761+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:43.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:42 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:42.761+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:43.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:42.966+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:43.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:42.966+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:43.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:42.966+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:43.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:42.789+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:43.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:42.789+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:43.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:42 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:42.789+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:43.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:43 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:43.300+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:43.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:43 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:43.300+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:43.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:43 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:43.055+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:43.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:43 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:43.055+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:43.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:43 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:43.055+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:43.715 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:43.276+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:43.715 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:43.276+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:43.715 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:43.276+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:43.834 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:43 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:43.439+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.652344+0000 front 2024-09-11T00:14:00.652163+0000 (oldest deadline 2024-09-11T00:14:24.152170+0000) 2024-09-11T00:14:43.834 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:43 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:43.439+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.153989+0000 front 2024-09-11T00:14:11.153780+0000 (oldest deadline 2024-09-11T00:14:34.053910+0000) 2024-09-11T00:14:43.834 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:43 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5[48019]: 2024-09-11T00:14:43.439+0000 7fd68239c640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.755033+0000 front 2024-09-11T00:14:15.755076+0000 (oldest deadline 2024-09-11T00:14:41.055052+0000) 2024-09-11T00:14:44.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:43.713+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:44.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:43.713+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:44.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:43 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:43.713+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:44.110 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:44.003+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:44.110 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:44.003+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:44.110 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:44.003+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:44.110 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:43 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:43.832+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:44.111 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:43 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:43.832+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:44.111 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:43 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:43.832+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:44.300 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:44 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:44.274+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:44.300 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:44 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:44.274+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:44.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:44 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:44.043+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:44.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:44 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:44.043+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:44.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:44 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:44.043+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:44.414 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:44 smithi135 podman[72466]: 2024-09-11 00:14:44.109072079 +0000 UTC m=+5.474806811 container died 6f3233e09f7542686cebfb4c91412b5d011ac0e78ffd7aa051a4d8d36f135a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T00:14:44.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:44 smithi135 podman[72466]: 2024-09-11 00:14:44.520813703 +0000 UTC m=+5.886548436 container cleanup 6f3233e09f7542686cebfb4c91412b5d011ac0e78ffd7aa051a4d8d36f135a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T00:14:44.676 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:44 smithi135 bash[72466]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5 2024-09-11T00:14:44.697 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:44 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:44.271+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:44.697 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:44 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:44.271+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:44.697 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:44 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:44.271+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:45.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:44 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:44.695+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:45.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:44 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:44.695+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:45.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:44 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:44.695+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:45.090 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:44 smithi135 podman[72485]: 2024-09-11 00:14:44.772341248 +0000 UTC m=+0.663861220 container remove 6f3233e09f7542686cebfb4c91412b5d011ac0e78ffd7aa051a4d8d36f135a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:45.090 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:45 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:45.013+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:45.090 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:45 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:45.013+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:45.090 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:45 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:45.013+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:45.091 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:44.879+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:45.091 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:44.879+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:45.091 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:44 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:44.879+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:45.425 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:45 smithi135 podman[72583]: 2024-09-11 00:14:44.992583694 +0000 UTC m=+0.016509457 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:45.426 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:45 smithi135 podman[72583]: 2024-09-11 00:14:45.123231284 +0000 UTC m=+0.147157039 container create 87ed52b6b15871400713a1da4af7cd163a106d7c8856ad153cb42365b585a831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T00:14:45.426 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:45 smithi135 podman[72583]: 2024-09-11 00:14:45.334322766 +0000 UTC m=+0.358248523 container init 87ed52b6b15871400713a1da4af7cd163a106d7c8856ad153cb42365b585a831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T00:14:45.426 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:45 smithi135 podman[72583]: 2024-09-11 00:14:45.337745596 +0000 UTC m=+0.361671352 container start 87ed52b6b15871400713a1da4af7cd163a106d7c8856ad153cb42365b585a831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:45.542 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:45 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:45.273+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:45.543 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:45 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:45.273+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:45.543 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:45 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:45.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:45.543 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:45 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:45.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:45.543 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:45 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:45.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:45.698 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:45.313+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:45.698 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:45.313+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:45.698 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:45.313+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:45.853 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:45 smithi135 podman[72583]: 2024-09-11 00:14:45.442646218 +0000 UTC m=+0.466571976 container attach 87ed52b6b15871400713a1da4af7cd163a106d7c8856ad153cb42365b585a831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-11T00:14:45.853 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 11 00:14:45 smithi135 podman[72607]: 2024-09-11 00:14:45.563027319 +0000 UTC m=+0.017135324 container died 87ed52b6b15871400713a1da4af7cd163a106d7c8856ad153cb42365b585a831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:14:46.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:45.697+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:46.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:45.697+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:46.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:45 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:45.697+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:46.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:45 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:45.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:46.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:45 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:45.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:46.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:45 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:45.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:46.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:46.030+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:46.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:46.030+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:46.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:46.030+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:46.209 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T00:14:46.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:14:46.250 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T00:14:46.250 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T00:14:46.250 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.6 2024-09-11T00:14:46.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:46 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:46.273+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:46.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:46 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:46.273+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:46.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:46 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:46.109+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:46.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:46 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:46.109+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:46.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:46 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:46.109+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:46.575 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:46 smithi019 systemd[1]: Stopping Ceph osd.6 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:14:46.575 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:46.353+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:46.575 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:46.353+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:46.576 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:46.353+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:47.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:46.573+0000 7f3f2ddbf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:47.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:46.573+0000 7f3f2ddbf640 -1 osd.6 91 *** Got signal Terminated *** 2024-09-11T00:14:47.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:46.573+0000 7f3f2ddbf640 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:47.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:46.666+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:47.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:46.666+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:47.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:46 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:46.666+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:47.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:46.822+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:47.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:46.822+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:47.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:46.822+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:47.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:46.987+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:47.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:46.987+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:47.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:46 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:46.987+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:47.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:47 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:47.275+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:47.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:47 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:47.275+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:47.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:47 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:47.066+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:47.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:47 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:47.066+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:47.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:47 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:47.066+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:47.670 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:47.358+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:47.670 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:47.358+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:47.670 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:47.358+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:48.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:47.668+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:48.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:47.668+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:48.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:47.668+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:48.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:47 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:47.807+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:48.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:47 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:47.807+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:48.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:47 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:47.807+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:48.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:47 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:47.953+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:48.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:47 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:47.953+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:48.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:47 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:47.953+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:48.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:48 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:48.311+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:48.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:48 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:48.311+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:48.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:48 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:48.065+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:48.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:48 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:48.065+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:48.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:48 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:48.065+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:48.656 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:48.385+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:48.656 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:48.385+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:48.656 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:48.385+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:49.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:48.654+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:49.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:48.654+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:49.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:48.654+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:49.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:48 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:48.654+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:25.148877+0000 front 2024-09-11T00:14:25.148940+0000 (oldest deadline 2024-09-11T00:14:48.649036+0000) 2024-09-11T00:14:49.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:48 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:48.795+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:49.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:48 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:48.795+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:49.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:48 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:48.795+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:49.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:48 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:48.927+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:49.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:48 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:48.927+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:49.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:48 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:48.927+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:49.177 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:48 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:48.927+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:49.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:49 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:49.348+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:49.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:49 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:49.348+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:49.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:49 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:49.348+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:49.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:49 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:49.113+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:49.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:49 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:49.113+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:49.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:49 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:49.113+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:49.650 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:49 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:49.404+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:49.651 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:49 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:49.404+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:49.651 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:49 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:49.404+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:50.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:49 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:49.649+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:50.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:49 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:49.649+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:50.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:49 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:49.649+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:50.023 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:49 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:49.649+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:25.148877+0000 front 2024-09-11T00:14:25.148940+0000 (oldest deadline 2024-09-11T00:14:48.649036+0000) 2024-09-11T00:14:50.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:49 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:49.783+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:50.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:49 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:49.783+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:50.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:49 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:49.783+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:50.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:49 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:49.929+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:50.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:49 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:49.929+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:50.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:49 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:49.929+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:50.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:49 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:49.929+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:50.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:50.160+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:50.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:50.160+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:50.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:50.160+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:50.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:50.334+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:50.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:50.334+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:50.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:50.334+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:50.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:50 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:50.400+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:50.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:50 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:50.400+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:50.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:50 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:50.400+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:50.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:50 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:50.602+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:13:58.145018+0000 front 2024-09-11T00:13:58.145067+0000 (oldest deadline 2024-09-11T00:14:24.045279+0000) 2024-09-11T00:14:50.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:50 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:50.602+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:11.047082+0000 front 2024-09-11T00:14:11.047177+0000 (oldest deadline 2024-09-11T00:14:36.347153+0000) 2024-09-11T00:14:50.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:50 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:50.602+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.347703+0000 front 2024-09-11T00:14:16.347652+0000 (oldest deadline 2024-09-11T00:14:40.447714+0000) 2024-09-11T00:14:50.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:50 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6[61918]: 2024-09-11T00:14:50.602+0000 7f3f2a3d4640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:25.148877+0000 front 2024-09-11T00:14:25.148940+0000 (oldest deadline 2024-09-11T00:14:48.649036+0000) 2024-09-11T00:14:51.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:50 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:50.805+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:51.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:50 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:50.805+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:51.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:50 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:50.805+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:51.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:50 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:50.971+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:51.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:50 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:50.971+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:51.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:50 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:50.971+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:51.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:50 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:50.971+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:51.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:51 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:51.332+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:51.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:51 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:51.332+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:51.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:51 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:51.332+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:51.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:51 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:51.190+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:51.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:51 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:51.190+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:51.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:51 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:51.190+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:51.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:51 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:51.190+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:51.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:51 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:51.357+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:51.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:51 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:51.357+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:51.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:51 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:51.357+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:52.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:51.768+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:52.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:51.768+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:52.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:51.768+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:52.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:51.984+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:52.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:51.984+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:52.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:51.984+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:52.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:51 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:51.984+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:52.225 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:51 smithi019 podman[107931]: 2024-09-11 00:14:51.971998734 +0000 UTC m=+5.519501219 container died 819afec2ddc8ea19163483e8c8c970f740eb53869389b5e2f0bffd8be3769c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-11T00:14:52.522 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:52 smithi019 podman[107931]: 2024-09-11 00:14:52.423591486 +0000 UTC m=+5.971094016 container cleanup 819afec2ddc8ea19163483e8c8c970f740eb53869389b5e2f0bffd8be3769c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-11T00:14:52.523 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:52 smithi019 bash[107931]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6 2024-09-11T00:14:52.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:52 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:52.345+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:52.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:52 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:52.345+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:52.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:52 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:52.345+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:52.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:52 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:52.345+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:52.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:52.289+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:52.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:52.289+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:52.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:52.289+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:52.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:52.237+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:52.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:52.237+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:52.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:52.237+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:52.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:52 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:52.237+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:53.022 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:52 smithi019 podman[107961]: 2024-09-11 00:14:52.750062437 +0000 UTC m=+0.776102571 container remove 819afec2ddc8ea19163483e8c8c970f740eb53869389b5e2f0bffd8be3769c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T00:14:53.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:52 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:52.816+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:53.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:52 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:52.816+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:53.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:52 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:52.816+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:53.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:52 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:52.946+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:53.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:52 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:52.946+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:53.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:52 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:52.946+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:53.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:52 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:52.946+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:53.352 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:53 smithi019 podman[108046]: 2024-09-11 00:14:53.003435731 +0000 UTC m=+0.016473237 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:53.352 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:53 smithi019 podman[108046]: 2024-09-11 00:14:53.126099957 +0000 UTC m=+0.139137466 container create a4c3ae7a73c0d455c74d485df1b1aff9bd145e29a130b7d0fe743e87e1978792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:53.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:53 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:53.300+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:53.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:53 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:53.300+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:53.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:53 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:53.300+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:53.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:53 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:53.270+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:53.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:53 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:53.270+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:53.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:53 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:53.270+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:53.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:53 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:53.270+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:53.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:53.351+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:53.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:53.351+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:53.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:53.351+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:53.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:53 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:53.351+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:53.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:53 smithi019 podman[108046]: 2024-09-11 00:14:53.395628064 +0000 UTC m=+0.408665570 container init a4c3ae7a73c0d455c74d485df1b1aff9bd145e29a130b7d0fe743e87e1978792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-11T00:14:53.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:53 smithi019 podman[108046]: 2024-09-11 00:14:53.399060464 +0000 UTC m=+0.412097972 container start a4c3ae7a73c0d455c74d485df1b1aff9bd145e29a130b7d0fe743e87e1978792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T00:14:53.773 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:53 smithi019 podman[108046]: 2024-09-11 00:14:53.478683817 +0000 UTC m=+0.491721332 container attach a4c3ae7a73c0d455c74d485df1b1aff9bd145e29a130b7d0fe743e87e1978792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:14:53.774 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 11 00:14:53 smithi019 podman[108046]: 2024-09-11 00:14:53.591244837 +0000 UTC m=+0.604282344 container died a4c3ae7a73c0d455c74d485df1b1aff9bd145e29a130b7d0fe743e87e1978792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T00:14:54.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:53 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:53.772+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:54.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:53 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:53.772+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:54.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:53 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:53.772+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:54.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:53 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:53.949+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:54.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:53 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:53.949+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:54.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:53 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:53.949+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:54.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:53 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:53.949+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:54.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T00:14:54.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:14:54.274 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T00:14:54.274 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T00:14:54.274 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.7 2024-09-11T00:14:54.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:54.362+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:54.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:54.362+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:54.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:54.362+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:54.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:54 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:54.362+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:54.562 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:54.320+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:54.562 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:54.320+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:54.562 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:54.320+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:54.562 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:54.320+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:54.563 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:54.302+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:54.563 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:54.302+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:54.563 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:54.302+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:54.563 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:54 smithi131 systemd[1]: Stopping Ceph osd.7 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:14:54.563 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:54.559+0000 7f56c07bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:54.563 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:54.559+0000 7f56c07bb640 -1 osd.7 91 *** Got signal Terminated *** 2024-09-11T00:14:54.563 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:54.559+0000 7f56c07bb640 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:55.084 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:54 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:54.775+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:55.085 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:54 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:54.775+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:55.085 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:54 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:54.775+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:55.088 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:54 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:54.932+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:55.088 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:54 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:54.932+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:55.088 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:54 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:54.932+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:55.088 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:54 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:54.932+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:55.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:55 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:55.282+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:55.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:55 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:55.282+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:55.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:55 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:55.282+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:55.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:55 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:55.282+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:55.624 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:55 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:55.323+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:55.624 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:55 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:55.323+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:55.624 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:55 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:55.323+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:55.772 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:55 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:55.316+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:55.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:55 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:55.316+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:55.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:55 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:55.316+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:55.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:55 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:55.316+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:55.925 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:55 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:55.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:55.926 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:55 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:55.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:55.926 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:55 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:55.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:56.310 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:56 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:56.307+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:56.311 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:56 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:56.307+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:56.311 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:56 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:56.307+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:56.311 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:56 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:56.277+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:56.311 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:56 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:56.277+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:56.311 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:56 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:56.277+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:56.311 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:56 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:56.277+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:56.425 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:55 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:55.956+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:56.426 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:55 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:55.956+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:56.426 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:55 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:55.956+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:56.426 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:55 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:55.956+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:56.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:56 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:56.279+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:56.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:56 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:56.279+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:56.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:56 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:56.279+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:56.773 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:56 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:56.279+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:57.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:56 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:56.774+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:57.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:56 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:56.774+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:57.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:56 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:56.774+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:57.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:56 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:56.985+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:57.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:56 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:56.985+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:57.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:56 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:56.985+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:57.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:56 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:56.985+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:57.522 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:57 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:57.251+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:57.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:57 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:57.251+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:57.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:57 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:57.251+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:57.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:57 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:57.251+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:57.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:57.344+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:57.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:57.344+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:57.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:57.344+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:57.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:57.325+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:57.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:57.325+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:57.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:57.325+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:57.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:57.325+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:57.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:57 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:57.325+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:14:58.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:57 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:57.792+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:58.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:57 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:57.792+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:58.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:57 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:57.792+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:58.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:57 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:57.943+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:58.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:57 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:57.943+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:58.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:57 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:57.943+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:58.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:57 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:57.943+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:58.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:58 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:58.258+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:58.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:58 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:58.258+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:58.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:58 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:58.258+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:58.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:58 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:58.258+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:58.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:58.352+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:58.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:58.352+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:58.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:58.352+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:58.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:58.352+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.374640+0000 front 2024-09-11T00:14:35.374670+0000 (oldest deadline 2024-09-11T00:14:57.674766+0000) 2024-09-11T00:14:58.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:58.278+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:58.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:58.278+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:58.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:58.278+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:58.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:58.278+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:58.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:58 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:58.278+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:14:59.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:58 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:58.821+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:14:59.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:58 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:58.821+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:14:59.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:58 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:58.821+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:14:59.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:58 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:58.928+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:14:59.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:58 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:58.928+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:14:59.177 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:58 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:58.928+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:14:59.177 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:58 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:58.928+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:14:59.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:59 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:59.253+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:14:59.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:59 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:59.253+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:14:59.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:59 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:59.253+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:14:59.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:59 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:59.253+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:14:59.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:14:59 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:14:59.253+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:14:59.550 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:59.383+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:08.371681+0000 front 2024-09-11T00:14:08.371754+0000 (oldest deadline 2024-09-11T00:14:33.671881+0000) 2024-09-11T00:14:59.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:59.383+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:17.172890+0000 front 2024-09-11T00:14:17.172876+0000 (oldest deadline 2024-09-11T00:14:43.072862+0000) 2024-09-11T00:14:59.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:59.383+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:23.073458+0000 front 2024-09-11T00:14:23.073292+0000 (oldest deadline 2024-09-11T00:14:48.373381+0000) 2024-09-11T00:14:59.551 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7[54382]: 2024-09-11T00:14:59.383+0000 7f56b8dc8640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.374640+0000 front 2024-09-11T00:14:35.374670+0000 (oldest deadline 2024-09-11T00:14:57.674766+0000) 2024-09-11T00:14:59.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:59.295+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:14:59.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:59.295+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:14:59.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:59.295+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:14:59.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:59.295+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:14:59.552 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:14:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:14:59.295+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:00.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:59.947+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:00.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:59.947+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:00.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:59.947+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:00.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:14:59.947+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:00.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:59.870+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:00.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:59.870+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:00.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:59.870+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:00.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:14:59 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:14:59.870+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:00.301 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:00 smithi131 podman[71368]: 2024-09-11 00:15:00.013074671 +0000 UTC m=+5.543020539 container died 95698f9b14765889d8efa9495803051f893234bd327861f5bdc63751e05d7f1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:00.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:00 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:00.245+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:00.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:00 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:00.245+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:00.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:00 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:00.245+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:00.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:00 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:00.245+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:00.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:00 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:00.245+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:00.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:00.210+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:00.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:00.211+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:00.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:00.211+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:00.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:00.211+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:00.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:00 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:00.211+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:00.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:00 smithi131 podman[71368]: 2024-09-11 00:15:00.360172958 +0000 UTC m=+5.890118827 container cleanup 95698f9b14765889d8efa9495803051f893234bd327861f5bdc63751e05d7f1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:15:00.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:00 smithi131 bash[71368]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7 2024-09-11T00:15:00.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:00 smithi131 podman[71382]: 2024-09-11 00:15:00.586548988 +0000 UTC m=+0.567059511 container remove 95698f9b14765889d8efa9495803051f893234bd327861f5bdc63751e05d7f1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T00:15:01.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:00.948+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:01.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:00.948+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:01.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:00.948+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:01.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:00.948+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:01.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:00.911+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:01.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:00.911+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:01.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:00.911+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:01.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:00 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:00.911+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:01.300 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:01 smithi131 podman[71471]: 2024-09-11 00:15:00.924268778 +0000 UTC m=+0.015774004 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:01.300 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:01 smithi131 podman[71471]: 2024-09-11 00:15:01.062411326 +0000 UTC m=+0.153916568 container create abb7713cc6f30406e8670ee9e8af72da860d1f108502e7fd3b5af19f8a8906f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T00:15:01.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:01 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:01.219+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:01.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:01 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:01.219+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:01.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:01 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:01.219+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:01.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:01 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:01.219+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:01.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:01 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:01.219+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:01.522 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:01 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:01.174+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:01.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:01 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:01.174+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:01.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:01 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:01.174+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:01.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:01 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:01.174+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:01.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:01 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:01.174+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:01.800 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:01 smithi131 podman[71471]: 2024-09-11 00:15:01.331412614 +0000 UTC m=+0.422917817 container init abb7713cc6f30406e8670ee9e8af72da860d1f108502e7fd3b5af19f8a8906f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-11T00:15:01.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:01 smithi131 podman[71471]: 2024-09-11 00:15:01.334781381 +0000 UTC m=+0.426286585 container start abb7713cc6f30406e8670ee9e8af72da860d1f108502e7fd3b5af19f8a8906f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:15:01.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:01 smithi131 podman[71471]: 2024-09-11 00:15:01.423022001 +0000 UTC m=+0.514527216 container attach abb7713cc6f30406e8670ee9e8af72da860d1f108502e7fd3b5af19f8a8906f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T00:15:01.801 INFO:journalctl@ceph.osd.7.smithi131.stdout:Sep 11 00:15:01 smithi131 podman[71471]: 2024-09-11 00:15:01.529127599 +0000 UTC m=+0.620632803 container died abb7713cc6f30406e8670ee9e8af72da860d1f108502e7fd3b5af19f8a8906f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:15:02.167 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T00:15:02.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:01.909+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:02.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:01.909+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:02.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:01.909+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:02.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:01.909+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:02.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:01.871+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:02.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:01.871+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:02.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:01.871+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:02.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:01 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:01.871+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:02.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:02.206 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T00:15:02.206 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T00:15:02.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.8 2024-09-11T00:15:02.413 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:02 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:02.198+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:02.413 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:02 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:02.198+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:02.413 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:02 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:02.198+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:02.413 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:02 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:02.198+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:02.413 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:02 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:02.198+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:02.522 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:02 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:02.209+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:02.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:02 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:02.209+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:02.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:02 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:02.209+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:02.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:02 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:02.209+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:02.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:02 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:02.209+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:02.525 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 systemd[1]: Stopping Ceph osd.8 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:02.850 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:02.523+0000 7f9e9d4e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:02.851 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:02.523+0000 7f9e9d4e6640 -1 osd.8 91 *** Got signal Terminated *** 2024-09-11T00:15:02.851 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:02.523+0000 7f9e9d4e6640 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:15:03.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:02.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:03.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:02.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:03.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:02.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:03.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:02.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:03.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:02.849+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:03.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:02.849+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:03.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:02.849+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:03.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:02 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:02.849+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:03.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:03 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:03.210+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:03.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:03 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:03.210+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:03.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:03 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:03.210+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:03.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:03 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:03.210+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:03.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:03 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:03.210+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:03.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:03 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:03.173+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:03.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:03 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:03.173+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:03.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:03 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:03.173+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:03.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:03 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:03.173+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:03.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:03 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:03.173+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:04.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:03.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:04.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:03.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:04.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:03.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:04.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:03.923+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:04.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:03.826+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:04.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:03.826+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:04.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:03.826+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:04.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:03 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:03.826+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:04.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:04 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:04.201+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:04.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:04 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:04.201+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:04.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:04 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:04.201+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:04.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:04 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:04.201+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:04.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:04 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:04.201+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:04.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:04 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:04.191+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:04.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:04 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:04.191+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:04.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:04 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:04.191+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:04.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:04 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:04.191+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:04.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:04 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:04.191+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:05.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:04.951+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:04.951+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:04.951+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:04.951+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:04.813+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:04.813+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:04.813+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:04.813+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:05.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:04 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:04.813+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:05.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:05 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:05.175+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:05.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:05 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:05.175+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:05.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:05 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:05.175+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:05.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:05 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:05.175+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:05.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:05 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:05.175+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:05.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:05 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:05.150+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:05.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:05 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:05.150+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:05.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:05 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:05.150+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:05.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:05 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:05.150+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:05.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:05 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:05.150+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:05.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:05 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:05.150+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:06.175 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:05.906+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:05.906+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:05.906+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:05.906+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:05.906+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.102376+0000 front 2024-09-11T00:14:41.102400+0000 (oldest deadline 2024-09-11T00:15:05.802517+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:05.828+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:05.828+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:05.828+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:05.828+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:06.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:05 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:05.828+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:06.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:06 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:06.142+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:06.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:06 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:06.142+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:06.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:06 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:06.142+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:06.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:06 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:06.142+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:06.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:06 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:06.142+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:06.524 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:06 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:06.142+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:06.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:06.108+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:06.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:06.108+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:06.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:06.108+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:06.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:06.108+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:06.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:06.108+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:06.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:06 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:06.108+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:07.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:06.886+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.697718+0000 front 2024-09-11T00:14:00.697692+0000 (oldest deadline 2024-09-11T00:14:25.397643+0000) 2024-09-11T00:15:07.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:06.886+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:10.698859+0000 front 2024-09-11T00:14:10.699024+0000 (oldest deadline 2024-09-11T00:14:36.598599+0000) 2024-09-11T00:15:07.176 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:06.886+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.598926+0000 front 2024-09-11T00:14:16.598948+0000 (oldest deadline 2024-09-11T00:14:42.499086+0000) 2024-09-11T00:15:07.177 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:06.886+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.800162+0000 front 2024-09-11T00:14:24.800074+0000 (oldest deadline 2024-09-11T00:14:48.299959+0000) 2024-09-11T00:15:07.177 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8[54947]: 2024-09-11T00:15:06.886+0000 7f9e99afb640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.102376+0000 front 2024-09-11T00:14:41.102400+0000 (oldest deadline 2024-09-11T00:15:05.802517+0000) 2024-09-11T00:15:07.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:06.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:07.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:06.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:07.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:06.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:07.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:06.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:07.178 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:06.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:07.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:07.115+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:07.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:07.115+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:07.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:07.115+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:07.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:07.115+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:07.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:07.115+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:07.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:07 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:07.115+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:07.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:07 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:07.081+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:07.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:07 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:07.081+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:07.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:07 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:07.081+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:07.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:07 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:07.081+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:07.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:07 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:07.081+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:07.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:07 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:07.081+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:08.088 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:07 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:07.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:08.088 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:07 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:07.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:08.088 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:07 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:07.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:08.088 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:07 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:07.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:08.088 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:07 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:07.808+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:08.376 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:08 smithi135 podman[72687]: 2024-09-11 00:15:08.086365861 +0000 UTC m=+5.684650803 container died 9e13dbb461a6d90b02ba7811d15808037963bca8dc92669a7e9cf903447702e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:08.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:08 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:08.136+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:08.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:08 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:08.137+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:08.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:08 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:08.137+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:08.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:08 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:08.137+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:08.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:08 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:08.137+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:08.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:08 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:08.137+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:08.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:08 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:08.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:08.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:08 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:08.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:08.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:08 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:08.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:08.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:08 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:08.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:08.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:08 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:08.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:08.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:08 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:08.068+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:08.675 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:08 smithi135 podman[72687]: 2024-09-11 00:15:08.473737887 +0000 UTC m=+6.072022832 container cleanup 9e13dbb461a6d90b02ba7811d15808037963bca8dc92669a7e9cf903447702e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:15:08.676 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:08 smithi135 bash[72687]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8 2024-09-11T00:15:09.042 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:08 smithi135 podman[72703]: 2024-09-11 00:15:08.725212435 +0000 UTC m=+0.637396539 container remove 9e13dbb461a6d90b02ba7811d15808037963bca8dc92669a7e9cf903447702e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-11T00:15:09.042 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:08 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:08.767+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:09.042 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:08 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:08.767+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:09.043 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:08 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:08.767+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:09.043 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:08 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:08.767+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:09.043 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:08 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:08.767+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:09.304 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:09 smithi135 podman[72795]: 2024-09-11 00:15:08.944562986 +0000 UTC m=+0.016358660 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:09.304 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:09 smithi135 podman[72795]: 2024-09-11 00:15:09.059308334 +0000 UTC m=+0.131103999 container create c1617980fa7584793962faafe1e8d011ea3fd0946ab6095a397f9d07575506a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:09.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:09.186+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:09.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:09.186+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:09.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:09.186+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:09.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:09.186+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:09.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:09.186+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:09.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:09 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:09.186+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:09.550 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:09 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:09.051+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:09.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:09 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:09.051+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:09.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:09 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:09.051+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:09.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:09 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:09.051+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:09.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:09 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:09.051+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:09.551 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:09 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:09.051+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:09.676 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:09 smithi135 podman[72795]: 2024-09-11 00:15:09.303328083 +0000 UTC m=+0.375123750 container init c1617980fa7584793962faafe1e8d011ea3fd0946ab6095a397f9d07575506a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T00:15:09.676 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:09 smithi135 podman[72795]: 2024-09-11 00:15:09.306788545 +0000 UTC m=+0.378584217 container start c1617980fa7584793962faafe1e8d011ea3fd0946ab6095a397f9d07575506a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:15:09.676 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:09 smithi135 podman[72795]: 2024-09-11 00:15:09.420094009 +0000 UTC m=+0.491889686 container attach c1617980fa7584793962faafe1e8d011ea3fd0946ab6095a397f9d07575506a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T00:15:09.676 INFO:journalctl@ceph.osd.8.smithi135.stdout:Sep 11 00:15:09 smithi135 podman[72795]: 2024-09-11 00:15:09.499748682 +0000 UTC m=+0.571544355 container died c1617980fa7584793962faafe1e8d011ea3fd0946ab6095a397f9d07575506a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T00:15:10.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:09 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:09.737+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:10.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:09 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:09.737+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:10.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:09 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:09.737+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:10.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:09 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:09.737+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:10.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:09 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:09.737+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:10.222 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T00:15:10.264 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:10.265 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T00:15:10.265 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T00:15:10.265 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.9 2024-09-11T00:15:10.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.031+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:10.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.031+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:10.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.031+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:10.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.031+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:10.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.031+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:10.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.031+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:10.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.176+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:10.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.176+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:10.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.176+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:10.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.176+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:10.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.176+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:10.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.176+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:10.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 systemd[1]: Stopping Ceph osd.9 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:10.925 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:10 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:10.698+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:10.926 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:10 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:10.698+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:10.926 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:10 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:10.698+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:10.926 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:10 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:10.698+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:10.926 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:10 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:10.699+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:11.022 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.567+0000 7f0cdbf7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:11.023 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.567+0000 7f0cdbf7d640 -1 osd.9 91 *** Got signal Terminated *** 2024-09-11T00:15:11.023 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:10 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:10.567+0000 7f0cdbf7d640 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:15:11.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.992+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:11.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.992+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:11.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.992+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:11.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.992+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:11.304 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.992+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:11.304 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:10 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:10.992+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:11.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:11 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:11.188+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:11.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:11 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:11.188+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:11.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:11 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:11.188+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:11.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:11 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:11.188+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:11.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:11 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:11.188+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:11.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:11 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:11.189+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:12.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:11 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:11.694+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:12.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:11 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:11.694+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:12.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:11 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:11.694+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:12.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:11 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:11.694+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:12.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:11 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:11.694+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:12.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:11 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:11.960+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:12.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:11 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:11.960+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:12.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:11 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:11.960+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:12.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:11 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:11.960+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:12.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:11 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:11.960+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:12.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:11 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:11.960+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:12.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:12 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:12.225+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:12.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:12 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:12.225+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:12.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:12 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:12.225+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:12.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:12 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:12.225+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:12.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:12 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:12.225+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:12.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:12 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:12.225+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:13.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:12 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:12.731+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:13.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:12 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:12.731+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:13.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:12 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:12.731+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:13.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:12 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:12.731+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:13.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:12 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:12.731+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:13.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:12 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:12.920+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:13.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:12 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:12.920+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:13.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:12 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:12.920+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:13.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:12 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:12.920+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:13.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:12 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:12.920+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:13.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:12 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:12.920+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:13.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:13 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:13.182+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:13.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:13 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:13.182+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:13.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:13 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:13.182+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:13.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:13 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:13.182+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:13.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:13 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:13.182+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:13.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:13 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:13.182+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:14.077 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:13 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:13.762+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:14.077 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:13 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:13.762+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:14.077 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:13 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:13.762+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:14.077 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:13 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:13.762+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:14.077 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:13 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:13.762+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:14.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:13 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:13.891+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:14.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:13 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:13.891+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:14.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:13 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:13.891+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:14.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:13 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:13.891+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:14.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:13 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:13.891+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:14.302 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:13 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:13.891+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:14.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:14 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:14.195+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:14.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:14 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:14.195+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:14.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:14 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:14.195+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:14.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:14 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:14.195+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:14.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:14 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:14.195+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:14.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:14 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:14.195+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:15.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:14.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:15.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:14.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:15.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:14.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:15.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:14.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:15.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:14.801+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:15.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:14 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:14.862+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:15.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:14 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:14.862+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:15.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:14 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:14.862+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:15.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:14 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:14.862+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:15.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:14 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:14.862+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:15.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:14 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:14.862+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:15.522 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:15 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:15.221+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.593536+0000 front 2024-09-11T00:14:00.593680+0000 (oldest deadline 2024-09-11T00:14:25.893712+0000) 2024-09-11T00:15:15.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:15 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:15.221+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.395143+0000 front 2024-09-11T00:14:09.395103+0000 (oldest deadline 2024-09-11T00:14:33.495085+0000) 2024-09-11T00:15:15.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:15 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:15.221+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:18.697013+0000 front 2024-09-11T00:14:18.696939+0000 (oldest deadline 2024-09-11T00:14:40.297183+0000) 2024-09-11T00:15:15.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:15 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:15.221+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:27.298448+0000 front 2024-09-11T00:14:27.298480+0000 (oldest deadline 2024-09-11T00:14:51.998562+0000) 2024-09-11T00:15:15.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:15 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:15.221+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:34.200031+0000 front 2024-09-11T00:14:34.200188+0000 (oldest deadline 2024-09-11T00:14:58.899970+0000) 2024-09-11T00:15:15.523 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:15 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9[68848]: 2024-09-11T00:15:15.221+0000 7f0cd8592640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:41.200981+0000 front 2024-09-11T00:14:41.200880+0000 (oldest deadline 2024-09-11T00:15:05.900795+0000) 2024-09-11T00:15:16.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:15 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:15.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:16.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:15 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:15.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:16.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:15 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:15.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:16.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:15 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:15.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:16.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:15 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:15.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:16.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:15 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:15.875+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:16.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:15 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:15.875+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:16.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:15 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:15.875+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:16.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:15 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:15.875+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:16.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:15 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:15.875+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:16.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:15 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:15.875+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:16.502 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:16 smithi019 podman[108150]: 2024-09-11 00:15:16.087508281 +0000 UTC m=+5.622450116 container died e89b85cbf15b85393b1db328c7d37b5b6ea768a3161939539610d434681802fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T00:15:16.502 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:16 smithi019 podman[108150]: 2024-09-11 00:15:16.500946381 +0000 UTC m=+6.035888213 container cleanup e89b85cbf15b85393b1db328c7d37b5b6ea768a3161939539610d434681802fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:16.772 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:16 smithi019 bash[108150]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9 2024-09-11T00:15:17.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:16 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:16.900+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:17.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:16 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:16.900+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:17.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:16 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:16.900+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:17.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:16 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:16.900+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:17.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:16 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:16.900+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:17.185 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:16 smithi019 podman[108165]: 2024-09-11 00:15:16.844026204 +0000 UTC m=+0.750483539 container remove e89b85cbf15b85393b1db328c7d37b5b6ea768a3161939539610d434681802fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:17.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:16.840+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:17.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:16.840+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:17.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:16.840+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:17.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:16.840+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:17.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:16.840+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:17.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:16.840+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:17.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:16 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:16.840+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:17.506 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:17 smithi019 podman[108254]: 2024-09-11 00:15:17.087678519 +0000 UTC m=+0.016033698 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:17.506 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:17 smithi019 podman[108254]: 2024-09-11 00:15:17.211244029 +0000 UTC m=+0.139599251 container create bf36ef8c6b0a5d20b41fb4c73f7a08879fbc4cc9b6cc095ec2aa11a1c0f8f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T00:15:17.506 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:17 smithi019 podman[108254]: 2024-09-11 00:15:17.421873507 +0000 UTC m=+0.350228684 container init bf36ef8c6b0a5d20b41fb4c73f7a08879fbc4cc9b6cc095ec2aa11a1c0f8f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:15:17.506 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:17 smithi019 podman[108254]: 2024-09-11 00:15:17.425388337 +0000 UTC m=+0.353743522 container start bf36ef8c6b0a5d20b41fb4c73f7a08879fbc4cc9b6cc095ec2aa11a1c0f8f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:15:17.506 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:17 smithi019 podman[108254]: 2024-09-11 00:15:17.505166225 +0000 UTC m=+0.433521409 container attach bf36ef8c6b0a5d20b41fb4c73f7a08879fbc4cc9b6cc095ec2aa11a1c0f8f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:17.772 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 11 00:15:17 smithi019 podman[108254]: 2024-09-11 00:15:17.620816451 +0000 UTC m=+0.549171637 container died bf36ef8c6b0a5d20b41fb4c73f7a08879fbc4cc9b6cc095ec2aa11a1c0f8f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T00:15:18.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:17 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:17.830+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:18.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:17 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:17.830+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:18.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:17 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:17.830+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:18.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:17 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:17.830+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:18.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:17 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:17.830+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:18.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:17 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:17.830+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:18.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:17 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:17.830+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:18.425 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:17 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:17.941+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:18.425 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:17 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:17.941+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:18.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:17 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:17.941+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:18.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:17 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:17.941+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:18.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:17 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:17.941+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:18.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:17 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:17.941+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:18.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T00:15:18.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:18.614 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T00:15:18.614 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T00:15:18.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.10 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 systemd[1]: Stopping Ceph osd.10 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.816+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.816+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.816+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.816+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.816+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.816+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:18.931 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.816+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:19.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.929+0000 7f4860f47640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:19.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.929+0000 7f4860f47640 -1 osd.10 91 *** Got signal Terminated *** 2024-09-11T00:15:19.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:18 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:18.929+0000 7f4860f47640 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:15:19.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:18.989+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:19.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:18.989+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:19.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:18.989+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:19.426 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:18.989+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:19.427 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:18.989+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:19.427 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:18.989+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:19.952 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:19 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:19.948+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:19.952 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:19 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:19.948+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:19.952 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:19 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:19.948+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:19.952 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:19 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:19.948+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:19.952 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:19 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:19.948+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:19.952 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:19 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:19.948+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:20.050 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:19 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:19.774+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:20.051 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:19 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:19.774+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:20.051 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:19 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:19.774+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:20.051 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:19 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:19.774+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:20.051 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:19 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:19.774+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:20.051 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:19 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:19.774+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:20.051 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:19 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:19.774+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:21.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:20 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:20.906+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:21.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:20 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:20.906+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:21.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:20 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:20.906+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:21.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:20 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:20.906+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:21.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:20 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:20.906+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:21.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:20 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:20.906+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:21.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:20 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:20.906+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:21.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:20.820+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:21.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:20.820+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:21.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:20.820+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:21.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:20.820+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:21.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:20.820+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:21.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:20.820+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:21.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:20 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:20.820+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:22.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:21 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:21.908+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:22.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:21 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:21.908+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:22.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:21 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:21.908+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:22.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:21 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:21.908+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:22.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:21 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:21.908+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:22.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:21 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:21.908+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:22.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:21 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:21.908+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:22.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:21 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:21.851+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:22.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:21 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:21.851+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:22.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:21 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:21.851+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:22.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:21 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:21.851+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:22.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:21 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:21.851+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:22.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:21 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:21.851+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:22.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:21 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:21.851+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:23.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:22 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:22.902+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:23.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:22 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:22.902+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:23.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:22 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:22.902+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:23.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:22 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:22.902+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:23.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:22 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:22.902+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:23.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:22 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:22.902+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:23.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:22 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:22.902+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:23.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:22 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:22.812+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:23.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:22 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:22.812+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:23.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:22 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:22.812+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:23.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:22 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:22.812+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:23.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:22 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:22.812+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:23.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:22 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:22.812+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:23.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:22 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:22.812+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:24.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:23 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:23.892+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:24.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:23 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:23.892+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:24.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:23 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:23.892+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:24.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:23 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:23.892+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:24.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:23 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:23.892+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:24.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:23 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:23.892+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:24.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:23 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:23.892+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:24.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:23 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:23.849+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:01.393332+0000 front 2024-09-11T00:14:01.393273+0000 (oldest deadline 2024-09-11T00:14:27.293455+0000) 2024-09-11T00:15:24.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:23 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:23.849+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:07.293842+0000 front 2024-09-11T00:14:07.293864+0000 (oldest deadline 2024-09-11T00:14:31.993946+0000) 2024-09-11T00:15:24.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:23 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:23.849+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:16.595237+0000 front 2024-09-11T00:14:16.595385+0000 (oldest deadline 2024-09-11T00:14:40.095130+0000) 2024-09-11T00:15:24.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:23 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:23.849+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-11T00:14:24.696980+0000 front 2024-09-11T00:14:24.696953+0000 (oldest deadline 2024-09-11T00:14:50.596777+0000) 2024-09-11T00:15:24.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:23 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:23.849+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:31.697619+0000 front 2024-09-11T00:14:31.697638+0000 (oldest deadline 2024-09-11T00:14:56.997678+0000) 2024-09-11T00:15:24.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:23 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:23.849+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:40.498739+0000 front 2024-09-11T00:14:40.498888+0000 (oldest deadline 2024-09-11T00:15:04.598597+0000) 2024-09-11T00:15:24.301 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:23 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10[61221]: 2024-09-11T00:15:23.849+0000 7f485d55c640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:50.900261+0000 front 2024-09-11T00:14:50.900271+0000 (oldest deadline 2024-09-11T00:15:16.799993+0000) 2024-09-11T00:15:24.654 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:24 smithi131 podman[71597]: 2024-09-11 00:15:24.365051283 +0000 UTC m=+5.553158023 container died fb8b735c1bed762582fd9df28051d446990e3a0b530b7f2658b43194b5aab51d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:15:24.655 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:24 smithi131 podman[71597]: 2024-09-11 00:15:24.653851336 +0000 UTC m=+5.841958072 container cleanup fb8b735c1bed762582fd9df28051d446990e3a0b530b7f2658b43194b5aab51d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:25.039 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:24 smithi131 bash[71597]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10 2024-09-11T00:15:25.039 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:24 smithi131 podman[71613]: 2024-09-11 00:15:24.854860409 +0000 UTC m=+0.487438247 container remove fb8b735c1bed762582fd9df28051d446990e3a0b530b7f2658b43194b5aab51d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T00:15:25.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:24.843+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:25.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:24.843+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:25.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:24.843+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:25.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:24.843+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:25.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:24.843+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:25.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:24.843+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:25.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:24 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:24.843+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:25.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:25 smithi131 podman[71702]: 2024-09-11 00:15:25.066444298 +0000 UTC m=+0.015731223 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:25.300 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:25 smithi131 podman[71702]: 2024-09-11 00:15:25.164099374 +0000 UTC m=+0.113386293 container create 4f82e7bbaf46c51c695711096d73cd0c2b5469cabb38f8f7d4d35f6a391db91d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:15:25.800 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:25 smithi131 podman[71702]: 2024-09-11 00:15:25.408195843 +0000 UTC m=+0.357482769 container init 4f82e7bbaf46c51c695711096d73cd0c2b5469cabb38f8f7d4d35f6a391db91d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:15:25.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:25 smithi131 podman[71702]: 2024-09-11 00:15:25.411426455 +0000 UTC m=+0.360713389 container start 4f82e7bbaf46c51c695711096d73cd0c2b5469cabb38f8f7d4d35f6a391db91d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T00:15:25.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:25 smithi131 podman[71702]: 2024-09-11 00:15:25.491300925 +0000 UTC m=+0.440587864 container attach 4f82e7bbaf46c51c695711096d73cd0c2b5469cabb38f8f7d4d35f6a391db91d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:15:25.801 INFO:journalctl@ceph.osd.10.smithi131.stdout:Sep 11 00:15:25 smithi131 podman[71702]: 2024-09-11 00:15:25.612009926 +0000 UTC m=+0.561296855 container died 4f82e7bbaf46c51c695711096d73cd0c2b5469cabb38f8f7d4d35f6a391db91d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T00:15:26.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:25.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:26.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:25.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:26.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:25.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:26.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:25.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:26.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:25.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:26.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:25.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:26.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:25 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:25.851+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:26.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T00:15:26.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:26.270 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T00:15:26.270 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T00:15:26.271 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.11 2024-09-11T00:15:26.586 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 systemd[1]: Stopping Ceph osd.11 for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:26.885 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.584+0000 7f9603f6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:26.885 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.584+0000 7f9603f6d640 -1 osd.11 91 *** Got signal Terminated *** 2024-09-11T00:15:26.885 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.584+0000 7f9603f6d640 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:15:27.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.883+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:27.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.883+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:27.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.883+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:27.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.883+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:27.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.883+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:27.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.883+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:27.177 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:26 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:26.883+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:28.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:27.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:28.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:27.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:28.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:27.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:28.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:27.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:28.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:27.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:28.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:27.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:28.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:27 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:27.850+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:29.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:28.877+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:29.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:28.877+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:29.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:28.877+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:29.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:28.877+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:29.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:28.877+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:29.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:28.877+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:29.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:28 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:28.877+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:30.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:29 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:29.842+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6820 osd.8 since back 2024-09-11T00:15:03.434448+0000 front 2024-09-11T00:15:03.434481+0000 (oldest deadline 2024-09-11T00:15:29.234885+0000) 2024-09-11T00:15:31.175 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-11T00:14:00.023685+0000 front 2024-09-11T00:14:00.023648+0000 (oldest deadline 2024-09-11T00:14:24.024329+0000) 2024-09-11T00:15:31.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2024-09-11T00:14:09.925693+0000 front 2024-09-11T00:14:09.925478+0000 (oldest deadline 2024-09-11T00:14:35.825484+0000) 2024-09-11T00:15:31.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-09-11T00:14:15.826093+0000 front 2024-09-11T00:14:15.826136+0000 (oldest deadline 2024-09-11T00:14:40.526121+0000) 2024-09-11T00:15:31.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2024-09-11T00:14:35.729342+0000 front 2024-09-11T00:14:35.729370+0000 (oldest deadline 2024-09-11T00:14:59.229517+0000) 2024-09-11T00:15:31.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-09-11T00:14:43.131432+0000 front 2024-09-11T00:14:43.131501+0000 (oldest deadline 2024-09-11T00:15:04.231584+0000) 2024-09-11T00:15:31.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-11T00:14:48.332488+0000 front 2024-09-11T00:14:48.332475+0000 (oldest deadline 2024-09-11T00:15:17.733034+0000) 2024-09-11T00:15:31.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2024-09-11T00:14:59.433986+0000 front 2024-09-11T00:14:59.433956+0000 (oldest deadline 2024-09-11T00:15:20.533750+0000) 2024-09-11T00:15:31.176 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:30 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11[61614]: 2024-09-11T00:15:30.853+0000 7f95fc57a640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.135:6820 osd.8 since back 2024-09-11T00:15:03.434448+0000 front 2024-09-11T00:15:03.434481+0000 (oldest deadline 2024-09-11T00:15:29.234885+0000) 2024-09-11T00:15:32.252 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:31 smithi135 podman[72909]: 2024-09-11 00:15:31.98156093 +0000 UTC m=+5.513356840 container died f7f5bd424d868e4db1a2c21651a319cf87cbfaa763e371ef77d576514c5652b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T00:15:32.603 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:32 smithi135 podman[72909]: 2024-09-11 00:15:32.334030957 +0000 UTC m=+5.865826855 container cleanup f7f5bd424d868e4db1a2c21651a319cf87cbfaa763e371ef77d576514c5652b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:15:32.603 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:32 smithi135 bash[72909]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11 2024-09-11T00:15:32.925 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:32 smithi135 podman[72925]: 2024-09-11 00:15:32.601986 +0000 UTC m=+0.615856475 container remove f7f5bd424d868e4db1a2c21651a319cf87cbfaa763e371ef77d576514c5652b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:15:33.281 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:32 smithi135 podman[73012]: 2024-09-11 00:15:32.85422561 +0000 UTC m=+0.015939056 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:33.281 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:32 smithi135 podman[73012]: 2024-09-11 00:15:32.961175717 +0000 UTC m=+0.122889193 container create 52cea134e4ff1803920ac86c6df73c5cdbfba7bfdaee0da44b9f8c4b85689e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:33.281 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:33 smithi135 podman[73012]: 2024-09-11 00:15:33.171510999 +0000 UTC m=+0.333224439 container init 52cea134e4ff1803920ac86c6df73c5cdbfba7bfdaee0da44b9f8c4b85689e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T00:15:33.281 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:33 smithi135 podman[73012]: 2024-09-11 00:15:33.174798884 +0000 UTC m=+0.336512316 container start 52cea134e4ff1803920ac86c6df73c5cdbfba7bfdaee0da44b9f8c4b85689e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T00:15:33.281 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:33 smithi135 podman[73012]: 2024-09-11 00:15:33.279828493 +0000 UTC m=+0.441541935 container attach 52cea134e4ff1803920ac86c6df73c5cdbfba7bfdaee0da44b9f8c4b85689e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:15:33.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Sep 11 00:15:33 smithi135 podman[73012]: 2024-09-11 00:15:33.359808204 +0000 UTC m=+0.521521636 container died 52cea134e4ff1803920ac86c6df73c5cdbfba7bfdaee0da44b9f8c4b85689e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-11T00:15:33.927 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T00:15:33.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:33.964 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T00:15:33.965 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T00:15:33.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.a 2024-09-11T00:15:34.272 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:15:34 smithi019 systemd[1]: Stopping Ceph mds.a for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:35.023 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:15:34 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-a[75990]: 2024-09-11T00:15:34.544+0000 7fac17bf1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:35.023 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:15:34 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-a[75990]: 2024-09-11T00:15:34.544+0000 7fac17bf1640 -1 mds.a *** got signal Terminated *** 2024-09-11T00:15:37.429 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:15:37 smithi019 podman[108368]: 2024-09-11 00:15:37.060336251 +0000 UTC m=+2.892589226 container died 448943214c3900833c389d337bbdd82379f60189a395b9302faaa98101258a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T00:15:37.773 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:15:37 smithi019 podman[108368]: 2024-09-11 00:15:37.519384675 +0000 UTC m=+3.351637648 container cleanup 448943214c3900833c389d337bbdd82379f60189a395b9302faaa98101258a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T00:15:37.773 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 11 00:15:37 smithi019 bash[108368]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-a 2024-09-11T00:15:37.953 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T00:15:37.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:37.989 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T00:15:37.989 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T00:15:37.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.d 2024-09-11T00:15:38.416 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 11 00:15:38 smithi019 systemd[1]: Stopping Ceph mds.d for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:38.772 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 11 00:15:38 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d[74688]: 2024-09-11T00:15:38.413+0000 7f44af64c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:38.773 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 11 00:15:38 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d[74688]: 2024-09-11T00:15:38.413+0000 7f44af64c640 -1 mds.d *** got signal Terminated *** 2024-09-11T00:15:40.783 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 11 00:15:40 smithi019 podman[108489]: 2024-09-11 00:15:40.523170394 +0000 UTC m=+2.314493825 container died df7d129f4f45465c3fcdbb91ffd2102bde49e57a688e78a58f24318be333c480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:15:41.184 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 11 00:15:40 smithi019 podman[108489]: 2024-09-11 00:15:40.856570507 +0000 UTC m=+2.647893979 container cleanup df7d129f4f45465c3fcdbb91ffd2102bde49e57a688e78a58f24318be333c480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T00:15:41.184 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 11 00:15:40 smithi019 bash[108489]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d 2024-09-11T00:15:41.441 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 11 00:15:41 smithi019 podman[108500]: 2024-09-11 00:15:41.18260739 +0000 UTC m=+0.661057213 container remove df7d129f4f45465c3fcdbb91ffd2102bde49e57a688e78a58f24318be333c480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:15:41.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T00:15:41.476 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:41.477 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T00:15:41.477 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T00:15:41.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.g 2024-09-11T00:15:41.773 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:15:41 smithi019 systemd[1]: Stopping Ceph mds.g for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:42.272 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:15:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g[75571]: 2024-09-11T00:15:41.966+0000 7f700c64d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:42.272 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:15:41 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g[75571]: 2024-09-11T00:15:41.966+0000 7f700c64d640 -1 mds.g *** got signal Terminated *** 2024-09-11T00:15:46.186 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:15:45 smithi019 podman[108607]: 2024-09-11 00:15:45.787571134 +0000 UTC m=+4.083833846 container died eafe4497e369b899191fe752d515657b69a2693a8ac6246d7729befcd14038ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T00:15:46.522 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:15:46 smithi019 podman[108607]: 2024-09-11 00:15:46.251693831 +0000 UTC m=+4.547956465 container cleanup eafe4497e369b899191fe752d515657b69a2693a8ac6246d7729befcd14038ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T00:15:46.523 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 11 00:15:46 smithi019 bash[108607]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-g 2024-09-11T00:15:46.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T00:15:46.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:46.727 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T00:15:46.727 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T00:15:46.728 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.j 2024-09-11T00:15:47.040 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 11 00:15:46 smithi019 systemd[1]: Stopping Ceph mds.j for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:47.522 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 11 00:15:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j[74289]: 2024-09-11T00:15:47.037+0000 7f3c5db49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:47.522 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 11 00:15:47 smithi019 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j[74289]: 2024-09-11T00:15:47.037+0000 7f3c5db49640 -1 mds.j *** got signal Terminated *** 2024-09-11T00:15:49.272 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 11 00:15:49 smithi019 podman[108723]: 2024-09-11 00:15:49.02125116 +0000 UTC m=+2.073365003 container died 6eb732705ca958007d2045f65aa03555cae6a6c6911ea5b56ee541269a77fadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T00:15:49.858 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 11 00:15:49 smithi019 podman[108723]: 2024-09-11 00:15:49.581152973 +0000 UTC m=+2.633266809 container cleanup 6eb732705ca958007d2045f65aa03555cae6a6c6911ea5b56ee541269a77fadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:15:49.858 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 11 00:15:49 smithi019 bash[108723]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-j 2024-09-11T00:15:50.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T00:15:50.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:50.051 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T00:15:50.051 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T00:15:50.051 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.b 2024-09-11T00:15:50.550 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:15:50 smithi131 systemd[1]: Stopping Ceph mds.b for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:50.812 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:15:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b[66435]: 2024-09-11T00:15:50.570+0000 7f1836b29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:50.812 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:15:50 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b[66435]: 2024-09-11T00:15:50.570+0000 7f1836b29640 -1 mds.b *** got signal Terminated *** 2024-09-11T00:15:53.924 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:15:53 smithi131 podman[71806]: 2024-09-11 00:15:53.65322894 +0000 UTC m=+3.407740126 container died 63217acb0f42df8c1c0bba1276ee34c2c6ad3e92a67db65a6178ad709f24f9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:15:54.288 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:15:54 smithi131 podman[71806]: 2024-09-11 00:15:54.003110241 +0000 UTC m=+3.757621427 container cleanup 63217acb0f42df8c1c0bba1276ee34c2c6ad3e92a67db65a6178ad709f24f9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:15:54.288 INFO:journalctl@ceph.mds.b.smithi131.stdout:Sep 11 00:15:54 smithi131 bash[71806]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-b 2024-09-11T00:15:54.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T00:15:54.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:54.469 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T00:15:54.469 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T00:15:54.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.e 2024-09-11T00:15:54.800 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:54 smithi131 systemd[1]: Stopping Ceph mds.e for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:15:54.800 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e[65814]: 2024-09-11T00:15:54.789+0000 7fe7247c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:54.800 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:54 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e[65814]: 2024-09-11T00:15:54.789+0000 7fe7247c0640 -1 mds.e *** got signal Terminated *** 2024-09-11T00:15:59.158 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:58 smithi131 podman[71938]: 2024-09-11 00:15:58.805335206 +0000 UTC m=+4.122404288 container died 9b41a39e69e901d4144e2c9ad38e90ee95c769de8000aa1a0a0d89b70a869d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:15:59.408 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:59 smithi131 podman[71938]: 2024-09-11 00:15:59.239539664 +0000 UTC m=+4.556608787 container cleanup 9b41a39e69e901d4144e2c9ad38e90ee95c769de8000aa1a0a0d89b70a869d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T00:15:59.408 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:59 smithi131 bash[71938]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e 2024-09-11T00:15:59.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T00:15:59.682 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:59 smithi131 podman[71950]: 2024-09-11 00:15:59.407320195 +0000 UTC m=+0.601340305 container remove 9b41a39e69e901d4144e2c9ad38e90ee95c769de8000aa1a0a0d89b70a869d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T00:15:59.682 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:59 smithi131 systemd[1]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-11T00:15:59.683 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:59 smithi131 systemd[1]: Stopped Ceph mds.e for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:15:59.683 INFO:journalctl@ceph.mds.e.smithi131.stdout:Sep 11 00:15:59 smithi131 systemd[1]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.e.service: Consumed 1.042s CPU time. 2024-09-11T00:15:59.694 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:15:59.694 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T00:15:59.694 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T00:15:59.694 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.h 2024-09-11T00:15:59.994 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:15:59 smithi131 systemd[1]: Stopping Ceph mds.h for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:16:00.300 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:15:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h[66123]: 2024-09-11T00:15:59.992+0000 7f6a867bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:00.300 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:15:59 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h[66123]: 2024-09-11T00:15:59.992+0000 7f6a867bf640 -1 mds.h *** got signal Terminated *** 2024-09-11T00:16:01.955 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:16:01 smithi131 podman[72058]: 2024-09-11 00:16:01.651079299 +0000 UTC m=+1.735469429 container died a994c3e521087cc71c0bfe21d1fd39917939d99d0013d9ebc14c2bcd5ddfac86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-11T00:16:02.263 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:16:02 smithi131 podman[72058]: 2024-09-11 00:16:02.045247473 +0000 UTC m=+2.129637598 container cleanup a994c3e521087cc71c0bfe21d1fd39917939d99d0013d9ebc14c2bcd5ddfac86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:16:02.264 INFO:journalctl@ceph.mds.h.smithi131.stdout:Sep 11 00:16:02 smithi131 bash[72058]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-h 2024-09-11T00:16:02.422 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T00:16:02.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:02.454 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T00:16:02.454 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T00:16:02.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.k 2024-09-11T00:16:02.800 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 11 00:16:02 smithi131 systemd[1]: Stopping Ceph mds.k for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:16:02.800 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 11 00:16:02 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k[65505]: 2024-09-11T00:16:02.748+0000 7f0b2dd36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:02.801 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 11 00:16:02 smithi131 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k[65505]: 2024-09-11T00:16:02.748+0000 7f0b2dd36640 -1 mds.k *** got signal Terminated *** 2024-09-11T00:16:06.175 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 11 00:16:05 smithi131 podman[72179]: 2024-09-11 00:16:05.891893842 +0000 UTC m=+3.225367610 container died 02c23f50332ecd1ae7f227c13a649a6fc1a239897a402eb3ae0501a9c7f38c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:06.175 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 11 00:16:06 smithi131 podman[72179]: 2024-09-11 00:16:06.174104956 +0000 UTC m=+3.507578714 container cleanup 02c23f50332ecd1ae7f227c13a649a6fc1a239897a402eb3ae0501a9c7f38c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T00:16:06.525 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 11 00:16:06 smithi131 bash[72179]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k 2024-09-11T00:16:06.525 INFO:journalctl@ceph.mds.k.smithi131.stdout:Sep 11 00:16:06 smithi131 podman[72192]: 2024-09-11 00:16:06.416903669 +0000 UTC m=+0.524161129 container remove 02c23f50332ecd1ae7f227c13a649a6fc1a239897a402eb3ae0501a9c7f38c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:16:06.545 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T00:16:06.577 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:06.577 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T00:16:06.577 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T00:16:06.577 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.c 2024-09-11T00:16:06.925 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:16:06 smithi135 systemd[1]: Stopping Ceph mds.c for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:16:07.425 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:16:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c[66878]: 2024-09-11T00:16:06.951+0000 7f762a0c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:07.425 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:16:06 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c[66878]: 2024-09-11T00:16:06.951+0000 7f762a0c4640 -1 mds.c *** got signal Terminated *** 2024-09-11T00:16:09.996 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:16:09 smithi135 podman[73116]: 2024-09-11 00:16:09.718903058 +0000 UTC m=+2.946793092 container died 7ea8e1614f6efb590164ff30a3cb6d68703a5a8b1f767da94fde5464ffb5a5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:16:10.378 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:16:10 smithi135 podman[73116]: 2024-09-11 00:16:10.092693051 +0000 UTC m=+3.320583073 container cleanup 7ea8e1614f6efb590164ff30a3cb6d68703a5a8b1f767da94fde5464ffb5a5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T00:16:10.378 INFO:journalctl@ceph.mds.c.smithi135.stdout:Sep 11 00:16:10 smithi135 bash[73116]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-c 2024-09-11T00:16:10.510 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T00:16:10.545 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:10.546 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T00:16:10.546 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T00:16:10.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.f 2024-09-11T00:16:10.882 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:10 smithi135 systemd[1]: Stopping Ceph mds.f for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:16:11.175 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:10 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f[66582]: 2024-09-11T00:16:10.879+0000 7fdabecb9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:11.176 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:10 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f[66582]: 2024-09-11T00:16:10.879+0000 7fdabecb9640 -1 mds.f *** got signal Terminated *** 2024-09-11T00:16:14.098 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:13 smithi135 podman[73250]: 2024-09-11 00:16:13.685381875 +0000 UTC m=+2.914515961 container died 835edba0c49bd27c7978875e22d402b6826661f6159f77d23517bfdc400b571b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-11T00:16:14.357 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:14 smithi135 podman[73250]: 2024-09-11 00:16:14.163045243 +0000 UTC m=+3.392179328 container cleanup 835edba0c49bd27c7978875e22d402b6826661f6159f77d23517bfdc400b571b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:14.357 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:14 smithi135 bash[73250]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f 2024-09-11T00:16:14.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T00:16:14.607 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:14 smithi135 podman[73261]: 2024-09-11 00:16:14.356144262 +0000 UTC m=+0.624956042 container remove 835edba0c49bd27c7978875e22d402b6826661f6159f77d23517bfdc400b571b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T00:16:14.607 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:14 smithi135 systemd[1]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.f.service: Deactivated successfully. 2024-09-11T00:16:14.607 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:14 smithi135 systemd[1]: Stopped Ceph mds.f for 8be8ba00-6fcf-11ef-bcea-c7b262605968. 2024-09-11T00:16:14.607 INFO:journalctl@ceph.mds.f.smithi135.stdout:Sep 11 00:16:14 smithi135 systemd[1]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.f.service: Consumed 4.625s CPU time. 2024-09-11T00:16:14.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:14.620 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T00:16:14.620 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T00:16:14.620 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.i 2024-09-11T00:16:14.925 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:16:14 smithi135 systemd[1]: Stopping Ceph mds.i for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:16:15.425 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:16:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i[67194]: 2024-09-11T00:16:14.950+0000 7f9b40a64640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:15.425 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:16:14 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i[67194]: 2024-09-11T00:16:14.950+0000 7f9b40a64640 -1 mds.i *** got signal Terminated *** 2024-09-11T00:16:18.043 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:16:17 smithi135 podman[73369]: 2024-09-11 00:16:17.685748518 +0000 UTC m=+2.842341680 container died d9bc917b5ce6d484283d6fbe82fd8faeafc490499f2c0e517e23a8e231aa18c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:18.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:16:18 smithi135 podman[73369]: 2024-09-11 00:16:18.142142669 +0000 UTC m=+3.298735831 container cleanup d9bc917b5ce6d484283d6fbe82fd8faeafc490499f2c0e517e23a8e231aa18c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T00:16:18.335 INFO:journalctl@ceph.mds.i.smithi135.stdout:Sep 11 00:16:18 smithi135 bash[73369]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-i 2024-09-11T00:16:18.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T00:16:18.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:18.594 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T00:16:18.594 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T00:16:18.594 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.l 2024-09-11T00:16:18.894 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:16:18 smithi135 systemd[1]: Stopping Ceph mds.l for 8be8ba00-6fcf-11ef-bcea-c7b262605968... 2024-09-11T00:16:19.175 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:16:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l[66265]: 2024-09-11T00:16:18.920+0000 7f51924ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:19.175 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:16:18 smithi135 ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l[66265]: 2024-09-11T00:16:18.920+0000 7f51924ad640 -1 mds.l *** got signal Terminated *** 2024-09-11T00:16:22.047 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:16:21 smithi135 podman[73491]: 2024-09-11 00:16:21.690124922 +0000 UTC m=+2.885019132 container died 2bda5cb7268ee3ee7c9f239372e183a561d7a18aedfa00bb95b0f671024a7272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-11T00:16:22.425 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:16:22 smithi135 podman[73491]: 2024-09-11 00:16:22.13755099 +0000 UTC m=+3.332445200 container cleanup 2bda5cb7268ee3ee7c9f239372e183a561d7a18aedfa00bb95b0f671024a7272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T00:16:22.425 INFO:journalctl@ceph.mds.l.smithi135.stdout:Sep 11 00:16:22 smithi135 bash[73491]: ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968-mds-l 2024-09-11T00:16:22.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8be8ba00-6fcf-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T00:16:22.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:22.632 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T00:16:22.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:16:22.845 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-11T00:16:25.314 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:16:25.516 INFO:teuthology.orchestra.run.smithi131.stdout:Deleting cluster with fsid: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-11T00:16:28.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:16:28.218 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-11T00:16:30.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:16:30.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:16:30.907 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:16:30.935 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T00:16:30.936 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi019/crash 2024-09-11T00:16:30.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:16:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:tar: /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:16:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:16:30.970 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi131/crash 2024-09-11T00:16:30.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:16:31.012 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:16:31.012 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:16:31.014 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi135/crash 2024-09-11T00:16:31.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:16:31.052 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:16:31.052 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:16:31.053 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T00:16:31.053 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T00:16:31.096 INFO:tasks.cephadm:Compressing logs... 2024-09-11T00:16:31.097 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:16:31.139 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:16:31.142 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:16:31.166 INFO:teuthology.orchestra.run.smithi019.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T00:16:31.166 INFO:teuthology.orchestra.run.smithi019.stderr:: No such file or directory 2024-09-11T00:16:31.166 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T00:16:31.167 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:16:31.167 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:16:31.167 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T00:16:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:16:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T00:16:31.170 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T00:16:31.170 INFO:teuthology.orchestra.run.smithi131.stderr:: No such file or directory 2024-09-11T00:16:31.170 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T00:16:31.170 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T00:16:31.170 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:16:31.170 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T00:16:31.171 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T00:16:31.171 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T00:16:31.172 INFO:teuthology.orchestra.run.smithi019.stderr: 84.0% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:16:31.172 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:16:31.172 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.g.log: /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:16:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T00:16:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T00:16:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:16:31.173 INFO:teuthology.orchestra.run.smithi019.stderr: 95.1% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T00:16:31.175 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:16:31.175 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T00:16:31.177 INFO:teuthology.orchestra.run.smithi019.stderr: 95.0% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T00:16:31.177 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T00:16:31.177 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T00:16:31.177 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T00:16:31.178 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log: 81.1% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:16:31.178 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:16:31.178 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:16:31.178 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.y.log: 94.9% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T00:16:31.179 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T00:16:31.179 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.x.log: 86.7% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:16:31.180 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:16:31.182 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log: 86.7% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:16:31.183 INFO:teuthology.orchestra.run.smithi019.stderr: 95.1% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T00:16:31.185 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T00:16:31.185 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.h.log: 90.9% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:16:31.185 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T00:16:31.185 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T00:16:31.188 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T00:16:31.189 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:16:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T00:16:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:16:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:16:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:16:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T00:16:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T00:16:31.200 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.e.log: 94.9% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T00:16:31.200 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:16:31.200 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:16:31.200 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T00:16:31.200 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:16:31.201 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:16:31.202 INFO:teuthology.orchestra.run.smithi019.stderr: 95.0% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T00:16:31.240 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 81.1% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:16:31.310 INFO:teuthology.orchestra.run.smithi135.stderr: 92.6% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T00:16:31.312 INFO:teuthology.orchestra.run.smithi135.stderr: 91.0% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:16:31.376 INFO:teuthology.orchestra.run.smithi135.stderr: 86.7% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:16:31.418 INFO:teuthology.orchestra.run.smithi131.stderr: 94.7% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T00:16:31.553 INFO:teuthology.orchestra.run.smithi019.stderr: 90.2% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T00:16:31.602 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T00:16:31.710 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:16:31.803 INFO:teuthology.orchestra.run.smithi135.stderr: 90.2% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:16:32.149 INFO:teuthology.orchestra.run.smithi019.stderr: 90.3% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T00:16:33.891 INFO:teuthology.orchestra.run.smithi135.stderr: 91.7% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T00:16:37.846 INFO:teuthology.orchestra.run.smithi131.stderr: 94.9% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T00:16:42.909 INFO:teuthology.orchestra.run.smithi019.stderr: 91.5% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T00:16:44.663 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T00:16:45.361 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T00:16:46.482 INFO:teuthology.orchestra.run.smithi019.stderr: 91.6% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T00:16:46.532 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T00:16:47.302 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T00:16:47.304 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-09-11T00:16:47.304 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m16.147s 2024-09-11T00:16:47.304 INFO:teuthology.orchestra.run.smithi131.stderr:user 1m4.484s 2024-09-11T00:16:47.304 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m1.971s 2024-09-11T00:16:47.540 INFO:teuthology.orchestra.run.smithi019.stderr: 91.8% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T00:16:49.353 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T00:16:49.604 INFO:teuthology.orchestra.run.smithi019.stderr: 91.7% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T00:16:49.609 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-11T00:16:49.609 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m18.452s 2024-09-11T00:16:49.609 INFO:teuthology.orchestra.run.smithi019.stderr:user 1m1.299s 2024-09-11T00:16:49.609 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m1.876s 2024-09-11T00:16:50.650 INFO:teuthology.orchestra.run.smithi135.stderr: 95.1% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T00:18:16.263 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T00:18:21.649 INFO:teuthology.orchestra.run.smithi135.stderr: 91.7% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T00:19:03.193 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T00:19:22.222 INFO:teuthology.orchestra.run.smithi135.stderr: 91.9% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T00:19:52.432 INFO:teuthology.orchestra.run.smithi135.stderr: 95.0% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T00:24:40.510 INFO:teuthology.orchestra.run.smithi135.stderr: 93.4% -- replaced with /var/log/ceph/8be8ba00-6fcf-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi135.stderr:real 8m9.392s 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi135.stderr:user 5m59.679s 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m14.272s 2024-09-11T00:24:40.550 INFO:tasks.cephadm:Archiving logs... 2024-09-11T00:24:40.550 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi019/log 2024-09-11T00:24:40.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:24:50.728 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi131/log 2024-09-11T00:24:50.729 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:25:01.959 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi135/log 2024-09-11T00:25:01.961 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:25:56.962 INFO:tasks.cephadm:Removing cluster... 2024-09-11T00:25:56.963 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 --force 2024-09-11T00:25:57.177 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-11T00:25:57.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 --force 2024-09-11T00:25:57.753 INFO:teuthology.orchestra.run.smithi131.stdout:Deleting cluster with fsid: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-11T00:25:58.137 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8be8ba00-6fcf-11ef-bcea-c7b262605968 --force 2024-09-11T00:25:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 8be8ba00-6fcf-11ef-bcea-c7b262605968 2024-09-11T00:25:59.193 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T00:25:59.193 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:25:59.212 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:25:59.228 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:25:59.245 INFO:tasks.cephadm:Teardown complete 2024-09-11T00:25:59.245 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T00:25:59.263 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T00:25:59.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:25:59.266 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:25:59.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:25:59.436 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T00:25:59.448 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T00:25:59.448 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:25:59.451 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:25:59.454 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:25:59.466 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:25:59.466 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:25:59.468 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:25:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:25:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-09-11T00:25:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -590us[ -584us] +/- 43ms 2024-09-11T00:25:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 0 +889us[ +889us] +/- 57ms 2024-09-11T00:25:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -157us[ -152us] +/- 85ms 2024-09-11T00:25:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:25:59.472 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:25:59.472 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-11T00:25:59.472 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -600us[ -595us] +/- 43ms 2024-09-11T00:25:59.472 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 +912us[ +912us] +/- 57ms 2024-09-11T00:25:59.472 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -146us[ -146us] +/- 86ms 2024-09-11T00:25:59.472 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:25:59.543 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:25:59.543 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-11T00:25:59.543 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -592us[ -602us] +/- 44ms 2024-09-11T00:25:59.543 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +895us[ +886us] +/- 57ms 2024-09-11T00:25:59.543 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -172us[ -172us] +/- 86ms 2024-09-11T00:25:59.543 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:25:59.544 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T00:25:59.554 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T00:25:59.554 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T00:25:59.565 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:25:59.654 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:25:59.722 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:25:59.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:25:59.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:25:59.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:25:59.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:25:59.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:25:59.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:25:59.942 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T00:25:59.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T00:25:59.965 INFO:teuthology.task.internal:Duration was 2475.617404 seconds 2024-09-11T00:25:59.965 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T00:25:59.977 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T00:25:59.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:25:59.980 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:25:59.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:26:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:26:00.021 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:26:00.054 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:26:00.508 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T00:26:00.509 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T00:26:00.509 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:26:00.533 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-09-11T00:26:00.533 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:26:00.553 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-11T00:26:00.553 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:26:00.575 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T00:26:00.576 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:26:00.578 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:26:00.596 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:26:00.643 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T00:26:00.643 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:26:00.648 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:26:00.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:26:01.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T00:26:01.634 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T00:26:01.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:26:01.660 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:26:01.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:26:01.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T00:26:01.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:26:01.733 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:26:01.735 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:26:01.755 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-11T00:26:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-09-11T00:26:01.825 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-11T00:26:01.847 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:26:01.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:26:01.863 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:26:01.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:26:01.878 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:26:01.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:26:01.896 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T00:26:01.907 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T00:26:01.909 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi019 2024-09-11T00:26:01.909 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:26:01.966 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi131 2024-09-11T00:26:01.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:26:02.003 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899807/remote/smithi135 2024-09-11T00:26:02.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:26:02.046 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T00:26:02.046 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:26:02.050 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:26:02.052 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:26:02.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T00:26:02.110 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T00:26:02.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T00:26:02.122 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T00:26:02.122 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:26:02.125 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:26:02.127 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:26:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:26 /home/ubuntu/cephtest 2024-09-11T00:26:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:26 /home/ubuntu/cephtest 2024-09-11T00:26:02.154 INFO:teuthology.orchestra.run.smithi135.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:26 /home/ubuntu/cephtest 2024-09-11T00:26:02.155 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T00:26:02.167 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T00:26:02.278 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} duration: 2475.6174035072327 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-11T00:26:02.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:26:02.372 INFO:teuthology.run:pass